/irc-logs / w3c / #testing / 2014-03-31 / end

Options:

  1. # Session Start: Mon Mar 31 00:00:00 2014
  2. # Session Ident: #testing
  3. # [00:16] * Joins: yankhates_cb (~yankhatescb@public.cloak)
  4. # [00:19] * Joins: heycam|away (~cam@public.cloak)
  5. # [00:27] * Joins: zcorpan (~zcorpan@public.cloak)
  6. # [00:34] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  7. # [01:28] * Joins: zcorpan (~zcorpan@public.cloak)
  8. # [01:35] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  9. # [01:57] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
  10. # [02:01] * Joins: ptressel (~chatzilla@public.cloak)
  11. # [02:29] * Joins: zcorpan (~zcorpan@public.cloak)
  12. # [02:36] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  13. # [03:02] * Joins: yankhates_cb (~yankhatescb@public.cloak)
  14. # [03:30] * Joins: zcorpan (~zcorpan@public.cloak)
  15. # [03:37] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  16. # [03:37] * heycam|away is now known as heycam
  17. # [04:08] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
  18. # [04:30] * Joins: zcorpan (~zcorpan@public.cloak)
  19. # [04:38] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  20. # [04:41] * heycam is now known as heycam|away
  21. # [04:47] * Joins: yankhates_cb (~yankhatescb@public.cloak)
  22. # [05:01] * Quits: ptressel (~chatzilla@public.cloak) ("reboot")
  23. # [05:16] * Joins: ptressel (~chatzilla@public.cloak)
  24. # [05:20] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
  25. # [05:31] * Joins: zcorpan (~zcorpan@public.cloak)
  26. # [05:38] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  27. # [06:24] * Joins: glenn_ (~gadams@public.cloak)
  28. # [06:30] * Quits: glenn (~gadams@public.cloak) (Ping timeout: 180 seconds)
  29. # [06:32] * Joins: zcorpan (~zcorpan@public.cloak)
  30. # [06:39] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  31. # [06:40] * Joins: yankhates_cb (~yankhatescb@public.cloak)
  32. # [06:46] * Quits: glenn_ (~gadams@public.cloak) ("Leaving...")
  33. # [07:07] * heycam|away is now known as heycam
  34. # [07:12] * heycam is now known as heycam|away
  35. # [07:13] * heycam|away is now known as heycam
  36. # [07:13] * heycam is now known as heycam|away|away
  37. # [07:13] * heycam|away|away is now known as heycam|away
  38. # [07:14] * heycam|away is now known as heycam|away|away
  39. # [07:33] * Joins: zcorpan (~zcorpan@public.cloak)
  40. # [07:40] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  41. # [08:10] * heycam|away|away is now known as heycam
  42. # [08:20] * Joins: edoyle (~edoyle@public.cloak)
  43. # [08:33] * Joins: zcorpan (~zcorpan@public.cloak)
  44. # [08:33] * Joins: gitbot (~gitbot@public.cloak)
  45. # [08:33] -gitbot:#testing- [web-platform-tests] yunxiaoxie opened pull request #818: Remove test files in IndexedDB/submissions/Opera/invalid (master...yunxiaoxie/invalid) https://github.com/w3c/web-platform-tests/pull/818
  46. # [08:33] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  47. # [08:39] * Joins: gitbot (~gitbot@public.cloak)
  48. # [08:39] -gitbot:#testing- [web-platform-tests] yunxiaoxie opened pull request #819: Move a test for createObjectStore to IndexedDB/ (master...yunxiaoxie/createObjectStore) https://github.com/w3c/web-platform-tests/pull/819
  49. # [08:39] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  50. # [08:40] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  51. # [08:41] * Joins: Lachy_ (~Lachy@public.cloak)
  52. # [08:41] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
  53. # [09:06] * Joins: zcorpan (~zcorpan@public.cloak)
  54. # [09:13] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  55. # [09:13] * heycam is now known as heycam|away
  56. # [09:14] * Joins: dom (dom@public.cloak)
  57. # [09:28] * Joins: Ms2ger (~Ms2ger@public.cloak)
  58. # [09:45] * Quits: edoyle (~edoyle@public.cloak) (Ping timeout: 180 seconds)
  59. # [09:57] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  60. # [10:06] * Joins: Ms2ger (~Ms2ger@public.cloak)
  61. # [10:06] * Joins: zcorpan (~zcorpan@public.cloak)
  62. # [10:16] * Quits: Ms2ger (~Ms2ger@public.cloak) ("Leaving")
  63. # [10:21] * Joins: Ms2ger (~Ms2ger@public.cloak)
  64. # [10:37] * Quits: Lachy_ (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  65. # [10:46] * Joins: darobin (rberjon@public.cloak)
  66. # [11:06] * Joins: Lachy (~Lachy@public.cloak)
  67. # [11:25] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  68. # [11:29] * Joins: zcorpan (~zcorpan@public.cloak)
  69. # [11:36] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  70. # [11:45] * Joins: zcorpan_ (~zcorpan@public.cloak)
  71. # [11:46] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  72. # [11:46] * Joins: gitbot (~gitbot@public.cloak)
  73. # [11:46] -gitbot:#testing- [web-platform-tests] alsemenov opened pull request #820: tests for callbacks attached and changed (master...submission/unipro-custom-elements-7) https://github.com/w3c/web-platform-tests/pull/820
  74. # [11:46] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  75. # [11:51] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  76. # [12:18] * Quits: zcorpan_ (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  77. # [12:23] * Joins: edoyle (~edoyle@public.cloak)
  78. # [12:27] * Joins: zcorpan (~zcorpan@public.cloak)
  79. # [12:29] * Joins: abarsto (~abarsto@public.cloak)
  80. # [12:29] * abarsto is now known as ArtB
  81. # [12:45] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  82. # [12:57] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  83. # [13:04] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  84. # [13:12] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  85. # [13:19] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  86. # [13:40] * Quits: edoyle (~edoyle@public.cloak) (Ping timeout: 180 seconds)
  87. # [14:17] * Joins: plh (plehegar@public.cloak)
  88. # [14:25] * Quits: scott_gonzalez (~scott_gonzalez@public.cloak) (scott_gonzalez)
  89. # [14:26] <darobin> jgraham: do you reckon it's possible to make the timeout overrideable from the runner?
  90. # [14:26] * darobin isn't sure how to communicate that information to the tests
  91. # [14:26] <jgraham> darobin: You should be able to set the timeout multiplier
  92. # [14:26] <jgraham> darobin: What's the actual problem?
  93. # [14:27] <darobin> my problem is: the Surface I have to run IE with is pretty slow, and I'm getting timeouts that I'm almost sure aren't
  94. # [14:27] <darobin> the issue shows up with pages like the DOM Range tests that run 8000 tests
  95. # [14:28] <darobin> jgraham: can you set that using the query string or something?
  96. # [14:34] <jgraham> darobin: So the timeout_multiplier is a bit hard to set, which might be a flaw
  97. # [14:34] <jgraham> The design idea was that you could set it in testharnessreport.js
  98. # [14:34] <darobin> jgraham: it's not urgent, but it would be nice; I'm pretty sure that if I'm hitting slow runs on a Surface that weighs 3kg, it's not going to be better on mobile
  99. # [14:35] <darobin> ah, yeah, heh
  100. # [14:35] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
  101. # [14:35] <jgraham> darobin: Yeah, I haven't looked too hard at the timeouts I get from mobile yet
  102. # [14:35] <jgraham> Although I do turn rendering of the results off, which does help
  103. # [14:36] <darobin> I wonder if we could place the test runner popup offscreen to get the same effect (up to a point)
  104. # [14:37] <jgraham> I don't think that will help
  105. # [14:39] <jgraham> Probably the right solution is to make the test setup easier to manipulate from the outside
  106. # [14:40] <jgraham> For the gecko tests I use a custom testharnessreport.js
  107. # [14:40] <jgraham> We could make the default testharnessreport.js do something like if (window.opener && "testharness_properties" in window.opener) {setup(window.opener.testharness_properties)}
  108. # [14:41] <jgraham> And make the runner set the timeout multiplier and the render options in a global on the window
  109. # [14:42] <jgraham> darobin: I actually think that's the simplest option
  110. # [14:43] * Joins: Ms2ger (~Ms2ger@public.cloak)
  111. # [14:45] <darobin> mmmmmm
  112. # [14:45] <darobin> you know what, that's actually pretty smart
  113. # [14:45] <jgraham> zcorpan: Any idea if you will have a chance to look at the preload tests or the query-encoding ones in the near future?
  114. # [14:45] <zcorpan> jgraham: in the unstable list, you mean?
  115. # [14:45] <jgraham> zcorpan: Yeah
  116. # [14:46] <jgraham> The preload ones seem to be pretty broken for me :|
  117. # [14:46] <zcorpan> jgraham: my plan was to look over the list this week
  118. # [14:46] <jgraham> zcorpan: Awesome
  119. # [14:46] <jgraham> darobin: You going to make a patch or shall I?
  120. # [14:46] <darobin> jgraham: it's not a high priority for me, but I can do it if you don't
  121. # [14:46] <darobin> if you happen to be on it right now, then by all means go ahead
  122. # [14:47] <jgraham> darobin: Well I'm really waiting for some other tests to run, so I think I can do this
  123. # [14:48] <darobin> awesome
  124. # [14:48] <darobin> there certainly is a strong http://xkcd.com/303/ nature to this testing stuff
  125. # [14:56] <Ms2ger> We should make jgraham compile more
  126. # [14:57] <jgraham> I don't make a very good compiler
  127. # [15:04] * Quits: dom (dom@public.cloak) (Ping timeout: 180 seconds)
  128. # [15:15] <sangwhan> anybody with knowledge about how these magical css-wg tests work?
  129. # [15:15] <sangwhan> it's very different from anything else i've dealt with :|
  130. # [15:19] <Ms2ger> "not very well"
  131. # [15:19] * ato_ is now known as ato
  132. # [15:23] <jgraham> sangwhan: I think the process is that you ignore them until someone converts them to work with web-platform-tests
  133. # [15:24] <jgraham> Unless you want to be that person
  134. # [15:24] <jgraham> In which case you do it without asking, otherwise you will get some long spiel about how it isn't possible
  135. # [15:24] * Quits: Lachy (~Lachy@public.cloak) ("Textual IRC Client: www.textualapp.com")
  136. # [15:25] <Ms2ger> You'll get that anyway
  137. # [15:25] * Joins: Lachy (~Lachy@public.cloak)
  138. # [15:26] <jgraham> Yeah, but then you'll already have a working solution so it won't matter what people say
  139. # [15:26] <jgraham> Stop energy is less effective when it's ex post facto
  140. # [15:28] * zcorpan wonders if sangwhan still wants to carry on with whatever he wanted to do with the css tests
  141. # [15:29] <Ms2ger> I know I don't
  142. # [15:29] <zcorpan> might as well put up a sign "DANGER, NO ONE HAS RETURNED ALIVE TO DATE"
  143. # [15:30] <zcorpan> but is it that bad?
  144. # [15:36] <sangwhan> jgraham: i ain't asking for more work here, nice try though. i haven't touched layout code during my entire career apart from that occasional crash bug anyway
  145. # [15:36] * sangwhan doesn't get a warm vibe from all these warnings
  146. # [15:38] * sangwhan notes zcorpan is the official opera css man after all
  147. # [15:41] <zcorpan> sangwhan: i was trying to question jgraham's and Ms2ger's warnings :-P i haven't interacted much with css tests myself yet other than contributing some tests, which has been no problem
  148. # [15:43] <Ms2ger> I once tried to write references for existing tests
  149. # [15:43] <Ms2ger> That definitely was that bad
  150. # [15:43] <zcorpan> Ms2ger: ok :-(
  151. # [15:44] <Ms2ger> Also, reviews don't work at all
  152. # [15:45] <sangwhan> do they use Github for reviews? because that sure would do the trick
  153. # [15:48] <jgraham> No, they use some custom thing
  154. # [15:48] <jgraham> zcorpan: There has been a lot of resistance to integrating CSS tests with the wider testing effort
  155. # [15:49] <jgraham> Because the wider testing effort doesn't want to bear the cost of things that the CSSWG have decided are needed
  156. # [15:51] * Joins: gitbot (~gitbot@public.cloak)
  157. # [15:51] -gitbot:#testing- [web-platform-tests] jgraham created jgraham/testharness_properties (+2 new commits): https://github.com/w3c/web-platform-tests/compare/6a18298b0c56^...ed99811cfde3
  158. # [15:51] -gitbot:#testing- web-platform-tests/jgraham/testharness_properties 6a18298 James Graham: Allow harness to set properties in testharness.js
  159. # [15:51] -gitbot:#testing- web-platform-tests/jgraham/testharness_properties ed99811 James Graham: Update resources directory
  160. # [15:51] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  161. # [15:52] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  162. # [15:53] <sangwhan> some stuff i can clearly see being non-trivial to do in say testharness.js, so they probably have some valid points
  163. # [15:54] * Joins: gitbot (~gitbot@public.cloak)
  164. # [15:54] -gitbot:#testing- [web-platform-tests] jgraham opened pull request #821: Allow testharness properties to be set from the runner (master...jgraham/testharness_properties) https://github.com/w3c/web-platform-tests/pull/821
  165. # [15:54] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  166. # [15:56] <jgraham> sangwhan: The problem isn't the tests themselves
  167. # [15:56] <jgraham> It's all the metadata requirements
  168. # [15:56] <jgraham> (including review requirements)
  169. # [15:57] <jgraham> and the fact that they don't want to store actual tests but things that can be built to form tests
  170. # [15:59] <Ms2ger> sangwhan, things that would be easier as reftests? Because we have reftests in wpt ;)
  171. # [15:59] <jgraham> Apart from the last problem it's pretty obvious that the solution is to accept CSS tests into web-platform-tests and then for the CSS WG to use that as a pool of tests that they can draw from, do the extra work to ensure that review is only done by their approved reviewers, and that all their metadata requirements are met
  172. # [16:00] <jgraham> The rest of us could then just use the tests in w-p-t as is, or use the CSS-WG filtered subset, according to prefeerence
  173. # [16:00] <Ms2ger> I would not object to that
  174. # [16:01] <sangwhan> jgraham: i was blissfully aware of these requirements you mention
  175. # [16:02] <jgraham> darobin: Please add yourself as a reviewer for the runner directory
  176. # [16:02] <sangwhan> so you are saying these tests are "compiled"?
  177. # [16:02] <jgraham> darobin: In the meantime, have two reviews
  178. # [16:02] <sangwhan> quoting "but things that can be built to form tests"
  179. # [16:02] <jgraham> sangwhan: For at least some of the tests they use XML and generate HTML versions
  180. # [16:03] <sangwhan> in which case w-p-t can just take the generated versions i suppose
  181. # [16:03] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
  182. # [16:04] <jgraham> That doesn't seem like a great idea
  183. # [16:04] <jgraham> Since it would be so easy for things to get out of sync
  184. # [16:05] <jgraham> sangwhan: When someone evewntually does this work (from the CSSWG or otherwise) we'll have to figure out a solution
  185. # [16:06] <jgraham> Personally I tend to think that duplicating everything between HTML and XML has a rather high cost compared to the value
  186. # [16:07] <jgraham> There just aren't that many bugs that depend on the underlying format once you have a parsed document
  187. # [16:07] <sangwhan> Think it's a tricky call, CSSWG has members that are more interested in styling XML with CSS in a non-browser context
  188. # [16:08] <jgraham> Yep, and maybe those tests aren't suitable for web-platform-tests
  189. # [16:08] <zcorpan> might be more bugs with quirks mode
  190. # [16:08] <jgraham> I don't think those people should be allowed to hold the web hostage
  191. # [16:09] <plh> can we export the csswg tests in some ways?
  192. # [16:09] * darobin changes topic to '"Stop energy is less effective when it's ex post facto" --jgraham'
  193. # [16:09] <plh> like grab the approved directory or something
  194. # [16:10] <darobin> jgraham: I've added myself
  195. # [16:10] <jgraham> plh: Yeah, but we really want submitted and approved
  196. # [16:11] <jgraham> Although one could argue that submitted should go through PRs
  197. # [16:11] <plh> that might be easier indeed
  198. # [16:11] <jgraham> There's probably a little git-subtree dance we could do to import them
  199. # [16:11] <plh> would be difficult to automatically do a merge
  200. # [16:37] <Ms2ger> zcorpan, I do think running most tests in quirks mode too would be interesting
  201. # [16:41] * Joins: shepazu (schepers@public.cloak)
  202. # [16:44] <plh> so, after looking at the referrers from the 404, a good chunk of them come from outside, ie we can't do anything about them
  203. # [16:45] <plh> and some from questionable websites
  204. # [16:45] <plh> so, we shouldn't worry too much
  205. # [16:50] <plh> james, since you're looking at XHR tests it seems, I did try to fix a few more bugs on Saturday, including one in wptserve
  206. # [16:51] <plh> hopefully, Hallvord isn't fixing the same bugs
  207. # [17:07] <sangwhan> god, i wish github had a way for volunteers to help fix up PRs from other people
  208. # [17:09] <Ms2ger> sangwhan, didn't you hear? Github is perfect.
  209. # [17:10] <sangwhan> I should just embrace the change, right?
  210. # [17:10] <Ms2ger> Get off my lawn
  211. # [17:11] <Ms2ger> And github
  212. # [17:12] <jgraham> plh: Not really looking at the tests, just trying to help with the git issues
  213. # [17:12] <plh> oki
  214. # [17:17] * Joins: gitbot (~gitbot@public.cloak)
  215. # [17:17] -gitbot:#testing- [web-platform-tests] jgraham pushed 1 new commit to jgraham/testharness_properties: https://github.com/w3c/web-platform-tests/commit/aedcac217946872aa218bfb3b450a88aaf576493
  216. # [17:17] -gitbot:#testing- web-platform-tests/jgraham/testharness_properties aedcac2 James Graham: fixup! Update resources directory
  217. # [17:17] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  218. # [17:22] <jgraham> darobin: The Range test thing probably indicates that Gecko did the work to pass those tests, of which there are a lot, but which all pass when you comply with the specification
  219. # [17:22] <Ms2ger> Which Range test thing?
  220. # [17:22] <jgraham> Presto also passes them all, and from the point of view of "is the spec impelementable" that should be sufficient
  221. # [17:23] <darobin> mmmmmm
  222. # [17:23] <darobin> I should run tests on old Presto!
  223. # [17:23] <jgraham> Ms2ger: I seem to have accidentially read an email on public-html
  224. # [17:23] <darobin> silly me, how did I forget?
  225. # [17:23] <Ms2ger> Oh
  226. # [17:23] * Ms2ger ignores
  227. # [17:23] <darobin> lol
  228. # [17:23] <jgraham> Yeah, well I don't plan to make a habit of it
  229. # [17:24] <jgraham> But this was an unusually useful email
  230. # [17:24] <darobin> well, it's one I writed!
  231. # [17:24] <jgraham> In fact I didn't notice it was on public-html at all
  232. # [17:24] <darobin> I don't write much to public-html, but I do try to make it count
  233. # [17:24] <plh> darobin, I have the old presto engine if it would help you
  234. # [17:24] <plh> still the default one on linux
  235. # [17:24] <darobin> I have Opera 12.10, that's old Presto right?
  236. # [17:24] <plh> correct
  237. # [17:25] <jgraham> Yup
  238. # [17:25] <darobin> wonderful
  239. # [17:25] <Ms2ger> darobin, well, surely any email to p-h where you're not a complete moron improves the average :)
  240. # [17:26] * Joins: gitbot (~gitbot@public.cloak)
  241. # [17:26] -gitbot:#testing- [web-platform-tests] cynthia closed pull request #187: Add 4 tests for HTML sandboxing (5.4) (master...submissions/kinu_2) https://github.com/w3c/web-platform-tests/pull/187
  242. # [17:26] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  243. # [17:26] * Joins: gitbot (~gitbot@public.cloak)
  244. # [17:26] -gitbot:#testing- [web-platform-tests] cynthia reopened pull request #187: Add 4 tests for HTML sandboxing (5.4) (master...submissions/kinu_2) https://github.com/w3c/web-platform-tests/pull/187
  245. # [17:26] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  246. # [17:26] <darobin> Ms2ger: I find it difficult to simultaneously be a complete moron and a consistent moron
  247. # [17:26] <darobin> and, well, we value consistency around the Web don't we?
  248. # [17:26] <sangwhan> i see closing and reopening the review doesn't trigger critic
  249. # [17:27] <darobin> no, but it does tickle it
  250. # [17:27] <jgraham> It should
  251. # [17:27] <Ms2ger> darobin, stick with plain moron, then? :)
  252. # [17:27] <sangwhan> jgraham: https://github.com/w3c/web-platform-tests/pull/187
  253. # [17:28] <sangwhan> (found something where i dropped the ball, sorry about that)
  254. # [17:28] <darobin> Ms2ger: I can't do plain, no matter how hard I try I always come across as sexy
  255. # [17:28] * Ms2ger snorts
  256. # [17:28] <Ms2ger> sangwhan, hey, if you only dropped one ball... :)
  257. # [17:28] <sangwhan> range fails pretty hard on blink iirc
  258. # [17:28] <darobin> it's, like, I tried leaving the sexy at home but, man, it just kept chewing up the furniture
  259. # [17:28] <Ms2ger> You mean blink fails pretty hard on range :)
  260. # [17:29] * Joins: gitbot (~gitbot@public.cloak)
  261. # [17:29] -gitbot:#testing- [web-platform-tests] jgraham closed pull request #187: Add 4 tests for HTML sandboxing (5.4) (master...submissions/kinu_2) https://github.com/w3c/web-platform-tests/pull/187
  262. # [17:29] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  263. # [17:29] <sangwhan> also i fail pretty hard at english it seems
  264. # [17:29] * Joins: gitbot (~gitbot@public.cloak)
  265. # [17:29] -gitbot:#testing- [web-platform-tests] jgraham reopened pull request #187: Add 4 tests for HTML sandboxing (5.4) (master...submissions/kinu_2) https://github.com/w3c/web-platform-tests/pull/187
  266. # [17:29] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  267. # [17:29] * Ms2ger wonders why anything related to DOM would end up on p-h
  268. # [17:30] <darobin> can you folks get Presto to run the runner?
  269. # [17:30] <jgraham> Ms2ger: Ours is not to reason why, ours is just to prevent a complete screwup from happening
  270. # [17:31] <darobin> Ms2ger: because the HTML WG pwns the DOM these days
  271. # [17:31] <darobin> Ms2ger: do you want messages relating to CR exit for the DOM to be on www-dom?
  272. # [17:31] <darobin> because, you know, I can make your dream a reality
  273. # [17:31] <Ms2ger> No, I want them not to exist
  274. # [17:31] <darobin> one step at a time brother
  275. # [17:31] <Ms2ger> Sad that you have to waste your time on that
  276. # [17:31] <jgraham> darobin: WFM in presto
  277. # [17:31] <darobin> jgraham: version?
  278. # [17:32] <jgraham> 12.16
  279. # [17:32] <darobin> mmmmmmmmm
  280. # [17:33] * Quits: ptressel (~chatzilla@public.cloak) ("ff frozen")
  281. # [17:34] * Quits: zcorpan (~zcorpan@public.cloak) (Client closed connection)
  282. # [17:34] * Joins: lmclister (~lmclister@public.cloak)
  283. # [17:34] * Joins: zcorpan (~zcorpan@public.cloak)
  284. # [17:34] * Joins: lukeis (~Adium@public.cloak)
  285. # [17:35] <darobin> bah, somehow getting MANIFEST.json seems to make wptserve fall over
  286. # [17:35] <jgraham> ?!
  287. # [17:35] * Joins: edoyle (~edoyle@public.cloak)
  288. # [17:37] <darobin> this is insane
  289. # [17:41] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
  290. # [17:41] <darobin> well, it's driving me insane
  291. # [17:41] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  292. # [17:42] <Ms2ger> That would imply you weren't yet ;)
  293. # [17:48] * Quits: jgraham (~jgraham@public.cloak) (Ping timeout: 180 seconds)
  294. # [17:48] <sangwhan> i think w-p-t might soon need a search engine
  295. # [17:49] <sangwhan> along with the html spec
  296. # [17:50] * Joins: lmcliste_ (~lmclister@public.cloak)
  297. # [17:50] * Quits: lmclister (~lmclister@public.cloak) (Client closed connection)
  298. # [17:50] * Joins: gitbot (~gitbot@public.cloak)
  299. # [17:50] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/7594f7a962d91bb67a97f41b136186a84596da9c
  300. # [17:50] -gitbot:#testing- web-platform-tests/master 7594f7a Robin Berjon: add wptserve to ignores
  301. # [17:50] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  302. # [17:52] * Joins: jgraham (~jgraham@public.cloak)
  303. # [17:56] * Joins: rhauck (~Adium@public.cloak)
  304. # [17:56] <jgraham> darobin: http://hoppipolla.co.uk/410/presto-dom.json but it cost me my irc session to get it so if you already succeeded nevermind
  305. # [17:56] <darobin> jgraham: thanks a lot!
  306. # [17:57] <darobin> plh: jgraham just gave me one
  307. # [18:00] <darobin> jgraham: apparently you also ran into the timeout issue with http://www.w3c-test.org/dom/ranges/Range-mutations.html
  308. # [18:00] <darobin> it's the one that most affects IE, too
  309. # [18:00] <plh> yep, this one timeouts :(
  310. # [18:01] <plh> even if you pick /dom/range/
  311. # [18:01] <darobin> and it doesn't timeout when run directly
  312. # [18:01] <plh> or picked alone
  313. # [18:01] <plh> I enter /dom/ranges/Range-mutations and it worked
  314. # [18:01] <jgraham> That seems pretty odd
  315. # [18:02] <darobin> plh: the results with Presto look better! http://w3c.github.io/dom/test-results/less-than-2.html
  316. # [18:02] <jgraham> Anyway it doesn't have timeout=long
  317. # [18:02] <darobin> maybe it should
  318. # [18:02] <jgraham> (well not that syntax)
  319. # [18:02] <darobin> though when running it directly it's pretty fast
  320. # [18:03] * Joins: rhauck1 (~Adium@public.cloak)
  321. # [18:04] <jgraham> darobin: Did you update the table below?
  322. # [18:04] <jgraham> Oh, I see
  323. # [18:04] <jgraham> Nevermind
  324. # [18:04] <darobin> below?
  325. # [18:04] <jgraham> I'm pretty sure Presto should pass all the Range tests
  326. # [18:05] <darobin> maybe they're wrong?
  327. # [18:05] <plh> darobin, mutations says timeout in your table
  328. # [18:05] <darobin> https://critic.hoppipolla.co.uk/r/1128 is a-okay btw
  329. # [18:05] <plh> but I gave you the results
  330. # [18:05] <darobin> plh: oh, I thought you said it timed out for you too?
  331. # [18:05] <darobin> are you getting zero timeouts?
  332. # [18:05] <jgraham> Hmm, it apparently doesn't
  333. # [18:05] <plh> no, I said I ran it on the side then integrated the results by hand in the json
  334. # [18:05] <jgraham> Maybe the tests changed or something
  335. # [18:05] <darobin> plh: OH!
  336. # [18:06] <darobin> I didn't understand that
  337. # [18:06] * darobin gets plh's data
  338. # [18:06] * Joins: gitbot (~gitbot@public.cloak)
  339. # [18:06] -gitbot:#testing- [web-platform-tests] jgraham pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/3e544e8fec95549f7ef9cfa4a6f756abd1d85e99
  340. # [18:06] -gitbot:#testing- web-platform-tests/master 3e544e8 jgraham: Merge pull request #821 from w3c/jgraham/testharness_properties...
  341. # [18:06] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  342. # [18:06] * Quits: rhauck (~Adium@public.cloak) (Ping timeout: 180 seconds)
  343. # [18:07] * Joins: gitbot (~gitbot@public.cloak)
  344. # [18:07] -gitbot:#testing- [web-platform-tests] Velmont pushed 1 new commit to Velmont/move_ported_idb_tests: https://github.com/w3c/web-platform-tests/commit/1a9d9336bb7636a187f5c0421185b530fccce796
  345. # [18:07] -gitbot:#testing- web-platform-tests/Velmont/move_ported_idb_tests 1a9d933 Odin Hørthe Omdal: fixup! IndexedDB review fixes
  346. # [18:07] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  347. # [18:08] <darobin> plh: we're looking pretty good now
  348. # [18:08] <plh> nice
  349. # [18:14] <sangwhan> call me crazy, but i don't think any updates to presto were issued that would change the test results
  350. # [18:14] <sangwhan> or more of, issued to the public
  351. # [18:15] <jgraham> Unless you have a very recent presto-based TV, perhaps?
  352. # [18:16] <sangwhan> pretty much.
  353. # [18:27] * Joins: zcorpan (~zcorpan@public.cloak)
  354. # [18:27] * Joins: gitbot (~gitbot@public.cloak)
  355. # [18:27] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/9361e9414715688e29facca5ee493177b34c3d33
  356. # [18:27] -gitbot:#testing- web-platform-tests/master 9361e94 Robin Berjon: Merge pull request #809 from w3c/move-template-element-tests...
  357. # [18:27] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  358. # [18:30] * Joins: gitbot (~gitbot@public.cloak)
  359. # [18:30] -gitbot:#testing- [web-platform-tests] deniak deleted move-template-element-tests at f974de7: https://github.com/w3c/web-platform-tests/commit/f974de7
  360. # [18:30] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  361. # [18:34] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  362. # [18:39] <darobin> plh: I can't get the HTML TS to run in IE, there's always something that just crashed the browser completely
  363. # [18:40] <darobin> (and I haven't managed to be looking at the screen when it crashes, to get an idea of what's wrong)
  364. # [18:40] <jgraham> darobin: That's the limitation of the in-browser runner
  365. # [18:41] <jgraham> It doens't account at all for the possibility of a test doing something bad to the browser
  366. # [18:41] <darobin> yeah, though I didn't expect it to crash things quite this often :)
  367. # [18:41] <darobin> that said I've been talking with Erika and they do get results
  368. # [18:41] <darobin> so hopefully we'll get stuff from them
  369. # [18:41] <plh> jgraham, I'm curious, do you know how many tests total we have in WPT nowadays? since you're ruuning all of them, you probably the number
  370. # [18:42] <plh> s//have/
  371. # [18:42] <jgraham> plh: I can find out, but I only have the number of files off the top of my head
  372. # [18:42] <jgraham> 3400 files
  373. # [18:42] <plh> I was more interested in the number of tests. if you find it, I'm curious
  374. # [18:43] <plh> thanks!
  375. # [18:43] * Quits: darobin (rberjon@public.cloak) (Client closed connection)
  376. # [18:43] * Joins: hober (~ted@public.cloak)
  377. # [18:44] <jgraham> plh: I can find it easilly, it's second on my queue :)
  378. # [18:53] <jgraham> plh: 195023 results from a recent firefox run
  379. # [18:53] <jgraham> Unless I miscounted, which isn't unlikely
  380. # [18:55] * Joins: ptressel (~chatzilla@public.cloak)
  381. # [19:01] * Quits: rhauck1 (~Adium@public.cloak) ("Leaving.")
  382. # [19:14] <astearns__> sangwhan: on fixing up other people's PRs, if you can get them to make you a collaborator in their repo, you can check in your own changes to their PR branch
  383. # [19:14] * astearns__ is now known as astearns
  384. # [19:16] * Joins: rhauck (~Adium@public.cloak)
  385. # [19:19] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  386. # [19:21] <plh> jgraham, thank you again
  387. # [19:24] <jgraham> astearns: For the typical case we have that's pretty hard
  388. # [19:24] <jgraham> (they have lost interest in the PR)
  389. # [19:25] <astearns> yeah, it has limited use, but when it works it's pretty slick
  390. # [19:26] <astearns> (and it took me a while to figure out that's what I needed to do)
  391. # [19:26] <wilhelm> jgraham: Will you implement a SPARTAN-runner-style is-the-browser-still-running-or-should-I-restart-it feature for the Firefox-flavoured runner?
  392. # [19:27] <jgraham> wilhelm: Huh?
  393. # [19:28] <jgraham> The firefox runner is totally automatic and kills the browser if it doesn't get a result after a set time
  394. # [19:28] * Joins: zcorpan (~zcorpan@public.cloak)
  395. # [19:28] <wilhelm> jgraham: Re: tests making the browsser crash.
  396. # [19:28] <wilhelm> -s
  397. # [19:28] * wilhelm cna't write today.
  398. # [19:28] <jgraham> There isn't anything like the thing to see if the event loop is empty
  399. # [19:32] <jgraham> (also if it crashes the browser connection typically dies and I get an exception which I call a crash)
  400. # [19:33] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
  401. # [19:34] * Quits: ptressel (~chatzilla@public.cloak) (Client closed connection)
  402. # [19:34] * Joins: ptressel (~chatzilla@public.cloak)
  403. # [19:35] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
  404. # [19:35] * Joins: rhauck (~Adium@public.cloak)
  405. # [19:35] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  406. # [19:38] * Joins: rhauck1 (~Adium@public.cloak)
  407. # [19:39] * Quits: rhauck (~Adium@public.cloak) (Client closed connection)
  408. # [19:50] * Quits: lmcliste_ (~lmclister@public.cloak) ("")
  409. # [19:51] * Joins: Lachy (~Lachy@public.cloak)
  410. # [19:55] * Quits: rhauck1 (~Adium@public.cloak) ("Leaving.")
  411. # [19:59] * Joins: rhauck (~Adium@public.cloak)
  412. # [20:07] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  413. # [20:14] * Joins: Lachy (~Lachy@public.cloak)
  414. # [20:29] * Joins: zcorpan (~zcorpan@public.cloak)
  415. # [20:32] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  416. # [20:36] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  417. # [20:37] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
  418. # [20:42] * Joins: Lachy (~Lachy@public.cloak)
  419. # [20:51] * Joins: shepazu (schepers@public.cloak)
  420. # [20:54] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  421. # [20:57] * Joins: Lachy (~Lachy@public.cloak)
  422. # [21:00] * Quits: shepazu (schepers@public.cloak) (Ping timeout: 180 seconds)
  423. # [21:04] * Joins: darobin (rberjon@public.cloak)
  424. # [21:05] * Joins: gitbot (~gitbot@public.cloak)
  425. # [21:05] -gitbot:#testing- [web-platform-tests] plehegar opened pull request #822: Better exception handling when creating nodes (master...plh/insertBefore-fix) https://github.com/w3c/web-platform-tests/pull/822
  426. # [21:05] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  427. # [21:06] * Joins: rhauck (~Adium@public.cloak)
  428. # [21:08] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  429. # [21:08] <plh> darobin, I just sent a PR for fix on IE and Safari for a DOM test btw
  430. # [21:09] <plh> https://github.com/w3c/web-platform-tests/pull/822
  431. # [21:09] <plh> both will now fail properly instead of undefined
  432. # [21:09] * Joins: shepazu (schepers@public.cloak)
  433. # [21:09] <darobin> plh: ah, cool!
  434. # [21:10] <plh> calling the test function recursively isn't a good idea
  435. # [21:10] * Joins: lmclister (~lmclister@public.cloak)
  436. # [21:17] <Ms2ger> plh, oh, you mean some tests weren't run?
  437. # [21:17] <plh> yes
  438. # [21:19] <darobin> that should be documented
  439. # [21:21] <Ms2ger> plh, reviewed https://critic.hoppipolla.co.uk/r/1134
  440. # [21:21] <Ms2ger> Oh, so did darobin, but not good enough :)
  441. # [21:22] <darobin> heh
  442. # [21:23] <plh> I'll need to find the option in my editor to see white spaces
  443. # [21:23] <Ms2ger> I don't have one either, but critic does :)
  444. # [21:24] <plh> it would still be nice to catch that before it goes into critic :)
  445. # [21:25] <Ms2ger> True
  446. # [21:25] <Ms2ger> git diff might show it too
  447. # [21:25] <Ms2ger> Though I'm not sure if it does by default
  448. # [21:26] <plh> ok, issues are addressed
  449. # [21:26] <darobin> git diff shows it red here without me doing anything about it
  450. # [21:27] <darobin> plh: which editor?
  451. # [21:27] <plh> Sublime Text nowadays
  452. # [21:28] <Ms2ger> plh, r+, thanks
  453. # [21:28] <plh> thank you!
  454. # [21:28] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
  455. # [21:28] * Joins: gitbot (~gitbot@public.cloak)
  456. # [21:28] -gitbot:#testing- [web-platform-tests] plehegar closed pull request #822: Better exception handling when creating nodes (master...plh/insertBefore-fix) https://github.com/w3c/web-platform-tests/pull/822
  457. # [21:28] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  458. # [21:28] * Joins: gitbot (~gitbot@public.cloak)
  459. # [21:28] -gitbot:#testing- [web-platform-tests] plehegar pushed 4 new commits to master: https://github.com/w3c/web-platform-tests/compare/9361e9414715...d64f7d7f9360
  460. # [21:28] -gitbot:#testing- web-platform-tests/master d370e6f plehegar: Better exception handling when creating nodes
  461. # [21:28] -gitbot:#testing- web-platform-tests/master b07866b plehegar: Removed extra whitespaces
  462. # [21:28] -gitbot:#testing- web-platform-tests/master 51fcefa plehegar: createProcessingInstruction is tested elsewhere already
  463. # [21:28] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  464. # [21:29] * Quits: ArtB (~abarsto@public.cloak) ("Leaving.")
  465. # [21:29] * Joins: zcorpan (~zcorpan@public.cloak)
  466. # [21:37] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  467. # [21:39] * Joins: Lachy (~Lachy@public.cloak)
  468. # [21:42] <darobin> jgraham: do you reckon that since you're already running the tests there you could get us a JSON dump of all the HTML test results for Gecko?
  469. # [21:48] <darobin> also, I hope no one actually reads this, but I have to admit that I've kind of gotten used to Critic
  470. # [21:51] * Joins: zcorpan (~zcorpan@public.cloak)
  471. # [21:51] * plh changes topic to '"also, I hope no one actually reads this, but I have to admit that I've kind of gotten used to Critic" --darobin'
  472. # [21:52] <jgraham> heh
  473. # [21:53] <edoyle> hi darobin, we're working on that IE results JSON dump for you right now
  474. # [21:53] <darobin> edoyle++ \o/
  475. # [21:54] <edoyle> still html and dom, right?
  476. # [21:54] <darobin> edoyle: we'd love to have both, ideally as separate dumps
  477. # [21:54] <jgraham> darobin: Probably
  478. # [21:54] <darobin> (but I can munge the data into parts if that's not possible)
  479. # [21:54] <edoyle> k
  480. # [21:55] <darobin> edoyle: do you have your own JSON format or is it the same as the runner? Or close?
  481. # [21:55] <darobin> jgraham: that sounds like the kind of "probably" that's asking for a bribe or something
  482. # [21:55] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
  483. # [21:57] <edoyle> darobin: i believe its the same, but i don't have access to the code
  484. # [21:58] <darobin> edoyle: so long as it contains the same data one way or another I'll be happy to transform it
  485. # [22:01] * Joins: rhauck (~Adium@public.cloak)
  486. # [22:02] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
  487. # [22:10] * Joins: rhauck (~Adium@public.cloak)
  488. # [22:21] * Quits: darobin (rberjon@public.cloak) ("Leaving...")
  489. # [22:24] <edoyle> hi jgraham, we are interested in talking to you about wptrunner-- more soon :)
  490. # [22:26] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
  491. # [22:26] <jgraham> edoyle: Great! I'm planning to send a mail to the list as soon as I have a way to run it that doesn't depend on having the whole of the mozilla codebase ;)
  492. # [22:27] <jgraham> (which should be soon, just need to release some dependencies)
  493. # [22:28] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  494. # [22:35] * Joins: gitbot (~gitbot@public.cloak)
  495. # [22:35] -gitbot:#testing- [web-platform-tests] shishimaru opened pull request #823: Tests for Section 2. MediaSource Object API in Media Source Extensions. (master...shishimaru/media-source-MediaSourceObjectAPI) https://github.com/w3c/web-platform-tests/pull/823
  496. # [22:35] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  497. # [22:37] * Joins: Lachy (~Lachy@public.cloak)
  498. # [22:48] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  499. # [22:49] * Joins: Lachy (~Lachy@public.cloak)
  500. # [22:52] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  501. # [22:54] * Joins: Lachy (~Lachy@public.cloak)
  502. # [22:57] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  503. # [22:57] * Joins: Lachy (~Lachy@public.cloak)
  504. # [23:09] * Quits: ptressel (~chatzilla@public.cloak) ("zzz")
  505. # [23:10] <edoyle> jgraham: sounds great!
  506. # [23:10] * Quits: edoyle (~edoyle@public.cloak) ("")
  507. # [23:10] <Ms2ger> plh++
  508. # [23:11] <plh> hu... what did I do?
  509. # [23:11] <Ms2ger> The topic
  510. # [23:11] <plh> oh :)
  511. # [23:17] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  512. # [23:17] * Joins: Lachy (~Lachy@public.cloak)
  513. # [23:24] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  514. # [23:36] * Joins: rhauck (~Adium@public.cloak)
  515. # [23:54] * Joins: edoyle (~edoyle@public.cloak)
  516. # [23:55] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  517. # Session Close: Tue Apr 01 00:00:00 2014

The end :)