/irc-logs / w3c / #testing / 2015-08-20 / end

Options:

Previous day, Next day

  1. # Session Start: Thu Aug 20 00:00:00 2015
  2. # Session Ident: #testing
  3. # [00:54] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  4. # [01:01] * Joins: jyasskin (~textual@public.cloak)
  5. # [01:01] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  6. # [02:18] * Joins: jyasskin (~textual@public.cloak)
  7. # [03:05] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  8. # [03:16] * terri is now known as terri_offline
  9. # [03:37] * Joins: gitbot (~gitbot@public.cloak)
  10. # [03:37] -gitbot:#testing- [web-platform-tests] hayatoito closed pull request #2097: Remove test-003.html (master...remove_event_test003) https://github.com/w3c/web-platform-tests/pull/2097
  11. # [03:37] * Parts: gitbot (~gitbot@public.cloak)
  12. # [04:09] * Joins: gitbot (~gitbot@public.cloak)
  13. # [04:09] -gitbot:#testing- [web-platform-tests] TakayoshiKochi opened pull request #2099: Fix event path trimming test case (master...event_dispatch_003) https://github.com/w3c/web-platform-tests/pull/2099
  14. # [04:09] * Parts: gitbot (~gitbot@public.cloak)
  15. # [04:57] * Joins: jyasskin (~textual@public.cloak)
  16. # [05:08] * Quits: jyasskin (~textual@public.cloak) (Client closed connection)
  17. # [05:09] * Joins: jyasskin (~textual@public.cloak)
  18. # [05:52] * Joins: MK (kawamori@public.cloak)
  19. # [06:25] * Joins: gamekathu (~gamekathu@public.cloak)
  20. # [06:42] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  21. # [06:42] * Quits: hgl (~hgl@public.cloak) (Ping timeout: 180 seconds)
  22. # [07:09] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  23. # [07:56] * Joins: jyasskin (~textual@public.cloak)
  24. # [08:26] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  25. # [09:32] * Joins: dom (dom@public.cloak)
  26. # [10:24] * Joins: Ms2ger (~Ms2ger@public.cloak)
  27. # [10:41] * Disconnected
  28. # [11:31] * Attempting to rejoin channel #testing
  29. # [11:31] * Rejoined channel #testing
  30. # [13:21] * Quits: gamekathu (~gamekathu@public.cloak) ("Page closed")
  31. # [13:33] <gsnedders> is all metadata now in the test files?
  32. # [13:36] <gsnedders> "Tests must be HTML, XHTML or SVG files." — can we not have arbitrary XML?
  33. # [13:38] <Ms2ger> In the test files or in the file name
  34. # [13:39] <gsnedders> in the file name? where is this documented?
  35. # [13:40] <Ms2ger> I have no idea
  36. # [13:40] <Ms2ger> But we have -manual and something with https
  37. # [13:44] <gsnedders> And what is the relation between the hg copy of the csswg-tests and the git copy?
  38. # [13:44] <gsnedders> Should I be ignoring one of them? Why do they both still exist?
  39. # [13:44] <MikeSmith> the git repo is just a mirror, right?
  40. # [13:45] <gsnedders> MikeSmith: but there are loads of issues and PRs open on it, so should I be submitting new tests on GitHub and pretended the non-mirror hg doesn't exist?
  41. # [13:45] <gsnedders> I am so confused.
  42. # [13:45] <gsnedders> And I bloody well worked on this stuff for years. >_>
  43. # [13:45] <MikeSmith> plinss can probably clear that up
  44. # [13:46] <MikeSmith> I doubt he's online yet though
  45. # [13:46] <MikeSmith> but anyway I think he's the one to talk to about all things csswg-tests
  46. # [13:46] <gsnedders> http://testthewebforward.org/docs/github-101.html tells you to use git, but then if you look at the github page it just says it's a mirror
  47. # [13:47] <gsnedders> "Please note that although we will grant write access directly to the Mercurial repo, it is strongly advised to use GitHub for test submissions to enable reviewers to use its built-in review tools. Direct submissions to Mercurial should be limited to administrative or housekeeping tasks, very minor changes that don't require a review, or from advanced users of the system."
  48. # [13:47] <gsnedders> If everything is done through Github nowadays, why on earth does the Mercurial repo still exist?
  49. # [13:47] * MikeSmith didn't write that part of the docs nor ever touch it so can't really say
  50. # [13:48] <MikeSmith> anyway, all good questions
  51. # [13:48] <MikeSmith> it's just that I don't think anybody who's normally around here can answer them authoratively
  52. # [13:48] <gsnedders> I left you guys to handle all of this when I vanished because I trusted you to keep things sane, pff! :P
  53. # [13:48] <MikeSmith> hahah
  54. # [13:48] <MikeSmith> see what happens!
  55. # [13:49] <MikeSmith> so the lesson for you is to never disappear again
  56. # [13:49] <MikeSmith> because clearly things just go all to hell while you're gone
  57. # [13:49] <gsnedders> is there any easy way to modify an HTML page programmatically *without* changing the serialisation of it all? hmmm
  58. # [13:50] <Ms2ger> gsnedders, hey, wpt is nice
  59. # [13:50] <Ms2ger> gsnedders, setting input.value?
  60. # [13:52] <gsnedders> input.value?
  61. # [13:52] <Ms2ger> gsnedders, and I fixed the description of csswg-test
  62. # [13:52] <gsnedders> Basically I want to add reftest link elements to hundreds of tests.
  63. # [13:52] <Ms2ger> Oh
  64. # [13:52] <Ms2ger> No
  65. # [13:52] <gsnedders> And I don't want to do that by hand.
  66. # [13:52] <Ms2ger> I mean, not if you use a parser
  67. # [13:53] <gsnedders> Yeah, exactly :\
  68. # [13:54] <gsnedders> this is part of the reason why I so much prefer external metadata
  69. # [13:58] <gsnedders> Ms2ger: that's not true, the new description, given the README says the hg copy is the canonical one
  70. # [13:58] <Ms2ger> For all intensive porpoises, it's true
  71. # [14:03] <gsnedders> tl;dr: I have all the Opera references, and the mapping from test to ref
  72. # [14:04] <gsnedders> I guess I'll add a moz-style manifest file to presto-testo as a first step
  73. # [14:04] <Ms2ger> Nice
  74. # [14:04] <Ms2ger> Do you have them by spec?
  75. # [14:08] <gsnedders> I'll just order the huge manifest file somehow, so we'll get a directory at a time
  76. # [14:11] <gsnedders> I'm wondering what to do with all the Opera XPath tests, because it seems like they should be in wpt
  77. # [14:11] <gsnedders> because whether we like it or not XPath is part of the platform
  78. # [14:12] <Ms2ger> That's document.evaluate()?
  79. # [14:12] <gsnedders> yeah
  80. # [14:13] <Ms2ger> We already have domxpath/ in wpt, feel free to add there
  81. # [14:14] <gsnedders> why did searching for "xpath" in the page not find that?
  82. # [14:14] <gsnedders> browsers!
  83. # [14:14] <gsnedders> and I don't know why we have two tests from Opera there rather than the thousand there are…
  84. # [14:15] <gsnedders> weird
  85. # [14:16] <Ms2ger> commit 3243c6ba43022564efe314c8f970062a3b5bb0b7
  86. # [14:16] <Ms2ger> Author: James Graham <jgraham@opera.com>
  87. # [14:16] <Ms2ger> Date: Mon Oct 15 10:34:08 2012 +0200
  88. # [14:16] <Ms2ger> Tests for interaction between XPath and the HTML parser
  89. # [14:16] <Ms2ger>
  90. # [14:16] <Ms2ger> --HG--
  91. # [14:16] <Ms2ger> extra : rebase_source : 06e4394fbd06e5b31a716d4080e8a3badc12e6ae
  92. # [14:17] <gsnedders> Doesn't really help know from where in Opera's test tree they're from, sadly
  93. # [14:17] <gsnedders> probably some bug directory that jgraham wrote as part of the HTML parser work
  94. # [14:17] <gsnedders> and the bug directories aren't public, because that'd be a nightmare
  95. # [14:17] <gsnedders> even though half the interesting stuff is there
  96. # [14:18] <Ms2ger> Yeah, sorting tests never seemed to be Opera's strong suit
  97. # [14:18] <gsnedders> they were sorted!
  98. # [14:18] <gsnedders> just not in a massively sane way
  99. # [14:18] <gsnedders> though most sorting schemes have some drawback or other
  100. # [14:20] <Ms2ger> How about jstest-futhark and jstest-core-2, which have mostly the same tests?
  101. # [14:24] <gsnedders> legacy of multiple JS engines co-existing at once, IIRC
  102. # [14:25] <gsnedders> and trying to have testsuites that should entirely pass
  103. # [14:25] <gsnedders> (which I'm never convinced is a worthwhile goal)
  104. # [14:25] <gsnedders> (you just need to know which tests are expected to fail)
  105. # [14:26] <Ms2ger> Right
  106. # [14:27] <Ms2ger> Multiple engines shouldn't be an issue if they can have separate expectations
  107. # [14:29] <gsnedders> there was really just a bunch of policies, some good and some bad, which led to the clusterfuck
  108. # [14:29] <Ms2ger> Anyway, water under the bridge
  109. # [14:29] * Ms2ger wonders if it'd be hard to deduplicate those automatically
  110. # [14:30] <MikeSmith> hmm, wondering why basically all of the html5lib tests in the wpt repo fail in Chrome
  111. # [14:30] <MikeSmith> e.g., http://w3c-test.org/html/syntax/parsing/html5lib_tests19.html
  112. # [14:31] <MikeSmith> ah
  113. # [14:31] <MikeSmith> nm
  114. # [14:31] <Ms2ger> Failed to read the 'contentDocument' property from 'HTMLIFrameElement': Blocked a frame with origin "http://w3c-test.org" from accessing a cross-origin frame.
  115. # [14:31] <MikeSmith> "Failed to read the 'contentDocument' property from 'HTMLIFrameElement': Blocked a frame with origin "http://w3c-test.org" from accessing a cross-origin frame."
  116. # [14:31] <MikeSmith> yeah
  117. # [14:31] <Ms2ger> Data urls?
  118. # [14:31] <MikeSmith> must be
  119. # [14:31] <MikeSmith> gsnedders would know
  120. # [14:32] <MikeSmith> we had discussion about this recently somewhere
  121. # [14:32] <MikeSmith> wonder if we could switch to using srcdoc instead
  122. # [14:32] <MikeSmith> for those
  123. # [14:34] <Ms2ger> Servo doesn't have srcdoc :)
  124. # [14:34] <Ms2ger> Not sure we actually run those tests
  125. # [14:35] <MikeSmith> oh
  126. # [14:35] <gsnedders> MikeSmith: it's cross-origin data URIs
  127. # [14:35] <MikeSmith> yeah
  128. # [14:35] <gsnedders> MikeSmith: but I don't really know about html/syntax/parsing much, mostly I just maintain the upstream stuff :P
  129. # [14:35] <MikeSmith> hai
  130. # [14:42] <MikeSmith> gsnedders: I'm guessing https://gsnedders.html5.org/html5lib-tests/runner.html hasn't been updated in quite a while
  131. # [14:42] <MikeSmith> and I suppose there there's no other way to run them online
  132. # [14:43] <MikeSmith> so that I can give somebody else a link to them so they can run them themselves in whatever browser/version they want
  133. # [14:50] * Joins: Ms2ger` (~Ms2ger@public.cloak)
  134. # [14:50] * Quits: Ms2ger (~Ms2ger@public.cloak) ("Leaving")
  135. # [14:53] <gsnedders> MikeSmith: hah, no
  136. # [14:53] <gsnedders> MikeSmith: that's /anicent/
  137. # [14:55] <Ms2ger`> <script src="http://sloth.whyi.org/~whiskey/cgi-bin/delay.py?delay=600"></script>
  138. # [15:09] <gsnedders> hah
  139. # [15:21] <gsnedders> Ms2ger`: where is that? that shouldn't have made it out, really
  140. # [15:22] <Ms2ger`> $ git grep whiskey
  141. # [15:22] <Ms2ger`> jstest-core-2/demos/inspector/index.html: <a href="http://i100.ryd.student.liu.se/~whiskey/js/inspector/inspector.py">
  142. # [15:22] <Ms2ger`> jstest-core-2/scheduler-regression/interruptedInlineScript3.html: <script src="http://sloth.whyi.org/~whiskey/cgi-bin/delay.py?delay=600"></script>
  143. # [15:22] <Ms2ger`> jstest-core-2/scheduler-regression/interruptedInlineScript4.html: document.write ("<" + "script src=\"http://sloth.whyi.org/~whiskey/cgi-bin/delay.py?delay=600\"></" + "script>");
  144. # [15:22] <Ms2ger`> jstest-futhark/demos/inspector/index.html: <a href="http://i100.ryd.student.liu.se/~whiskey/js/inspector/inspector.py">
  145. # [15:22] <gsnedders> hahaha
  146. # [15:24] <gsnedders> but yeah, those testsuites were mostly abandoned long ago… slightly surprising that they didn't get hit by my work on removing external servers, but whatever
  147. # [16:09] <Ms2ger`> <script type="sun/javascript">
  148. # [16:33] * Joins: jyasskin (~textual@public.cloak)
  149. # [16:46] * Quits: dom (dom@public.cloak) ("")
  150. # [16:49] * Joins: dom (dom@public.cloak)
  151. # [16:53] * Joins: playjax (~chatzilla@public.cloak)
  152. # [16:58] <Ms2ger`> gsnedders, fyi: https://github.com/w3c/csswg-test/pull/820
  153. # [17:00] * terri_offline is now known as terri
  154. # [17:02] <gsnedders> Ms2ger`: taht the ancient email?
  155. # [17:03] <Ms2ger`> Based on something I pushed to bitbucket in 2011
  156. # [17:03] <Ms2ger`> So "ancient" pretty much covers it
  157. # [17:03] <gsnedders> I think that's an email from me from years ago :)
  158. # [17:04] <Ms2ger`> Quite possible
  159. # [17:05] <Ms2ger`> Apparently I didn't bother mentioning where I got them :)
  160. # [17:10] <ato> Ms2ger`: I just
  161. # [17:10] <gsnedders> Ms2ger`: looks like it's those tests :)
  162. # [17:10] <ato> Ms2ger`: I just `git grep whiskey`’d my repo, but did not find any scotch )-:
  163. # [17:10] <gsnedders> Ms2ger`: see my comments
  164. # [17:10] <Ms2ger`> ato, in a Mozilla tree, look for bourbon instead :)
  165. # [17:11] <ato> Hah
  166. # [17:12] <AutomatedTester> yea... crazy north american's confused with the idea that Bourbon == Whiskey
  167. # [17:12] <AutomatedTester> but then again they call whiskey Scotch
  168. # [17:12] <AutomatedTester> ¯\_(ツ)_/¯
  169. # [17:23] * Joins: ddddd (~ddddd@public.cloak)
  170. # [17:23] * Quits: ddddd (~ddddd@public.cloak) ("Page closed")
  171. # [17:42] <Ms2ger`> I forgot how aggressively Microsoft fought the idea of having a testsuite for anything more than implementation reportds
  172. # [17:46] * Quits: dom (dom@public.cloak) ("")
  173. # [17:46] * Quits: playjax (~chatzilla@public.cloak) (Client closed connection)
  174. # [17:54] * Joins: bhill2 (~bhill2@public.cloak)
  175. # [17:56] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  176. # [17:58] <AutomatedTester> Ms2ger`: oh how they change?
  177. # [17:58] * Joins: bhill2 (~bhill2@public.cloak)
  178. # [18:01] <Ms2ger`> AutomatedTester, one hopes so
  179. # [18:51] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  180. # [19:07] <plinss> gsnedders: in the csswg-test repo you can have arbitrary XML, that’s fine
  181. # [19:07] <plinss> the hg repo is still considered our canonical repo as we have a lot of tooling built around it
  182. # [19:08] <plinss> the github mirror is a live bi-directional mirror, so submissions are welcome in either
  183. # [19:10] * Joins: bhill2 (~bhill2@public.cloak)
  184. # [19:23] <gsnedders> Ms2ger`: it was a weird time in the WG, the chairs pushing very very very hard to get CSS 2.1 to REC
  185. # [19:23] <gsnedders> Ms2ger`: most of us in the WG didn't care
  186. # [19:24] <gsnedders> Ms2ger`: most of us wanted the testsuite to be better even if it delayed REC
  187. # [19:24] <gsnedders> Ms2ger`: MS were some of the few who didn't, they wanted it to REC
  188. # [19:29] <gsnedders> plinss: wouldn't it kinda make sense to have hg as a read-only mirror, given the use of GitHub for review, keeping it just for the tooling?
  189. # [19:29] <plinss> gsnedders: we still have a number of active contributors that really prefer hg
  190. # [19:30] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  191. # [19:30] <plinss> the bi-directional sync seems to be working well, no real reason to remove it
  192. # [19:30] <gsnedders> plinss: but that takes them out of the normal review process
  193. # [19:31] <plinss> those pushing to hg tend to be the reviewers
  194. # [19:31] * Joins: bhill2 (~bhill2@public.cloak)
  195. # [19:32] <gsnedders> so, what, reviewer tests don't get reviewed?
  196. # [19:33] <plinss> no, all tests get reviewed at some point, they just don’t all have to be reviewed on github
  197. # [19:33] <plinss> we also have shepherd which predated github
  198. # [19:34] <gsnedders> bah, it seems silly to have multiple parallel processes.
  199. # [19:34] <gsnedders> but maybe that's just me :)
  200. # [19:34] <plinss> agreeed, but that’s the world we live in
  201. # [19:35] <gsnedders> where is most of the discussion about the CSS testsuite nowadays? #css-test seems as dead as it almost always has been, so I presume it' sjust mailing list as always?
  202. # [19:35] <plinss> yes
  203. # [19:36] <gsnedders> I'm probably going to do the rest of the massive dump of refs for tests that Opera had
  204. # [19:37] <gsnedders> and hope they actually get into the testsuite this time
  205. # [19:37] <plinss> that would be awesome
  206. # [19:57] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  207. # [20:01] * Joins: bhill2 (~bhill2@public.cloak)
  208. # [20:12] <Ms2ger`> plinss, r? https://github.com/w3c/csswg-test/pull/820
  209. # [20:12] <Ms2ger`> gsnedders, fwiw, Servo has the automated tests from the css21 suite in CI
  210. # [20:23] * Quits: Ms2ger` (~Ms2ger@public.cloak) ("nn")
  211. # [20:28] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  212. # [21:00] <gsnedders> I' starting to fear we don't have the data any more. Argh! Oh well, we can create it all again…
  213. # [21:01] <gsnedders> tl;dr: the metadata was stored in two places, one of which no longer exists. they may not have been entirely in sync. and the Opera summer party (and 20th anniversery party) is today so I don't have anyone with access to prod.
  214. # [21:06] <gsnedders> presto-testo/css/selectors/reftests contains crazy tests
  215. # [21:06] <gsnedders> I want to know who did that!
  216. # [21:07] <gsnedders> I presume they';re programmatically generated, bu t still
  217. # [21:11] <gsnedders> https://github.com/operasoftware/presto-testo/pull/49
  218. # [21:12] <gsnedders> I really want an easy way to add link elements to HTML files, because I feel like I'm gonna be doing that a lot
  219. # [21:13] <gsnedders> 7655 tests to add refs to
  220. # [21:13] * Joins: jyasskin (~textual@public.cloak)
  221. # [21:13] <gsnedders> suggestions anyone?
  222. # [21:57] <jgraham> gsnedders: Use a keyboard?
  223. # [21:57] <jgraham> Also, whyi!
  224. # [22:14] * Quits: jyasskin (~textual@public.cloak) ("My computer has gone to sleep. ZZZzzz…")
  225. # [22:45] * Quits: bhill2 (~bhill2@public.cloak) ("Leaving...")
  226. # [22:56] * Joins: bhill2 (~bhill2@public.cloak)
  227. # [22:56] * Joins: bhill2_ (~bhill2@public.cloak)
  228. # [23:03] * Quits: bhill2 (~bhill2@public.cloak) (Ping timeout: 180 seconds)
  229. # [23:27] <gsnedders> jgraham: that will take a long time!
  230. # [23:28] * Quits: bhill2_ (~bhill2@public.cloak) (Client closed connection)
  231. # [23:36] * terri is now known as terri_offline
  232. # Session Close: Fri Aug 21 00:00:00 2015

Previous day, Next day

Think these logs are useful? Then please donate to show your gratitude (and keep them up, of course). Thanks! — Krijn