/irc-logs / w3c / #testing / 2015-12-11 / end

Options:

Previous day, Next day

  1. # Session Start: Fri Dec 11 00:00:00 2015
  2. # Session Ident: #testing
  3. # [00:25] * terri is now known as terri_offline
  4. # [01:19] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  5. # [01:55] * Joins: gitbot (~gitbot@public.cloak)
  6. # [01:55] -gitbot:#testing- [web-platform-tests] inexorabletash opened pull request #2429: Use iframe.srcdoc instead of src with data: URLs (master...html5lib-use-srcdoc) https://github.com/w3c/web-platform-tests/pull/2429
  7. # [01:55] * Parts: gitbot (~gitbot@public.cloak)
  8. # [02:17] * Quits: bhill2_ (~bhill2@public.cloak) (Client closed connection)
  9. # [03:14] * heycam is now known as heycam|away
  10. # [04:13] * Joins: fwtnb (~fwtnb@public.cloak)
  11. # [04:21] * Joins: bhill2 (~bhill2@public.cloak)
  12. # [04:26] * Quits: fwtnb (~fwtnb@public.cloak) (Client closed connection)
  13. # [04:30] * Quits: bhill2 (~bhill2@public.cloak) (Ping timeout: 180 seconds)
  14. # [04:36] * Joins: bhill2 (~bhill2@public.cloak)
  15. # [04:49] * Quits: bhill2 (~bhill2@public.cloak) (Ping timeout: 180 seconds)
  16. # [05:01] * Joins: fwtnb (~fwtnb@public.cloak)
  17. # [05:01] * Quits: fwtnb (~fwtnb@public.cloak) (Client closed connection)
  18. # [05:01] * Joins: fwtnb (~fwtnb@public.cloak)
  19. # [06:25] * Joins: bhill2 (~bhill2@public.cloak)
  20. # [06:45] * Joins: Ms2ger (~Ms2ger@public.cloak)
  21. # [06:52] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  22. # [06:53] * Joins: bhill2 (~bhill2@public.cloak)
  23. # [07:09] * Joins: fwtnb_ (~fwtnb@public.cloak)
  24. # [07:10] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  25. # [07:10] * Quits: timeless (~sid4015@public.cloak) (Client closed connection)
  26. # [07:10] * Quits: tobie (~sid5692@public.cloak) (Client closed connection)
  27. # [07:10] * Quits: mkwst (~sid395@public.cloak) (Client closed connection)
  28. # [07:10] * Quits: koji (~sid53200@public.cloak) (koji)
  29. # [07:10] * Quits: krit (~sid15081@public.cloak) (krit)
  30. # [07:10] * Quits: hallvord (~sid83@public.cloak) (Client closed connection)
  31. # [07:10] * Quits: birtles (~sid16523@public.cloak) (Client closed connection)
  32. # [07:11] * Quits: fwtnb (~fwtnb@public.cloak) (Ping timeout: 180 seconds)
  33. # [07:11] * Quits: frewsxcv (~sid86219@public.cloak) (Client closed connection)
  34. # [07:11] * Quits: majidvp (~sid96638@public.cloak) (Client closed connection)
  35. # [07:11] * Quits: lmclister______ (~sid13822@public.cloak) (Client closed connection)
  36. # [07:11] * Quits: sangwhan (~sid12645@public.cloak) (Client closed connection)
  37. # [07:11] * Quits: scheib (~sid4467@public.cloak) (Client closed connection)
  38. # [07:11] * Joins: scheib (~sid4467@public.cloak)
  39. # [07:11] * Joins: frewsxcv (~sid86219@public.cloak)
  40. # [07:11] * Joins: majidvp (~sid96638@public.cloak)
  41. # [07:11] * Joins: hallvord (~sid83@public.cloak)
  42. # [07:11] * Joins: koji (~sid53200@public.cloak)
  43. # [07:11] * Joins: lmclister______ (~sid13822@public.cloak)
  44. # [07:11] * Joins: birtles (~sid16523@public.cloak)
  45. # [07:11] * Joins: sangwhan (~sid12645@public.cloak)
  46. # [07:11] * Joins: mkwst (~sid395@public.cloak)
  47. # [07:11] * Joins: krit (~sid15081@public.cloak)
  48. # [07:12] * Joins: timeless (~sid4015@public.cloak)
  49. # [07:12] * Joins: tobie (~sid5692@public.cloak)
  50. # [08:24] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  51. # [08:58] * Joins: dom (dom@public.cloak)
  52. # [10:38] * Quits: rniwa (~textual@public.cloak) ("My Mac has gone to sleep. ZZZzzz…")
  53. # [12:07] <MikeSmith> do we know if the Edge team is actually running tests in wptrunner now?
  54. # [12:08] <MikeSmith> I know jgraham got it working in Edge a couple months or so back but haven't heard if the Edge team has even tried it yet
  55. # [12:08] <jgraham> MikeSmith: actually running tests, yes, in wptrunner, no
  56. # [12:08] <MikeSmith> ok
  57. # [12:08] <jgraham> they have apparently made their own .net thing
  58. # [12:09] <MikeSmith> oh
  59. # [12:09] <MikeSmith> so are they going to use wptrunner eventually? at least maybe try it in parallel?
  60. # [12:09] <jgraham> (I would joke about rewriting wptrunner in Rust just for maximum NIH, but that actually sounds like an appealing idea, so I won't :)
  61. # [12:09] <MikeSmith> I guess it doesn't matter if their thing works with the harness as expected
  62. # [12:10] <MikeSmith> heh
  63. # [12:10] <jgraham> Yeah, I mean if their thing does what they want it's hard to argue that it's bad or wrong
  64. # [12:19] <MikeSmith> do we want that somebody all browser projects will be continuously publishing their current test results?
  65. # [12:19] <MikeSmith> I thought back in the day that's something we originally imagined we might end up having
  66. # [12:20] <jgraham> I would like that
  67. # [12:20] <MikeSmith> jgraham: lead by example? :)
  68. # [12:20] <MikeSmith> seems like Mozilla could be doing it now for gecko at least
  69. # [12:21] <MikeSmith> and for servo some subset at least
  70. # [12:21] <jgraham> We have someone working on a project for a (pure client side) web app for consuming wptrunner style logs into a queryable UI
  71. # [12:21] <jgraham> So you can use that on the data that we "publish" (in that you can get it from our CI system, but it's not that easy to find)
  72. # [12:22] <MikeSmith> I see
  73. # [12:22] <MikeSmith> that sounds pretty great
  74. # [12:34] <gsnedders> the problem with reimplementing wptrunner is we don't have a spec :P
  75. # [12:35] <jgraham> Well there is a bit of a problem there in terms of understanding the metadata and the ability to add new features
  76. # [12:36] <jgraham> But it's at least better than what google and wk seem to be doing which is just to piggyback these tests onto infrastructure designed for a different kind of test entirely
  77. # [12:38] <gsnedders> I'm not really that surprised, tbf. Adding a new test type is a fair bit of work, and neither WK/Blink have built-in WebDriver impls
  78. # [12:46] <gsnedders> (And I don't know ho wto solve that problem, really. I think it's understandable being weary of making your test infra rely on WebDriver.)
  79. # [12:54] <jgraham> *wary?
  80. # [13:04] <gsnedders> uh, yeah
  81. # [13:11] <jgraham> Well webdriver is in many ways an implementation detail. But you somehow want to deal with the possibility of the browser crashing when importing external tests, without having to just disable all tests that crash, or hold up importing the tests
  82. # [13:11] <jgraham> Servo does it by restarting the shell for every test, which is not ideal, but could be worse because it's so lightweight
  83. # [13:12] <jgraham> If you could write an entirely in-browser harness that could guarnatee that it flushed output to stdout before starting a new test that would work too
  84. # [13:31] * gsnedders wonders if it makes any difference to run Servo from a ramdisk for running tests
  85. # [13:31] <gsnedders> jgraham: also you have the fun of what if you get a result and /then/ crash
  86. # [13:32] <gsnedders> jgraham: or get a crash when navigating, and what do you attribute that too…
  87. # [13:32] <jgraham> Well yes, those things can happen of course
  88. # [13:32] <jgraham> But they're relatively rare
  89. # [13:47] <mkwst> gsnedders: Can we assume `blob` support in WPT? That is, would you be happy with a replacement for https://github.com/w3c/web-platform-tests/pull/2429 that stuffed everything into a blob and loaded that into an iframe? :)
  90. # [13:47] <mkwst> (Also thanks for the info on parsing. I have no idea how parsing works.)
  91. # [13:49] <jgraham> mkwst: Yeah, I'm happy with using blob
  92. # [13:50] <jgraham> If you can use that as the src of an iframe
  93. # [13:51] <jgraham> Basically the hard requirement is "normal document loading, not using document.write"
  94. # [13:51] <mkwst> jgraham: You can turn it into a URL via `URL.createObjectURL`.
  95. # [13:51] <mkwst> Testing it in FF now. Let's see if it explodes.
  96. # [13:52] <jgraham> mkwst: caniuse suggests there's enough support in latest released browsers to make that work
  97. # [13:53] <jgraham> Typically tests should use as few fancy features they aren't testing as possible, but at the minimum it should work on all released browsers (except the thing under test)
  98. # [13:53] <jgraham> is the unofficial standard
  99. # [13:54] <mkwst> Ok. I added a note to the PR. It looks like that might be a suitable workaround.
  100. # [13:56] <mkwst> Also, since you're here: does `tools/runner/index.html` respect the `.https.html` suffix? It looks like it's opening the cookie tests I'd like to add over HTTP.
  101. # [13:56] <mkwst> jgraham: ^^
  102. # [13:57] <gsnedders> jgraham: what's the reason we can't use d.w?
  103. # [13:57] * Joins: plh (plehegar@public.cloak)
  104. # [13:57] <gsnedders> jgraham: script execution and nested d.w?
  105. # [13:57] <jgraham> gsnedders: document.write is already supported with a different query string
  106. # [13:58] <jgraham> and experience suggests it gives different bugs
  107. # [13:58] <jgraham> mkwst: Quite possibly not
  108. # [13:59] <jgraham> The runner is missing some features because I don't really use it for anything so it doesn't get updated much
  109. # [14:00] <jgraham> mkwst: I don't think it would be hard to fix
  110. # [14:02] <gsnedders> jgraham: it gives different bugs? bah.
  111. # [14:02] <gsnedders> jgraham: I'm surprised the codepath is sufficiently different
  112. # [14:03] <gsnedders> jgraham: how do we get query strings to the manifest nowadays?
  113. # [14:04] <jgraham> gsnedders: You can set metadata in the test file to indicate that there are multiple possible alternates
  114. # [14:05] <jgraham> Look in one of these tests for an example
  115. # [14:05] <jgraham> It's a bit of an obscure feature though
  116. # [14:05] <gsnedders> oh, all the way at the top
  117. # [14:05] <gsnedders> I was too busy looking at the script :)
  118. # [14:08] <mkwst> jgraham: I see. Ok. I haven't dug through the relevant code to see how anything works, but I imagine you'd accept patches?
  119. # [14:14] <jgraham> mkwst: Indeed
  120. # [14:17] <gsnedders> jgraham: "To update them use the script /tools/scripts/update_html5lib_tests.py.
  121. # [14:18] <gsnedders> jgraham: that doesn't exist
  122. # [14:18] * gsnedders fixes that…
  123. # [14:20] <gsnedders> uh…
  124. # [14:20] <gsnedders> pnin:web-platform-tests gsnedders$ git submodule update
  125. # [14:20] <gsnedders> fatal: reference is not a tree: 9a88717bfd2e985fd6620ae6588911cc2bd1f02d
  126. # [14:20] <gsnedders> Unable to checkout '9a88717bfd2e985fd6620ae6588911cc2bd1f02d' in submodule path 'resources'
  127. # [14:20] <gsnedders> Why was it not fetching resources?
  128. # [14:22] * Joins: gitbot (~gitbot@public.cloak)
  129. # [14:22] -gitbot:#testing- [web-platform-tests] gsnedders opened pull request #2430: Fix the HTML parsing test README to have correct path to script (master...parsing-html5lib-update-path) https://github.com/w3c/web-platform-tests/pull/2430
  130. # [14:22] * Parts: gitbot (~gitbot@public.cloak)
  131. # [14:37] * Joins: gitbot (~gitbot@public.cloak)
  132. # [14:37] -gitbot:#testing- [web-platform-tests] mikewest created mkwst/blob (+1 new commit): https://github.com/w3c/web-platform-tests/commit/7cdc05e8bd06
  133. # [14:37] -gitbot:#testing- web-platform-tests/mkwst/blob 7cdc05e Mike West: Stop using `data:` URLs in html/syntax/parsing...
  134. # [14:37] * Parts: gitbot (~gitbot@public.cloak)
  135. # [14:37] * Joins: gitbot (~gitbot@public.cloak)
  136. # [14:37] -gitbot:#testing- [web-platform-tests] mikewest opened pull request #2431: Stop using `data:` URLs in html/syntax/parsing (master...mkwst/blob) https://github.com/w3c/web-platform-tests/pull/2431
  137. # [14:37] * Parts: gitbot (~gitbot@public.cloak)
  138. # [14:39] <mkwst> ^^ Blob version of Josh's patch. It works locally in my testing.
  139. # [14:43] <jgraham> mkwst: Seems OK to me. If we merge it I'll start an import into gecko and run the whole thing through our try infra
  140. # [14:44] <mkwst> jgraham: Ok. If both you and gsnedders are fine with it, I'll merge it.
  141. # [14:58] * heycam|away is now known as heycam
  142. # [15:04] <gsnedders> mkwst: LGTM
  143. # [15:05] * Joins: Ms2ger (~Ms2ger@public.cloak)
  144. # [15:12] * Joins: gitbot (~gitbot@public.cloak)
  145. # [15:12] -gitbot:#testing- [web-platform-tests] mikewest closed pull request #2431: Stop using `data:` URLs in html/syntax/parsing (master...mkwst/blob) https://github.com/w3c/web-platform-tests/pull/2431
  146. # [15:12] * Parts: gitbot (~gitbot@public.cloak)
  147. # [15:12] * Joins: gitbot (~gitbot@public.cloak)
  148. # [15:12] -gitbot:#testing- [web-platform-tests] mikewest pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/ccef0bbb95ffb5530ad4ec2e1ef748340cf4fe64
  149. # [15:12] -gitbot:#testing- web-platform-tests/master ccef0bb Mike West: Merge pull request #2431 from w3c/mkwst/blob...
  150. # [15:12] * Parts: gitbot (~gitbot@public.cloak)
  151. # [15:12] <mkwst> Thanks. Merged.
  152. # [16:01] * Joins: gitbot (~gitbot@public.cloak)
  153. # [16:01] -gitbot:#testing- [web-platform-tests] jgraham closed pull request #2430: Fix the HTML parsing test README to have correct path to script (master...parsing-html5lib-update-path) https://github.com/w3c/web-platform-tests/pull/2430
  154. # [16:01] * Parts: gitbot (~gitbot@public.cloak)
  155. # [16:01] * Joins: fwtnb (~fwtnb@public.cloak)
  156. # [16:04] * Quits: fwtnb (~fwtnb@public.cloak) (Client closed connection)
  157. # [16:04] * Joins: fwtnb (~fwtnb@public.cloak)
  158. # [16:08] * Quits: fwtnb_ (~fwtnb@public.cloak) (Ping timeout: 180 seconds)
  159. # [16:11] * Quits: fwtnb (~fwtnb@public.cloak) (Ping timeout: 180 seconds)
  160. # [16:34] * Quits: dom (dom@public.cloak) ("")
  161. # [17:05] * Quits: plh (plehegar@public.cloak) ("Leaving")
  162. # [17:07] * Joins: plh (plehegar@public.cloak)
  163. # [18:03] * Quits: plh (plehegar@public.cloak) ("Leaving")
  164. # [18:25] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  165. # [18:28] * heycam is now known as heycam|away
  166. # [18:47] * Joins: bhill2 (~bhill2@public.cloak)
  167. # [19:02] * Joins: Ms2ger (~Ms2ger@public.cloak)
  168. # [19:03] * Joins: gitbot (~gitbot@public.cloak)
  169. # [19:03] -gitbot:#testing- [web-platform-tests] inexorabletash closed pull request #2429: Use iframe.srcdoc instead of src with data: URLs (master...html5lib-use-srcdoc) https://github.com/w3c/web-platform-tests/pull/2429
  170. # [19:03] * Parts: gitbot (~gitbot@public.cloak)
  171. # [19:05] * Joins: fwtnb (~fwtnb@public.cloak)
  172. # [19:13] * Quits: fwtnb (~fwtnb@public.cloak) (Ping timeout: 180 seconds)
  173. # [19:15] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  174. # [19:18] * Joins: Ms2ger (~Ms2ger@public.cloak)
  175. # [19:37] * Joins: plh (plehegar@public.cloak)
  176. # [19:45] * terri_offline is now known as terri
  177. # [20:16] * terri is now known as terri_offline
  178. # [20:25] * heycam|away is now known as heycam
  179. # [20:27] * Quits: plh (plehegar@public.cloak) (Ping timeout: 180 seconds)
  180. # [20:35] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  181. # [20:35] * Joins: plh (plehegar@public.cloak)
  182. # [20:35] * terri_offline is now known as terri
  183. # [20:45] * Joins: Ms2ger (~Ms2ger@public.cloak)
  184. # [20:52] * heycam is now known as heycam|away
  185. # [21:05] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  186. # [21:07] * Joins: Ms2ger (~Ms2ger@public.cloak)
  187. # [21:30] * Quits: plh (plehegar@public.cloak) ("Leaving")
  188. # [21:31] * Joins: plh (plehegar@public.cloak)
  189. # [21:34] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  190. # [22:07] * Joins: gitbot (~gitbot@public.cloak)
  191. # [22:07] -gitbot:#testing- [csswg-test] cbiesinger opened pull request #980: Upstream a Chrome Flexbox test (master...moreflex) https://github.com/w3c/csswg-test/pull/980
  192. # [22:07] * Parts: gitbot (~gitbot@public.cloak)
  193. # [22:09] * Quits: plh (plehegar@public.cloak) (Ping timeout: 180 seconds)
  194. # [22:14] * Joins: plh (plehegar@public.cloak)
  195. # [22:45] * Joins: rniwa (~textual@public.cloak)
  196. # [23:00] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  197. # [23:02] * Joins: bhill2 (~bhill2@public.cloak)
  198. # [23:41] * heycam|away is now known as heycam
  199. # [23:52] * Joins: Ms2ger (~Ms2ger@public.cloak)
  200. # [23:55] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  201. # [23:59] * Joins: bhill2 (~bhill2@public.cloak)
  202. # Session Close: Sat Dec 12 00:00:00 2015

Previous day, Next day

Think these logs are useful? Then please donate to show your gratitude (and keep them up, of course). Thanks! — Krijn