/irc-logs / w3c / #testing / 2015-05-15 / end

Options:

Previous day, Next day

  1. # Session Start: Fri May 15 00:00:01 2015
  2. # Session Ident: #testing
  3. # [00:52] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  4. # [01:00] * Joins: bhill2 (~bhill2@public.cloak)
  5. # [01:23] * heycam|away is now known as heycam
  6. # [01:57] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  7. # [01:58] * Joins: bhill2 (~bhill2@public.cloak)
  8. # [02:02] * Joins: bhill2_ (~bhill2@public.cloak)
  9. # [02:04] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  10. # [02:13] * Quits: bhill2_ (~bhill2@public.cloak) (Client closed connection)
  11. # [02:13] * Joins: bhill2 (~bhill2@public.cloak)
  12. # [02:16] * Quits: ArtB (~ArtB@public.cloak) ("Leaving.")
  13. # [02:16] * Joins: ArtB (~ArtB@public.cloak)
  14. # [02:20] * Quits: bhill2 (~bhill2@public.cloak) (Ping timeout: 180 seconds)
  15. # [02:29] * Quits: MikeSmith (~MikeSmith@public.cloak) ("leaving")
  16. # [02:44] * terri is now known as terri_offline
  17. # [02:49] * Joins: playjax (~chatzilla@public.cloak)
  18. # [03:17] * Quits: ArtB (~ArtB@public.cloak) ("Leaving.")
  19. # [03:21] * heycam is now known as heycam|away
  20. # [03:28] * Joins: MikeSmith (~MikeSmith@public.cloak)
  21. # [03:39] * heycam|away is now known as heycam
  22. # [07:59] * heycam is now known as heycam|away
  23. # [09:38] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  24. # [09:54] * Joins: Ms2ger (~Ms2ger@public.cloak)
  25. # [09:58] * Joins: tripu (antonio@public.cloak)
  26. # [10:07] * Joins: Lachy (~Lachy@public.cloak)
  27. # [10:21] * Quits: playjax (~chatzilla@public.cloak) (Ping timeout: 180 seconds)
  28. # [10:43] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  29. # [10:46] * Joins: gitbot (~gitbot@public.cloak)
  30. # [10:46] -gitbot:#testing- [web-platform-tests] Ms2ger opened pull request #1832: Remove tabs from html/syntax/. (master...lint) https://github.com/w3c/web-platform-tests/pull/1832
  31. # [10:46] * Parts: gitbot (~gitbot@public.cloak)
  32. # [11:55] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  33. # [11:55] * Joins: ArtB (~ArtB@public.cloak)
  34. # [12:49] * Joins: gitbot (~gitbot@public.cloak)
  35. # [12:49] -gitbot:#testing- [web-platform-tests] chunywang opened pull request #1833: Add more Storage tests for WebStorage (master...webstorage/storage) https://github.com/w3c/web-platform-tests/pull/1833
  36. # [12:49] * Parts: gitbot (~gitbot@public.cloak)
  37. # [13:00] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  38. # [13:02] <odinho> ms2ger: pong. (but yo not here)
  39. # [13:02] <odinho> Anyway. What's special about 53(?) bits?
  40. # [13:02] <odinho> Or 0x20000000000000 as opposed to 0x20000000000000-1?
  41. # [13:03] <odinho> Ah, javascript ofc
  42. # [13:04] * Joins: gitbot (~gitbot@public.cloak)
  43. # [13:04] -gitbot:#testing- [web-platform-tests] chunywang opened pull request #1834: Add sessionStorage, localStorage manual tests (master...webstorage/storage-manual) https://github.com/w3c/web-platform-tests/pull/1834
  44. # [13:04] * Parts: gitbot (~gitbot@public.cloak)
  45. # [13:23] * Joins: gitbot (~gitbot@public.cloak)
  46. # [13:23] -gitbot:#testing- [web-platform-tests] Velmont created odinho/explain_magic_idbfactoryopen_version (+1 new commit): https://github.com/w3c/web-platform-tests/commit/cb38aa16f688
  47. # [13:23] -gitbot:#testing- web-platform-tests/odinho/explain_magic_idbfactoryopen_version cb38aa1 Odin Hørthe Omdal: IndexedDB: Explain magic numbers for IDBFactory.open version
  48. # [13:23] * Parts: gitbot (~gitbot@public.cloak)
  49. # [13:23] * Joins: gitbot (~gitbot@public.cloak)
  50. # [13:23] -gitbot:#testing- [web-platform-tests] Velmont opened pull request #1835: IndexedDB: Explain magic numbers for IDBFactory.open version (master...odinho/explain_magic_idbfactoryopen_version) https://github.com/w3c/web-platform-tests/pull/1835
  51. # [13:23] * Parts: gitbot (~gitbot@public.cloak)
  52. # [13:41] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  53. # [13:54] * Joins: gitbot (~gitbot@public.cloak)
  54. # [13:54] -gitbot:#testing- [wptrunner] jgraham created jgraham/servodriver_no_dom (+1 new commit): https://github.com/w3c/wptrunner/commit/a6908f90e5c7
  55. # [13:54] -gitbot:#testing- wptrunner/jgraham/servodriver_no_dom a6908f9 James Graham: Don't use the DOM to store results for servodriver.
  56. # [13:54] * Parts: gitbot (~gitbot@public.cloak)
  57. # [13:54] * Joins: gitbot (~gitbot@public.cloak)
  58. # [13:54] -gitbot:#testing- [wptrunner] jgraham opened pull request #110: Don't use the DOM to store results for servodriver. (master...jgraham/servodriver_no_dom) https://github.com/w3c/wptrunner/pull/110
  59. # [13:54] * Parts: gitbot (~gitbot@public.cloak)
  60. # [13:54] <jgraham> r? https://critic.hoppipolla.co.uk/r/5014
  61. # [14:26] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  62. # [14:37] * Joins: Ms2ger (~Ms2ger@public.cloak)
  63. # [14:50] * Joins: plh (plehegar@public.cloak)
  64. # [15:19] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  65. # [15:25] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
  66. # [15:29] <jgraham> Ms2ger: Did you want to look at https://critic.hoppipolla.co.uk/r/5014 ?
  67. # [15:30] <Ms2ger> Sure
  68. # [15:30] <Ms2ger> Wanna explain the motivation?
  69. # [15:31] * Ms2ger disappears for a bit first, though
  70. # [15:31] <jgraham> "I hoped it would work better". I'm not sure it *does* work better, but in general not dumping stuff into the dom when I don't have to seems like a win
  71. # [15:34] <Ms2ger> Why'd we do that in the first place?
  72. # [15:35] <jgraham> Put it in the DOM?
  73. # [15:35] <Ms2ger> Yeah
  74. # [15:35] <jgraham> Because I copied what I did for saucelabs I think
  75. # [15:35] <jgraham> Which I think I wrote in the lobby of a theatre
  76. # [15:35] <Ms2ger> Oh, and saucelabs only gives access to the dom?
  77. # [15:36] <jgraham> Well the strategy there was to select the DOM element using webdriver and read its text
  78. # [15:36] <jgraham> I'm not sure this approach wouldn't work better there too
  79. # [15:40] <jgraham> OTOH, it seems like no one is *that* interested in the saucelabs stuff
  80. # [15:43] <ato> I thought MikeSmith was.
  81. # [15:51] <plh> are we able to generate test results using saucelabs and make those available?
  82. # [15:52] <jgraham> "sort of"
  83. # [15:53] <jgraham> I mean it works, but it's super-slow at the moment
  84. # [15:53] <jgraham> More effort would be needed to make something that could actually run the whole testsuite
  85. # [15:53] <jgraham> (and it has to run against w3c-test.org which isn't ideal)
  86. # [15:54] <plh> not ideal because w3c-test.org isn't reliable enough or because it's too remote to saucelabs?
  87. # [15:56] <jgraham> Yes :)
  88. # [15:56] <jgraham> Or rather s/or/and/
  89. # [15:57] <jgraham> At the moment there are lots of non-trivial round trips involved in running the test
  90. # [15:58] <jgraham> It is possible to cut down the number of WebDriver calls that the harness makes, which will help
  91. # [15:58] <jgraham> It's also possible to turn off some of the saucelabs logging and so on
  92. # [15:58] <jgraham> It's not really possible to cut down the number of server accesses
  93. # [15:59] <plh> are you storing the results somewhere nowadays?
  94. # [16:00] <plh> I didn't think we know how to store results
  95. # [16:00] <AutomatedTester> jgraham: fwiw.... saucelabs is the reason why webdriver spec is trying to consolodate some calls
  96. # [16:00] <AutomatedTester> e.g. #location + #size is now in #rect
  97. # [16:01] <AutomatedTester> and actions is one end point instead of many
  98. # [16:01] <jgraham> AutomatedTester: BTW I mentioned to ato the other day that we should design the actions stuff so that you can use it to pipeline arbitary commands
  99. # [16:01] <jgraham> So that you could write a client API like
  100. # [16:02] <jgraham> webdriver.pipeline().get("http://example.com").find("#element").executeScript("return PASS").run()
  101. # [16:03] <jgraham> And it would be sent as a single HTTP call
  102. # [16:03] <jgraham> (this is a V2 feature ofc)
  103. # [16:03] <jgraham> plh: Nope, I don't have anywhere to store public results
  104. # [16:03] <AutomatedTester> the reason why we have not done that now is that people MAY want to put asserts between each of the calls
  105. # [16:03] <jgraham> AutomatedTester: No need to use RFC 2119 in normal text :)
  106. # [16:04] <AutomatedTester> i didnt mean it that way
  107. # [16:04] <jgraham> AutomatedTester: It feels like if you design it carefully it's a mondad :)
  108. # [16:04] <AutomatedTester> I used may like that because I have no idea how people would use it
  109. # [16:05] <jgraham> *Monad
  110. # [16:05] <AutomatedTester> I liked mondad better
  111. # [16:05] <AutomatedTester> :P
  112. # [16:05] <jgraham> Although maybe that doesn't buy you much…
  113. # [16:06] <jgraham> I mean clearly if one step fails the whole thing is going to fail
  114. # [16:06] <AutomatedTester> jgraham: it's definitely worth discussing
  115. # [16:06] <plh> jgraham, imho, having a fully functional saucelabs will only be valuable if we know how to store results and make them available to the community. I didn't put the storage question high on my list because only mozilla is able to give results so far and I wish we'd have at least an other browser as well
  116. # [16:06] <jgraham> And you can almost put arbitary code in there if you want using executeScript
  117. # [16:06] <AutomatedTester> as long as we can have decent reporting on which step failed
  118. # [16:07] <jgraham> I don't see why not
  119. # [16:07] <AutomatedTester> and there was enough of a need I am ok with doing a pipeline type call
  120. # [16:07] <jgraham> The only question is whether the output from one step can be the input to the next somehow
  121. # [16:09] <tobie> fwiw, saucelabs can store the results
  122. # [16:10] <tobie> (and has and API to query them)
  123. # [16:11] <plh> interesting. I guess it wouldn't work to store results coming from outside
  124. # [16:11] <jgraham> tobie: At least the way it works at the moment there isn't one saucelabs test per test
  125. # [16:12] <jgraham> iirc that seemed impractical for some reason (but I may not rc)
  126. # [16:22] <jgraham> It looks like you are supposed to quit() the browser after each test
  127. # [16:22] <jgraham> That isn't going to work
  128. # [16:25] <ato> AutomatedTester: I think pipelining is a very exciting idea because it’s basically just building on top of the action chains which we have already built into the spec.
  129. # [16:26] <ato> AutomatedTester: So if we make sure we word things in such a way that we can add this in a L2, that would be a big win I think.
  130. # [16:58] * Quits: plh (plehegar@public.cloak) ("Leaving")
  131. # [16:58] * Joins: plh (plehegar@public.cloak)
  132. # [17:39] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  133. # [17:54] * Joins: bhill2 (~bhill2@public.cloak)
  134. # [18:20] * Joins: Lachy (~Lachy@public.cloak)
  135. # [18:22] * Quits: hgl (~hgl@public.cloak) (Ping timeout: 180 seconds)
  136. # [18:23] * Joins: hgl (~hgl@public.cloak)
  137. # [18:45] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  138. # [19:18] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  139. # [19:19] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  140. # [19:59] * Joins: Lachy (~Lachy@public.cloak)
  141. # [20:11] * terri_offline is now known as terri
  142. # [20:52] * Quits: tripu (antonio@public.cloak) ("Leaving")
  143. # [20:56] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  144. # [22:54] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  145. # [22:55] * Quits: scott_gonzalez (~scott_gonzalez@public.cloak) (scott_gonzalez)
  146. # [22:59] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  147. # [23:00] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  148. # [23:03] * Joins: gitbot (~gitbot@public.cloak)
  149. # [23:03] -gitbot:#testing- [web-platform-tests] Ms2ger opened pull request #1836: Use a test per event type in a WebSocket events test. (master...ws-events) https://github.com/w3c/web-platform-tests/pull/1836
  150. # [23:03] * Parts: gitbot (~gitbot@public.cloak)
  151. # [23:45] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
  152. # Session Close: Sat May 16 00:00:00 2015

Previous day, Next day

Think these logs are useful? Then please donate to show your gratitude (and keep them up, of course). Thanks! — Krijn