/irc-logs / w3c / #testing / 2015-05-14 / end

Options:

Previous day, Next day

  1. # Session Start: Thu May 14 00:00:00 2015
  2. # Session Ident: #testing
  3. # [00:06] * Joins: bhill2 (~bhill2@public.cloak)
  4. # [00:14] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  5. # [00:28] * heycam|away is now known as heycam
  6. # [00:37] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
  7. # [00:49] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
  8. # [01:04] * Joins: bhill2 (~bhill2@public.cloak)
  9. # [01:13] * Quits: growthux (~growthux@public.cloak) ("Page closed")
  10. # [01:27] * Quits: Reinhold (~Reinhold@public.cloak) ("Page closed")
  11. # [01:54] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  12. # [01:54] * Joins: bhill2 (~bhill2@public.cloak)
  13. # [02:15] * Joins: bhill2_ (~bhill2@public.cloak)
  14. # [02:15] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  15. # [02:36] * Quits: bhill2_ (~bhill2@public.cloak) (Client closed connection)
  16. # [03:14] * Joins: gitbot (~gitbot@public.cloak)
  17. # [03:14] -gitbot:#testing- [web-platform-tests] zqzhang closed pull request #1823: Improve unplugging tests for Battery Status API (master...battery-status/updateCase) https://github.com/w3c/web-platform-tests/pull/1823
  18. # [03:14] * Parts: gitbot (~gitbot@public.cloak)
  19. # [03:30] * terri is now known as terri_offline
  20. # [04:12] * Quits: ArtB (~ArtB@public.cloak) ("Leaving.")
  21. # [05:00] * heycam is now known as heycam|away
  22. # [05:26] * Quits: scott_gonzalez (~scott_gonzalez@public.cloak) (Client closed connection)
  23. # [05:26] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
  24. # [05:39] * heycam|away is now known as heycam
  25. # [05:45] * Joins: playjax (~chatzilla@public.cloak)
  26. # [06:19] * Joins: tripu (antonio@public.cloak)
  27. # [06:47] * Joins: MK (kawamori@public.cloak)
  28. # [08:07] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  29. # [08:37] * Quits: playjax (~chatzilla@public.cloak) (Ping timeout: 180 seconds)
  30. # [08:47] * Joins: MK (kawamori@public.cloak)
  31. # [08:54] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  32. # [09:04] * Joins: MK (kawamori@public.cloak)
  33. # [09:20] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  34. # [09:26] * heycam is now known as heycam|away
  35. # [09:33] * Joins: MK (kawamori@public.cloak)
  36. # [09:46] * Quits: MK (kawamori@public.cloak) ("Leaving...")
  37. # [10:09] * Quits: tripu (antonio@public.cloak) ("Leaving")
  38. # [10:11] * Disconnected
  39. # [10:27] * Attempting to rejoin channel #testing
  40. # [10:27] * Rejoined channel #testing
  41. # [10:27] * Topic is '<jgraham> A programmer has a problem. They think "I know I'll use submodules". Now they have a tree of problems.'
  42. # [10:27] * Set by odinho on Thu Apr 02 15:58:23
  43. # [10:30] * Disconnected
  44. # [10:31] * Attempting to rejoin channel #testing
  45. # [10:31] * Rejoined channel #testing
  46. # [10:31] * Topic is '<jgraham> A programmer has a problem. They think "I know I'll use submodules". Now they have a tree of problems.'
  47. # [10:31] * Set by odinho on Thu Apr 02 15:58:23
  48. # [10:32] * Quits: krijnhoetmer (~krijnhoetmer@public.cloak) (Client closed connection)
  49. # [10:35] * Quits: tripu (antonio@public.cloak) (Ping timeout: 180 seconds)
  50. # [10:35] * Joins: tripu (antonio@public.cloak)
  51. # [10:35] * Joins: jgraham (~jgraham@public.cloak)
  52. # [10:38] * Disconnected
  53. # [10:57] * Attempting to rejoin channel #testing
  54. # [11:03] * Attempting to rejoin channel #testing
  55. # [11:03] * Rejoined channel #testing
  56. # [11:03] * Topic is '<jgraham> A programmer has a problem. They think "I know I'll use submodules". Now they have a tree of problems.'
  57. # [11:03] * Set by odinho on Thu Apr 02 15:58:23
  58. # [11:07] * Disconnected
  59. # [11:12] * Attempting to rejoin channel #testing
  60. # [11:16] * Attempting to rejoin channel #testing
  61. # [11:18] * Rejoined channel #testing
  62. # [11:18] * Topic is '<jgraham> A programmer has a problem. They think "I know I'll use submodules". Now they have a tree of problems.'
  63. # [11:18] * Set by odinho on Thu Apr 02 15:58:23
  64. # [11:18] * Joins: tripu (antonio@public.cloak)
  65. # [11:18] * Quits: schuki (~quassel@public.cloak) (Ping timeout: 180 seconds)
  66. # [11:19] * Joins: jgraham (~jgraham@public.cloak)
  67. # [11:20] * Joins: schuki (~quassel@public.cloak)
  68. # [11:39] * Joins: Ms2ger (~Ms2ger@public.cloak)
  69. # [11:40] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  70. # [11:44] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  71. # [11:50] * Joins: gitbot (~gitbot@public.cloak)
  72. # [11:50] -gitbot:#testing- [wptrunner] jgraham force-pushed jgraham/servodriver from 6c9e6de to 97afcf0: https://github.com/w3c/wptrunner/commits/jgraham/servodriver
  73. # [11:50] -gitbot:#testing- wptrunner/jgraham/servodriver 97afcf0 James Graham: Add "servodriver" product that runs servo tests using webdriver....
  74. # [11:50] * Parts: gitbot (~gitbot@public.cloak)
  75. # [11:51] * Joins: gitbot (~gitbot@public.cloak)
  76. # [11:51] -gitbot:#testing- [wptrunner] jgraham closed pull request #109: Add "servodriver" product that runs servo tests using webdriver. (master...jgraham/servodriver) https://github.com/w3c/wptrunner/pull/109
  77. # [11:51] * Parts: gitbot (~gitbot@public.cloak)
  78. # [11:52] * Joins: ArtB (~ArtB@public.cloak)
  79. # [11:54] <ato> jgraham: ++
  80. # [11:57] <jgraham> Just need to land the servo side now :)
  81. # [11:57] <ato> Is it worse than Gecko?
  82. # [11:58] <jgraham> Is what worse?
  83. # [11:59] <ato> Landing it (-:
  84. # [11:59] <Ms2ger> Better, we have autoland :)
  85. # [11:59] <ato> No sheriffs who wake you up at 2 am to scream at you?
  86. # [11:59] <jgraham> But I get bitrotted more often :)
  87. # [12:00] <ato> Who backs out your patch unrelated to tree bustage?
  88. # [12:00] <jgraham> Ms2ger: https://github.com/servo/servo/pull/6022 if you were bored (jdm reviewed it already)
  89. # [12:00] <Ms2ger> We've had one or so this year
  90. # [12:00] <ato> It’s crazy that Gecko doesn’t have a commit queue/autoland feature yet.
  91. # [12:00] <ato> It’s not rocket science.
  92. # [12:01] <Ms2ger> It is with the number of intermittent
  93. # [12:01] <Ms2ger> s
  94. # [12:02] * ato sighs
  95. # [12:02] <Ms2ger> jgraham, looks like your wptupdate PR trampled over another PR's expectation changes
  96. # [12:05] * jgraham sighs
  97. # [12:05] <jgraham> Also runs for the train
  98. # [12:31] <gsnedders> Ms2ger: this is why you burnt intermittent tests with fire
  99. # [12:31] <gsnedders> *burn
  100. # [12:34] <ato> Until recently we had no way to identify which tests were frequently intermittent.
  101. # [12:34] <ato> Also I get the impression that a lot of recent intermittents have been caused by infrastructure changes, e.g. in Treeherder.
  102. # [12:37] <gsnedders> Still claiming fire is the right solution :)
  103. # [12:38] <ato> I also question the value of a lot of the tests we run.
  104. # [12:38] <ato> Yes, I think fire is the appropriate means here.
  105. # [12:39] <Ms2ger> gsnedders, yeah, we disable tests pretty aggressively
  106. # [12:40] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  107. # [12:58] <jgraham> "Burn intermittent tests with fire" isn't a workable policy
  108. # [12:58] <jgraham> even disregarding the health and safety issues of fire in the server room
  109. # [12:59] <jgraham> and the lack of support in the EC2 API
  110. # [12:59] <jgraham> Lots of intermittents we see aren't problems with the tests, they're low-probability race conditions in the browser code
  111. # [13:00] <jgraham> (or, in the case of media code, high probability race conditions in the browser code…)
  112. # [13:01] <jgraham> Others are environmental issues ("tests fail if we lose the VM timeslice for too long")
  113. # [13:02] <jgraham> If we disabled every test that ever showed intermittent behaviour there would be a considerable loss of useful test coverage
  114. # [13:28] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  115. # [13:28] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  116. # [13:35] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Ping timeout: 180 seconds)
  117. # [13:41] * Joins: dulow187 (~dulow187@public.cloak)
  118. # [13:46] * Quits: dulow187 (~dulow187@public.cloak) ("Page closed")
  119. # [13:51] * Joins: dulow187 (~dulow187@public.cloak)
  120. # [13:53] * Quits: dulow187 (~dulow187@public.cloak) ("Page closed")
  121. # [13:54] * Joins: Lachy (~Lachy@public.cloak)
  122. # [14:11] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  123. # [14:45] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  124. # [14:50] * Quits: AutomatedTester (~AutomatedTester@public.cloak) ("Leaving...")
  125. # [15:03] * Joins: plh (plehegar@public.cloak)
  126. # [15:28] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
  127. # [15:39] * Joins: anssik (~uid10742@public.cloak)
  128. # [16:20] <jgraham> Can I ecourage someone to review https://github.com/w3c/wpt-tools/pull/6 and https://github.com/w3c/wpt-tools/pull/7? They are blockers for Windows
  129. # [16:23] <jgraham> (which is needed for the TestTWF MDN Fellow)
  130. # [16:52] * plh feels useless on those unfortunately
  131. # [16:54] <ato> plh: I’m not holding “feeling useless on Windows” against you, rather the opposite. (-:
  132. # [16:59] * Joins: bhill2 (~bhill2@public.cloak)
  133. # [17:03] * Quits: bhill2 (~bhill2@public.cloak) (Client closed connection)
  134. # [17:07] <Ms2ger> jgraham, r+
  135. # [17:08] <jgraham> Takk
  136. # [17:11] <ato> Ms2ger: The correct response is “bare hyggelig”.
  137. # [17:12] <Ms2ger> bh
  138. # [17:14] * Joins: gitbot (~gitbot@public.cloak)
  139. # [17:14] -gitbot:#testing- [web-platform-tests] jgraham pushed 1 new commit to jgraham/windows_openssl: https://github.com/w3c/web-platform-tests/commit/58b05310c04975720ec6e2263587504a7b9751a0
  140. # [17:14] -gitbot:#testing- web-platform-tests/jgraham/windows_openssl 58b0531 James Graham: Update to latest wpt-tools
  141. # [17:14] * Parts: gitbot (~gitbot@public.cloak)
  142. # [17:15] <jgraham> Ms2ger: Mind finishing the job by looking at https://github.com/w3c/web-platform-tests/pull/1825 ?
  143. # [17:19] <Ms2ger> jgraham, r+, with nits if you feel like them
  144. # [17:21] <jgraham> What would you prefer me to use rather than <a>? <span>?
  145. # [17:21] <Ms2ger> I'd prefer if you could put it on the <h*>, but slightly prefer span over a, yes
  146. # [17:22] <jgraham> I don't think I can put it on the h* because markdown
  147. # [17:22] <Ms2ger> Yeah, I suspected as much
  148. # [17:27] * Joins: gitbot (~gitbot@public.cloak)
  149. # [17:27] -gitbot:#testing- [web-platform-tests] jgraham force-pushed jgraham/windows_openssl from 58b0531 to 3853be3: https://github.com/w3c/web-platform-tests/commits/jgraham/windows_openssl
  150. # [17:27] -gitbot:#testing- web-platform-tests/jgraham/windows_openssl 5486d99 James Graham: Work around OpenSSL issues on windows
  151. # [17:27] -gitbot:#testing- web-platform-tests/jgraham/windows_openssl d8bc9ee James Graham: Update README file.
  152. # [17:27] -gitbot:#testing- web-platform-tests/jgraham/windows_openssl 3853be3 James Graham: Update to latest wpt-tools
  153. # [17:27] * Parts: gitbot (~gitbot@public.cloak)
  154. # [17:29] * Joins: gitbot (~gitbot@public.cloak)
  155. # [17:29] -gitbot:#testing- [web-platform-tests] jgraham closed pull request #1825: Jgraham/windows openssl (master...jgraham/windows_openssl) https://github.com/w3c/web-platform-tests/pull/1825
  156. # [17:29] * Parts: gitbot (~gitbot@public.cloak)
  157. # [17:40] * Joins: bhill2 (~bhill2@public.cloak)
  158. # [18:03] * Quits: burnik (~burnik@public.cloak) (Ping timeout: 180 seconds)
  159. # [18:05] * terri_offline is now known as terri
  160. # [19:21] * Quits: anssik (~uid10742@public.cloak) ("Connection closed for inactivity")
  161. # [20:08] * Quits: tripu (antonio@public.cloak) ("Leaving")
  162. # [20:50] <bhill2> is there a way to deliberately complete a test as "NOT RUN" ?
  163. # [20:50] <bhill2> e.g. if you're testing plugin behavior and the plugin isn't available?
  164. # [20:51] <bhill2> test.set_status(test.NOTRUN, "No plugin"); test.done();
  165. # [20:51] <bhill2> <-- done() internally sets status to PASS
  166. # [21:37] <bhill2> test1.set_status(test1.NOTRUN, "No Flash Player, cannot run test.");
  167. # [21:37] <bhill2> test1.phase = test1.phases.HAS_RESULT;
  168. # [21:37] <bhill2> is how
  169. # [21:39] * Joins: gitbot (~gitbot@public.cloak)
  170. # [21:39] -gitbot:#testing- [web-platform-tests] hillbrad opened pull request #1830: set test status to NOT RUN if no flash player available (master...hillbrad/detect-flash-for-object-src) https://github.com/w3c/web-platform-tests/pull/1830
  171. # [21:39] * Parts: gitbot (~gitbot@public.cloak)
  172. # [21:56] <jgraham> Yeah, so you're not really supposed to do that :)
  173. # [22:01] <bhill2> touchin' the private bits
  174. # [22:01] <bhill2> I can't think of a more appropriate result for e.g. trying to test something that blocks Flash on a stock Firefox install with no Flash.
  175. # [22:02] <bhill2> NOT RUN is what happened.
  176. # [22:10] <jgraham> It's confusingly not what NOT RUN means in testharness.js though. That means "this test was created, but no steps were called".
  177. # [22:12] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  178. # [22:15] <bhill2> well, that's pretty much what happens
  179. # [22:15] <bhill2> no steps, because the test steps cannot be run
  180. # [22:16] <bhill2> I guess I could not create the test
  181. # [22:16] <bhill2> but I'd rather have an indication that, e.g. to complete this test suite you need to install a plugin to make sure that behavior is correct when it is there
  182. # [22:26] * heycam|away is now known as heycam
  183. # [22:30] * Joins: Lachy (~Lachy@public.cloak)
  184. # [22:54] * Quits: scott_gonzalez (~scott_gonzalez@public.cloak) (Ping timeout: 180 seconds)
  185. # [23:02] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  186. # [23:02] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  187. # [23:06] * Quits: Ms2ger (~Ms2ger@public.cloak) ("nn")
  188. # [23:09] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Ping timeout: 180 seconds)
  189. # [23:31] * Quits: plh (plehegar@public.cloak) ("Leaving")
  190. # [23:52] * heycam is now known as heycam|away
  191. # [23:56] * Joins: gitbot (~gitbot@public.cloak)
  192. # [23:56] -gitbot:#testing- [web-platform-tests] hillbrad opened pull request #1831: Hillbrad/fix audio source onerror (master...hillbrad/fix-audio-source-onerror) https://github.com/w3c/web-platform-tests/pull/1831
  193. # [23:56] * Parts: gitbot (~gitbot@public.cloak)
  194. # Session Close: Fri May 15 00:00:01 2015

Previous day, Next day

Think these logs are useful? Then please donate to show your gratitude (and keep them up, of course). Thanks! — Krijn