/irc-logs / w3c / #testing / 2014-09-18 / end

Options:

  1. # Session Start: Thu Sep 18 00:00:00 2014
  2. # Session Ident: #testing
  3. # [00:06] * Quits: mdas (~mdas@public.cloak) (Client closed connection)
  4. # [00:09] * Quits: plh (plehegar@public.cloak) ("Leaving")
  5. # [00:23] * Joins: lmclister (~lmclister@public.cloak)
  6. # [00:23] * Quits: lmclister (~lmclister@public.cloak) ("")
  7. # [01:00] * Joins: Lachy (~Lachy@public.cloak)
  8. # [01:43] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  9. # [01:53] * Joins: Lachy (~Lachy@public.cloak)
  10. # [01:58] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  11. # [02:04] * heycam|away is now known as heycam
  12. # [02:08] * Joins: MK (kawamori@public.cloak)
  13. # [02:26] * Joins: MK_ (kawamori@public.cloak)
  14. # [02:27] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  15. # [02:34] * Quits: MK_ (kawamori@public.cloak) (Ping timeout: 180 seconds)
  16. # [05:09] * heycam is now known as heycam|away
  17. # [05:52] * heycam|away is now known as heycam
  18. # [06:12] * Joins: glenn (~gadams@public.cloak)
  19. # [06:12] * Joins: MK (kawamori@public.cloak)
  20. # [06:32] * Joins: zcorpan (~zcorpan@public.cloak)
  21. # [07:09] * Quits: zcorpan (~zcorpan@public.cloak) (Client closed connection)
  22. # [07:09] * Joins: zcorpan (~zcorpan@public.cloak)
  23. # [07:16] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  24. # [07:54] * Quits: glenn (~gadams@public.cloak) (Client closed connection)
  25. # [08:10] * Joins: zcorpan (~zcorpan@public.cloak)
  26. # [08:19] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  27. # [08:24] * Joins: MK (kawamori@public.cloak)
  28. # [08:39] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  29. # [08:48] * Joins: MK (kawamori@public.cloak)
  30. # [08:59] * heycam is now known as heycam|away
  31. # [09:47] * Joins: darobin (rberjon@public.cloak)
  32. # [10:42] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  33. # [11:10] * Joins: Lachy (~Lachy@public.cloak)
  34. # [11:22] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
  35. # [11:23] * Joins: Lachy (~Lachy@public.cloak)
  36. # [11:23] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  37. # [11:27] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  38. # [11:34] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  39. # [11:40] <MikeSmith> jgraham: what's the current status on wptrunner?
  40. # [11:46] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  41. # [12:08] * Joins: Lachy (~Lachy@public.cloak)
  42. # [12:37] <jgraham> MikeSmith: In what sense?
  43. # [12:53] <MikeSmith> jgraham: can I run it with chrome? IE?
  44. # [12:55] <MikeSmith> can contributors submit tests yet that need/rely on webdriver in order to be automated?
  45. # [12:56] <jgraham> MikeSmith: Ah, right
  46. # [12:58] <jgraham> You can run it with Chrome, Firefox, Servo and, if you are adventurous, Firefox OS, out of the box. Microsoft have a branch that adds IE support. Tests that rely on webdriver don't work yet, but ato is doing something clever that should provide a way forward there
  47. # [13:18] <jgraham> Speaking of ato
  48. # [13:26] <ato> Yes, I'll get around to that real soon.
  49. # [13:26] <ato> Been feeling a little under the weather the past week after India.
  50. # [13:29] <jgraham> ato: Do you have some opinion on how I should expose tests in the Mozilla tree that we are queuing to upstream or that we can't upstream for some reason? The plan is to have a set of "outbound" tests that will be upstreamed as part of a sync and a set of "internal" tests that use or test non-standard features but otherwise use the wptharness. So it would be nice to put these in a totally seperate place to the tests from upstream so that updating those [CUT]
  51. # [13:29] <jgraham> ... just copy the new tests and delete the old ones). However that creates complexity in other places. There are two basic approaches I can see assuming that each secondary suite lives in its own directory: 1) make the secondary suites totally seperate with different mach targets, different tbpl jobs, etc. This is implementable (I have done all the work needed apart from adding the extra jobs) but I think leads to a pretty poor developer experience if [CUT]
  52. # [13:29] <jgraham> ... |mach web-platform-tests-outbound| or similar. 2) Put the tests under some "fake" url like /_outbound/ or /_internal/ so that all tests share a single url space and a single job/mach target but exist in different directories on disk. This is complicated by the fact that there would be a single manifest file and the way of mapping a metadata file to the tests file would be more complicated ("more complicated" meaning "I don't know how it should work[CUT]
  53. # [13:29] <jgraham> ... mean that tests under /_outbound/ couldn't use absolute URLs since the URL would change after submission. So those are the two options. I guess option 3) is to do something like option 2) but with just one directory and make the update process skip the _outbound and _internal directories
  54. # [13:29] <jgraham> This is taking a lot more time than I expected :(
  55. # [13:37] * Joins: ptressel (~chatzilla@public.cloak)
  56. # [13:45] <ato> I really don't have any strong opinions on this, but I agree that separate mach targets is not a nice user experience for developers.
  57. # [13:45] <ato> Could you create a mach target that runs the three individual suites and collates the results to one formatter?
  58. # [13:48] <jgraham> It's not *easy* at least because lots of things are currently triggered on suite_end
  59. # [13:48] <jgraham> Obviously it's possible
  60. # [13:50] <ato> Okay and just so I understand the problem, this would be solved if you had a single manifest file and a single wptrunner instance?
  61. # [13:51] <jgraham> Yeah, if everything ran from a single manifest file with a single url space that would work. Options 2 and 3 above try to take that approach
  62. # [13:52] * Joins: dom (dom@public.cloak)
  63. # [13:52] <jgraham> Option 1 uses multiple manifest files with multiple url spaces, but has the property that the url space for tests running in the outbound suite is the same as the space for tests running in the main upstream suite
  64. # [13:53] <jgraham> So you can use absolute URLs to things that you wrote. I don't know if this is actually important, but if it is then that constrains the solution
  65. # [14:12] * Joins: plh (plehegar@public.cloak)
  66. # [15:33] * Joins: MK (kawamori@public.cloak)
  67. # [15:33] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  68. # [15:46] * Joins: Automate_ (~AutomatedTester@public.cloak)
  69. # [15:46] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  70. # [15:46] * Automate_ is now known as AutomatedTester
  71. # [15:47] * Joins: gitbot (~gitbot@public.cloak)
  72. # [15:47] -gitbot:#testing- [web-platform-tests] zcorpan closed pull request #1234: Some tests for <img>/<picture> (master...img-picture) https://github.com/w3c/web-platform-tests/pull/1234
  73. # [15:47] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
  74. # [15:51] * Joins: mdas (~mdas@public.cloak)
  75. # [16:01] * Joins: anssik (~uid10742@public.cloak)
  76. # [16:03] * Quits: zcorpan (~zcorpan@public.cloak) (Client closed connection)
  77. # [16:04] * Joins: zcorpan (~zcorpan@public.cloak)
  78. # [16:07] * Joins: Lachy_ (~Lachy@public.cloak)
  79. # [16:07] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
  80. # [16:11] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
  81. # [16:46] * Quits: Lachy_ (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  82. # [17:19] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
  83. # [17:19] * Quits: ptressel (~chatzilla@public.cloak) ("zzz")
  84. # [17:24] * Joins: Lachy (~Lachy@public.cloak)
  85. # [17:33] * Joins: MK_ (kawamori@public.cloak)
  86. # [17:34] * Quits: darobin (rberjon@public.cloak) (Client closed connection)
  87. # [17:36] * Joins: Lachy_ (~Lachy@public.cloak)
  88. # [17:36] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
  89. # [17:37] * Quits: MK (kawamori@public.cloak) (Ping timeout: 180 seconds)
  90. # [17:43] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
  91. # [18:08] * Joins: kawai (~kawai@public.cloak)
  92. # [18:14] * Quits: Lachy_ (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  93. # [18:17] * Quits: dom (dom@public.cloak) ("")
  94. # [18:32] * Quits: MK_ (kawamori@public.cloak) ("Leaving...")
  95. # [18:44] * Joins: Lachy (~Lachy@public.cloak)
  96. # [18:59] * Quits: anssik (~uid10742@public.cloak) ("Connection closed for inactivity")
  97. # [19:18] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  98. # [19:29] * Joins: Lachy (~Lachy@public.cloak)
  99. # [19:32] * Quits: kawai (~kawai@public.cloak) (Client closed connection)
  100. # [20:26] * Joins: Lachy_ (~Lachy@public.cloak)
  101. # [20:26] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
  102. # [20:30] * Joins: Lachy (~Lachy@public.cloak)
  103. # [20:34] * Quits: Lachy_ (~Lachy@public.cloak) (Ping timeout: 180 seconds)
  104. # [22:25] * Joins: bterlson______ (~sid23757@public.cloak)
  105. # [22:29] * Quits: bterlson_____ (~sid23757@public.cloak) (Ping timeout: 180 seconds)
  106. # [22:29] * bterlson______ is now known as bterlson_____
  107. # [22:44] * Quits: plh (plehegar@public.cloak) ("Leaving")
  108. # [22:44] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
  109. # [22:55] * Joins: Lachy (~Lachy@public.cloak)
  110. # Session Close: Fri Sep 19 00:00:00 2014

The end :)