Options:
- # Session Start: Fri Sep 06 00:00:00 2013
- # Session Ident: #testing
- # [00:05] * heycam|away is now known as heycam
- # [01:51] * Quits: jhammel (~jhammel@public.cloak) ("leaving")
- # [02:00] * Quits: thayakawa (~thayakawa@public.cloak) (Ping timeout: 180 seconds)
- # [03:32] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
- # [03:32] * heycam is now known as heycam|away
- # [03:33] * Joins: rhauck (~Adium@public.cloak)
- # [03:36] * heycam|away is now known as heycam
- # [03:40] * Quits: rhauck (~Adium@public.cloak) (Ping timeout: 180 seconds)
- # [04:04] * heycam is now known as heycam|away
- # [04:42] * heycam|away is now known as heycam
- # [06:05] * Quits: glenn_ (~gadams@public.cloak) (Client closed connection)
- # [06:22] * heycam is now known as heycam|away
- # [06:57] * heycam|away is now known as heycam
- # [07:15] * Joins: glenn (~gadams@public.cloak)
- # [07:23] * Quits: glenn (~gadams@public.cloak) (Ping timeout: 180 seconds)
- # [07:46] * Joins: glenn (~gadams@public.cloak)
- # [07:54] * heycam is now known as heycam|away
- # [08:06] * Joins: Ms2ger (~Ms2ger@public.cloak)
- # [08:40] * Joins: dom (dom@public.cloak)
- # [09:08] * Joins: zcorpan (~zcorpan@public.cloak)
- # [09:08] * Quits: zcorpan (~zcorpan@public.cloak) (Client closed connection)
- # [09:09] * Joins: zcorpan (~zcorpan@public.cloak)
- # [09:09] * Joins: zcorpan_ (~zcorpan@public.cloak)
- # [09:09] * Quits: zcorpan (~zcorpan@public.cloak) (Client closed connection)
- # [09:42] * Joins: tobie (tobie@public.cloak)
- # [09:43] * Joins: gitbot (~gitbot@public.cloak)
- # [09:43] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/11d290a32f450f0d28204eeb1eda3a2fb88d6ac4
- # [09:43] -gitbot:#testing- web-platform-tests/master 11d290a Michael[tm] Smith: New vnu-map.json for use in testing validator.nu
- # [09:43] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [09:44] * Joins: gitbot (~gitbot@public.cloak)
- # [09:44] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 1 new commit to conformance-checkers: https://github.com/w3c/web-platform-tests/commit/cb034d72819d0f21508ca1b1ff9ba45edc2158c5
- # [09:44] -gitbot:#testing- web-platform-tests/conformance-checkers cb034d7 Michael[tm] Smith: New vnu-map.json for use in testing validator.nu
- # [09:44] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [10:04] * Joins: darobin (rberjon@public.cloak)
- # [10:05] * Quits: glenn (~gadams@public.cloak) (Client closed connection)
- # [10:33] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [11:15] * Joins: glenn (~gadams@public.cloak)
- # [11:22] * Quits: glenn (~gadams@public.cloak) (Ping timeout: 180 seconds)
- # [11:56] <MikeSmith> git protip: don't use "--git-dir" to try to do anything with git repo when you're not actually in the directory for that repo
- # [11:56] <MikeSmith> or don't trust it
- # [11:58] * jgraham had never heard of --git-dir
- # [11:58] <jgraham> Did you also define --work-tree?
- # [12:00] <MikeSmith> jgraham: no, because it basically seemed to work as expected with just --git-dir and not --work-tree
- # [12:01] <MikeSmith> basically
- # [12:01] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [12:01] <MikeSmith> but then other bizarre stuff seems to silently happen
- # [12:02] <MikeSmith> anyway probably it's soemthing I'm doing wrong
- # [12:02] <jgraham> Ssssh, you will confirm Ms2ger's suspicions that git is basically an evil plot to confuse and destroy
- # [12:02] <MikeSmith> I was just trying to have a my script avoid the need to do a "cd" to the git dir before pulling
- # [12:02] <MikeSmith> heh
- # [12:02] <Ms2ger> Already confirmed
- # [12:03] <Ms2ger> MikeSmith, what's this conformance-checkers branch?
- # [12:05] <MikeSmith> Ms2ger: it's the stuff I gave you and jgraham a heads-up about earlier
- # [12:05] <MikeSmith> I made a branch so that I can pull just the branch into the validator.nu build tree
- # [12:05] <Ms2ger> I thought you were going to use a dir, not a branch
- # [12:06] <MikeSmith> yeah the branch is so that for the validator.nu build, I don't have to pull the entirety of wpt
- # [12:06] <MikeSmith> in order to run the test automation
- # [12:06] <MikeSmith> for regression testing changes
- # [12:07] <jgraham> That seems, umm, how are you doing it?
- # [12:08] <jgraham> I guess I could look
- # [12:08] <MikeSmith> git subtree push -P conformance-checkers/html-its/ -b its-inputdata origin its-inputdata
- # [12:09] <jgraham> So this is effectively a totally seperate repo hidden inside wpt?
- # [12:09] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [12:10] <jgraham> (it doesn't actually have any commits in common with master)
- # [12:10] <MikeSmith> that's the case for that branch, yeah
- # [12:10] <jgraham> Seems like you might just want an actual seperate repo, really
- # [12:10] <MikeSmith> but nobody else should be working from that branch
- # [12:10] <MikeSmith> it should be considered read-only
- # [12:11] <jgraham> Hmm
- # [12:11] <MikeSmith> export-only
- # [12:11] <jgraham> I guess that's a theory
- # [12:11] <jgraham> We can discover how well it works
- # [12:12] <Ms2ger> jgraham, r? https://critic.hoppipolla.co.uk/r/31 :)
- # [12:16] <jgraham> Ms2ger: OK, I'll look
- # [12:16] <AutomatedTester> MikeSmith: looks like more great API design by the git folks
- # [12:17] * Quits: zcorpan_ (~zcorpan@public.cloak) (Client closed connection)
- # [12:18] <MikeSmith> AutomatedTester: I just have a knack for accidentally finding ways to break stuff. Because I do stupid things most nobody else would think to do.
- # [12:18] * Joins: zcorpan (~zcorpan@public.cloak)
- # [12:18] <MikeSmith> I guess I should be doing QA work for a living
- # [12:18] <AutomatedTester> MikeSmith: a good API doent give you a foot gun
- # [12:19] <AutomatedTester> just saying
- # [12:19] <Ms2ger> This *is* git we're talking about, right?
- # [12:19] <MikeSmith> heh
- # [12:19] <MikeSmith> git is an intelligence test
- # [12:19] <Ms2ger> The better you deal, the lower your score? ;)
- # [12:20] <MikeSmith> hah
- # [12:21] * Joins: abarsto (~abarsto@public.cloak)
- # [12:21] * abarsto is now known as ArtB
- # [12:21] <MikeSmith> the more you use it, the dumber you get
- # [12:22] <MikeSmith> til after you use it for a long time, it just seems wonderful and perfect
- # [12:25] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
- # [12:29] <jgraham> Pretty sure any vcs that is powerful enough contains a footgun
- # [12:29] <jgraham> It's pretty much the definition of "powerful enough"
- # [12:33] <darobin> what's this nonsense about footguns?
- # [12:33] <darobin> a good API should give you enough rope to not just hang yourself, but also knit a footgun out of it
- # [12:33] <darobin> git does great in this department
- # [12:39] * Joins: gitbot (~gitbot@public.cloak)
- # [12:39] -gitbot:#testing- [web-platform-tests] jgraham opened pull request #320: Remove an old copy of the html5lib tests (master...remove_old_html5lib) https://github.com/w3c/web-platform-tests/pull/320
- # [12:39] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [12:39] <jgraham> Easiest review of the day, anyone?
- # [12:39] <jgraham> https://critic.hoppipolla.co.uk/r/301
- # [12:43] * Joins: zcorpan (~zcorpan@public.cloak)
- # [12:45] <darobin> jgraham: done
- # [12:45] <darobin> I reckon you don't need review for the truly obvious stuff
- # [12:45] <jgraham> darobin: Thanks
- # [12:46] <jgraham> Yeah, that I could perhaps have just pushed
- # [12:48] * Joins: gitbot (~gitbot@public.cloak)
- # [12:48] -gitbot:#testing- [web-platform-tests] jgraham closed pull request #320: Remove an old copy of the html5lib tests (master...remove_old_html5lib) https://github.com/w3c/web-platform-tests/pull/320
- # [12:48] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [12:48] * Joins: gitbot (~gitbot@public.cloak)
- # [12:48] -gitbot:#testing- [web-platform-tests] jgraham pushed 2 new commits to master: https://github.com/w3c/web-platform-tests/compare/11d290a32f45...aed5ba1f4b2b
- # [12:48] -gitbot:#testing- web-platform-tests/master 6cec38f James Graham: Remove an old copy of the html5lib tests
- # [12:48] -gitbot:#testing- web-platform-tests/master aed5ba1 jgraham: Merge pull request #320 from jgraham/remove_old_html5lib...
- # [12:48] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [12:51] * Joins: gitbot (~gitbot@public.cloak)
- # [12:51] -gitbot:#testing- [web-platform-tests] jgraham pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/cc959c36a5ca85f8640340445dc08c2018a50939
- # [12:51] -gitbot:#testing- web-platform-tests/master cc959c3 James Graham: Rename some page visibility manual tests to match new conventions.
- # [12:51] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [13:01] * Joins: gitbot (~gitbot@public.cloak)
- # [13:01] -gitbot:#testing- [web-platform-tests] jgraham pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/d013f8ca8495d0afd1ae9cad02f1dff1ce64afbe
- # [13:01] -gitbot:#testing- web-platform-tests/master d013f8c James Graham: Move manual tests in FileAPI to match naming convention
- # [13:01] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [13:04] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [13:05] <jgraham> So is http://w3c-test.org/web-platform-tests/master/battery-status/battery-charging.html a manual test?
- # [13:05] <jgraham> It has unusual preconditions at least, but I guess it finishes automatically if you meet them
- # [13:06] <Ms2ger> I say manual
- # [13:08] * Joins: gitbot (~gitbot@public.cloak)
- # [13:08] -gitbot:#testing- [web-platform-tests] jgraham pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/21eb0c1467dfd7a3b7eb91a6d9d9b176cd21f8c6
- # [13:08] -gitbot:#testing- web-platform-tests/master 21eb0c1 James Graham: Move some battery api tests to comply with naming conventions.
- # [13:08] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [13:08] <jgraham> Yeah, if there is a precondition that needs to be manually checked, it seems a lot like a manual test
- # [13:19] <darobin> definitely manual
- # [13:20] <darobin> I reckon most of DAP's tests will be manual — you usually can't introspect the device's status in another way...
- # [13:25] * Quits: tobie (tobie@public.cloak)
- # [13:26] * Joins: gitbot (~gitbot@public.cloak)
- # [13:26] -gitbot:#testing- [web-platform-tests] jgraham pushed 2 new commits to master: https://github.com/w3c/web-platform-tests/compare/21eb0c1467df...19c2500c28ec
- # [13:26] -gitbot:#testing- web-platform-tests/master eecdea5 James Graham: Move manual vibration test to matching naming convention
- # [13:26] -gitbot:#testing- web-platform-tests/master 19c2500 James Graham: Rename some mediastreams tests that require manual interaction.
- # [13:26] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [15:37] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [15:42] * Joins: tobie (tobie@public.cloak)
- # [15:52] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [16:01] * Joins: glenn (~gadams@public.cloak)
- # [16:20] * Joins: Lachy (~Lachy@public.cloak)
- # [16:36] * Quits: zcorpan (~zcorpan@public.cloak) (Client closed connection)
- # [16:37] * Joins: zcorpan (~zcorpan@public.cloak)
- # [16:37] * Joins: thayakawa (~thayakawa@public.cloak)
- # [16:44] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
- # [16:58] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
- # [17:07] * Quits: darobin (rberjon@public.cloak) (Client closed connection)
- # [17:07] * Joins: zcorpan (~zcorpan@public.cloak)
- # [17:16] * Quits: glenn (~gadams@public.cloak) (Client closed connection)
- # [17:29] * Joins: rhauck (~Adium@public.cloak)
- # [17:31] * Quits: rhauck (~Adium@public.cloak) ("Leaving.")
- # [17:40] <ArtB> ms2ger re "writing up a number of things that needed testing for the last testtwf event; I think those were all ignored, and still need to be done", do you have a link handy or recall the e-mail list used?
- # [17:40] <ArtB> (btw, that sucks)
- # [17:40] <Ms2ger> I don't
- # [17:41] <jgraham> There was an etherpad somewhere iirc
- # [17:41] <ArtB> I checked a couple of W3C archives
- # [17:44] <jgraham> Hmm, I can't find it either
- # [17:44] <jgraham> Now I am worried that I'm having shared hallucinations with Ms2ger
- # [17:44] * Ms2ger pokes his history
- # [17:45] * ArtB don't bogart that sh*t ;-)
- # [17:46] <jgraham> https://etherpad.mozilla.org/VkkW1BU54C
- # [17:47] <Ms2ger> https://etherpad.mozilla.org/VkkW1BU54C
- # [17:47] <Ms2ger> There we are
- # [17:47] <Ms2ger> At least we hallucinate consitently
- # [17:47] <Ms2ger> consistently
- # [17:48] <jgraham> Dunno if it ever got sent to anyone at the event though
- # [17:48] <Ms2ger> https://twitter.com/odinho/status/342965863512698880
- # [17:48] <Ms2ger> http://krijnhoetmer.nl/irc-logs/whatwg/20130607#l-369
- # [17:49] <ArtB> good list
- # [18:10] * Joins: Lachy (~Lachy@public.cloak)
- # [18:11] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [18:15] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [18:15] <Ms2ger> ArtB, btw, bz suggests that the webmessaging test suite is not quite good enough
- # [18:16] <ArtB> ms2ger, do you have a link?
- # [18:17] <jgraham> Is that "not *quite*" or "*not quite*"?
- # [18:17] <jgraham> i.e. is he actually saying it's lousy?
- # [18:18] <Ms2ger> <bz> ugh
- # [18:18] <Ms2ger> <bz> the WG thinks they have good test coverage?
- # [18:19] * Joins: zcorpan_ (~zcorpan@public.cloak)
- # [18:19] <jgraham> Heh
- # [18:19] <jgraham> OK
- # [18:20] <Ms2ger> That says enough? :)
- # [18:20] <ArtB> it would great to get bz to review what we have
- # [18:21] <ArtB> lots of failures and NotRuns http://www.w3.org/wiki/Webapps/Interop/WebMessaging
- # [18:21] <Ms2ger> Well, we need half a dozen bz's to do everything it would be great for bz to do :)
- # [18:21] <ArtB> I don't know if Alex Kuang is still active
- # [18:21] <ArtB> yeah, definitely need to clone that guy!
- # [18:22] * Quits: dom (dom@public.cloak) ("")
- # [18:23] <Ms2ger> ArtB, next time W3C has too much money, can you make them hire test reviewers rather than spec editors for specs that are already edited? :)
- # [18:24] <ArtB> wfm ;)
- # [18:25] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
- # [18:25] <jgraham> W3C should hire genetic engineers
- # [18:25] <jgraham> To look at cloning
- # [18:25] <jgraham> It's a long game
- # [18:26] <jgraham> But we can get ahead of the market
- # [18:26] * Quits: zcorpan_ (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
- # [18:28] * ArtB makes a note to include a "Wait for BZ Clone Miracle" in WebApps' test plan
- # [18:28] <jgraham> No, I'm suggesting we try Science, not wait for a miracle :)
- # [18:28] <jgraham> Anyway zcorpan wrote those tests
- # [18:28] <jgraham> Or some of those tests
- # [18:28] <jgraham> But I doubt he has time to write more
- # [18:29] <jgraham> Ms2ger: Does bz have specific areas that he thinks need tests?
- # [18:29] <Ms2ger> jgraham, the subject of the conversation was MessageEvent.ports, I believe
- # [18:29] <Ms2ger> And in particular the array type
- # [18:29] <jgraham> I have a feeling it won't be things that the general population of test authors at TestTWF are going to work on, but might be something that an "expert" could spend the day on
- # [18:30] <jgraham> That might postdate those tests
- # [18:30] <jgraham> Ah, I just got the email
- # [18:32] <jgraham> Woah
- # [18:32] <jgraham> bz is looking at the wrong testsuite
- # [18:32] <jgraham> afaict
- # [18:33] <Ms2ger> Bah, yes
- # [18:34] <Ms2ger> And that's why darobin needs to kill off all that
- # [18:37] <Ms2ger> ArtB, can you check if anything on your wiki still points to w3c-test.org/webapps?
- # [18:37] <ArtB> does anyone know if TTWF includes "reviewing test results" (such as http://www.w3.org/wiki/Webapps/Interop/WebMessaging ) to determine if failures are test bugs or impl bugs and then file issues/bugs accordingly?
- # [18:38] <ArtB> ms2ger, I'll look into that (I fixed a bunch of those links in PubStatus earlier today)
- # [18:38] <jgraham> I think it can include whatever we can persuade people to do
- # [18:38] <jgraham> Reviewing is generally not that exciting so it's hard to persuade people to do it
- # [18:40] <ArtB> yes true although I suppose it wouldn't hurt to add a) analyze WebMessaging test results and b) analyze Web Sockets test results to the list we give Rebecca/TTWF
- # [18:41] <jgraham> In good news, however, I have the results for a large fraction of the testsuite in gecko
- # [18:41] <stearns> ArtB: we do encourage logging bugs at TTWF, but so far it's been on tests people write, not looking at results of existing tests
- # [18:41] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [18:42] <Ms2ger> jgraham, woo
- # [18:42] <stearns> ArtB: but I'm up for adding that
- # [18:42] <ArtB> cool ; let me get the link for the WebSockets test results ...
- # [18:42] <jgraham> Ms2ger: One convenient 55Mb JSON file
- # [18:42] <Ms2ger> Is that passes and fails?
- # [18:43] <ArtB> http://www.w3.org/wiki/Webapps/Interop/WebSockets
- # [18:44] <jgraham> Ms2ger: passes, fails, harness status, some random logging
- # [18:44] <Ms2ger> Okay
- # [18:44] <Ms2ger> Now to visualize it :)
- # [18:44] <jgraham> (it gzips to 1.5Mb, so you can see it is not a very efficient format)
- # [18:44] * Quits: tobie (tobie@public.cloak)
- # [18:44] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [18:45] * Joins: rhauck (~Adium@public.cloak)
- # [18:45] <Ms2ger> jgraham, well, it contains all of Aryeh's autogenerated test names :)
- # [18:47] <jgraham> And contains the full URL of the test once per result
- # [18:47] <jgraham> (once per subtest result, that is)
- # [18:47] * Joins: Yves (ylafon@public.cloak)
- # [19:04] <Ms2ger> ArtB, would the WG be okay with bz coediting webidl?
- # [19:06] <ArtB> prolly ;-)
- # [19:06] <ArtB> please have bz send me a related e-mail
- # [19:09] <Ms2ger> <bz> I sent him that mail at the time.... and nothing happened
- # [19:13] * Joins: glenn (~gadams@public.cloak)
- # [19:30] * Joins: jhammel (~jhammel@public.cloak)
- # [19:34] <jgraham> Ms2ger: http://hoppipolla.co.uk/410/results.html Probably wrong.
- # [19:36] <Ms2ger> jgraham, what's the number of children?
- # [19:41] <jgraham> The number of tests on the page
- # [19:44] <Ms2ger> Doesn't seem to be
- # [19:44] <Ms2ger> /html/dom/documents/dom-tree-accessors/Document.getElementsByClassName-null-undef.html has one test
- # [19:44] <Ms2ger> And the page says /html/dom/documents/dom-tree-accessors/Document.getElementsByClassName-null-undef.html OK 166 75
- # [20:00] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [20:17] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [20:28] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [20:29] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [20:52] * Quits: ArtB (~abarsto@public.cloak) ("Leaving.")
- # [21:17] * Quits: thayakawa (~thayakawa@public.cloak) (Ping timeout: 180 seconds)
- # [21:43] * Joins: thayakawa (~thayakawa@public.cloak)
- # [21:45] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [21:46] * Joins: Automate_ (~AutomatedTester@public.cloak)
- # [21:46] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [23:00] * Joins: tobie (tobie@public.cloak)
- # [23:30] * Joins: [1]thayakawa (~thayakawa@public.cloak)
- # [23:35] * Quits: thayakawa (~thayakawa@public.cloak) (Ping timeout: 180 seconds)
- # [23:35] * [1]thayakawa is now known as thayakawa
- # [23:54] * Quits: Ms2ger (~Ms2ger@public.cloak) ("nn")
- # Session Close: Sat Sep 07 00:00:00 2013
The end :)