Options:
- # Session Start: Fri Mar 21 00:00:00 2014
- # Session Ident: #testing
- # [00:02] * Joins: shepazu (schepers@public.cloak)
- # [00:05] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
- # [00:22] * Joins: shepazu (schepers@public.cloak)
- # [00:53] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
- # [01:02] * heycam|away is now known as heycam
- # [01:38] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
- # [01:44] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
- # [01:57] * heycam is now known as heycam|away
- # [02:01] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [02:22] * heycam|away is now known as heycam
- # [02:33] * Joins: shepazu (schepers@public.cloak)
- # [02:33] * Joins: yankhates_cb (~yankhatescb@public.cloak)
- # [02:43] * Quits: shepazu (schepers@public.cloak) (Ping timeout: 180 seconds)
- # [02:46] * heycam is now known as heycam|away
- # [03:09] * Quits: lmclister (~lmclister@public.cloak) ("")
- # [03:33] * Joins: hober2 (~ted@public.cloak)
- # [03:34] * Quits: hober (~ted@public.cloak) (Client closed connection)
- # [03:34] * Quits: scott_gonzalez (~scott_gonzalez@public.cloak) (Client closed connection)
- # [03:44] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
- # [03:58] * Joins: yankhates_cb (~yankhatescb@public.cloak)
- # [04:35] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
- # [05:11] * heycam|away is now known as heycam
- # [05:19] * heycam is now known as heycam|away
- # [05:44] * Joins: yankhates_cb (~yankhatescb@public.cloak)
- # [06:01] * heycam|away is now known as heycam
- # [06:09] * Joins: gitbot (~gitbot@public.cloak)
- # [06:09] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 3 new commits to master: https://github.com/w3c/web-platform-tests/compare/275544eab54a...b7b37974cd4f
- # [06:09] -gitbot:#testing- web-platform-tests/master 0f4b83a Denis Ah-Kang: test contentEditable invalid value
- # [06:09] -gitbot:#testing- web-platform-tests/master ed94da2 Denis Ah-Kang: s/SYNTAX_ERR/SyntaxError/ per testharness.js recommendation
- # [06:09] -gitbot:#testing- web-platform-tests/master b7b3797 Michael[tm] Smith: Merge pull request #778 from deniak/contenteditable-exception...
- # [06:09] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [06:10] <@denis> jgraham, looks like the github hook doesn't update the master correctly
- # [06:10] <@denis> when you have a moment, can you take a look at: https://github.com/w3c/github_sync/pull/2 ?
- # [06:46] * Joins: zcorpan (~zcorpan@public.cloak)
- # [07:52] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
- # [08:07] * Joins: zcorpan (~zcorpan@public.cloak)
- # [08:34] * Joins: shepazu (schepers@public.cloak)
- # [08:50] * Joins: Lachy (~Lachy@public.cloak)
- # [09:10] * Joins: ptressel (~chatzilla@public.cloak)
- # [09:11] * Joins: Lachy_ (~Lachy@public.cloak)
- # [09:11] * Quits: Lachy (~Lachy@public.cloak) (Client closed connection)
- # [09:29] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
- # [09:39] * Joins: Ms2ger (~Ms2ger@public.cloak)
- # [10:05] <jgraham> denis: I don't understand why the deteched head matters?
- # [10:06] <jgraham> Using pull is the wrong solution for sure
- # [10:08] <@denis> jgraham, the hook creates a directory submission in base_path
- # [10:09] <@denis> then if we do a git checkout origin/master in base_path, it will give an error
- # [10:09] <@denis> because submission is not part of the origin
- # [10:17] * Joins: darobin (rberjon@public.cloak)
- # [10:22] * Joins: gitbot (~gitbot@public.cloak)
- # [10:22] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 2 new commits to master: https://github.com/w3c/web-platform-tests/compare/b7b37974cd4f...d1a99f8dac78
- # [10:22] -gitbot:#testing- web-platform-tests/master 2cf1615 Denis Ah-Kang: test on focus/blur event
- # [10:22] -gitbot:#testing- web-platform-tests/master d1a99f8 Michael[tm] Smith: Merge pull request #779 from deniak/focus-management...
- # [10:22] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [10:22] * Joins: gitbot (~gitbot@public.cloak)
- # [10:22] -gitbot:#testing- [web-platform-tests] sideshowbarker closed pull request #779: test on focus/blur event (master...focus-management) https://github.com/w3c/web-platform-tests/pull/779
- # [10:22] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [10:27] <@denis> jgraham, sorry, I misunderstood your comment about the detached head
- # [10:28] <@denis> there's actually a cronjob running on w3c-test.org that git pull master once a day
- # [10:28] <@denis> it's failling because the detached head thing
- # [10:29] <@denis> but the cronjob should probably be update to do a git checkout origin/master
- # [10:29] <Ms2ger> Why git pull?
- # [10:29] <@denis> no idea :)
- # [10:29] <MikeSmith> what should it be instead
- # [10:29] <MikeSmith> well instead of pull -r
- # [10:29] <@denis> maybe it was there before the hook
- # [10:30] <Ms2ger> My understanding is that hg pull is a normal thing to do, and git pull is something designed to fuck you up
- # [10:30] <@denis> I guess the best way to keep it up-to-date is to do a git checkout origin/master
- # [10:30] <MikeSmith> I would think we could just change the git fetch to git pull -r
- # [10:30] <MikeSmith> Ms2ger: yeah that's basically true
- # [10:31] <jgraham> I am always a little nervous of git pull
- # [10:31] <Ms2ger> Maybe
- # [10:31] <Ms2ger> git fetch origin
- # [10:31] <Ms2ger> git merge --ff-only origin/master
- # [10:31] <jgraham> I would prefer git checkout master; git merge origin/master --ff-only or something
- # [10:31] * Ms2ger has pull.sh files lying all around his git trees that do basically that
- # [10:32] <MikeSmith> yeah merge --ff-only should be fine
- # [10:32] <@denis> ok, will update the cronjob
- # [10:32] <MikeSmith> we're not making any local changes in that tree on w3c-test.org so regardless it should never risk clobbering anything
- # [10:44] * Joins: gitbot (~gitbot@public.cloak)
- # [10:44] -gitbot:#testing- [web-platform-tests] sideshowbarker closed pull request #782: test on beforescriptexecute and afterscriptexecute (master...script-before-after-events) https://github.com/w3c/web-platform-tests/pull/782
- # [10:44] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [10:44] * Joins: gitbot (~gitbot@public.cloak)
- # [10:44] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 3 new commits to master: https://github.com/w3c/web-platform-tests/compare/d1a99f8dac78...7574f4305775
- # [10:44] -gitbot:#testing- web-platform-tests/master 63e45d9 Denis Ah-Kang: test on beforescriptexecute and afterscriptexecute
- # [10:44] -gitbot:#testing- web-platform-tests/master 7efa525 Denis Ah-Kang: add async_test to test that both events have been fired
- # [10:44] -gitbot:#testing- web-platform-tests/master 7574f43 Michael[tm] Smith: Merge pull request #782 from deniak/script-before-after-events...
- # [10:44] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [10:47] * Joins: gitbot (~gitbot@public.cloak)
- # [10:47] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 1 new commit to master: https://github.com/w3c/web-platform-tests/commit/8d5ae8d6299210d2d49a8a18579b796e365951b4
- # [10:47] -gitbot:#testing- web-platform-tests/master 8d5ae8d Michael[tm] Smith: Minor changes to some test message strings.
- # [10:47] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [11:18] <MikeSmith> jgraham: webhook for http://hoppipolla.co.uk/sync.py is returning 500s
- # [11:21] <jgraham> MikeSmith: Feel free to remove it
- # [11:21] <MikeSmith> k
- # [11:29] * Joins: abarsto (~abarsto@public.cloak)
- # [11:29] * abarsto is now known as ArtB
- # [11:32] <darobin> tobie__, meet MikeSmith; MikeSmith, this is tobie__
- # [11:32] <MikeSmith> heh
- # [11:32] <darobin> tobie__ and MikeSmith: meet a common purpose
- # [11:32] <MikeSmith> tobie__: ganesh jitsu webhook returning 404s
- # [11:33] <MikeSmith> "Cannot POST /github-hook-pull-requests"
- # [11:33] <darobin> mmmmm
- # [11:33] <tobie__> confused
- # [11:33] <tobie__> what's giving you 404?
- # [11:33] <darobin> that should be /github-hook
- # [11:33] <MikeSmith> webhooks posting to http://ganesh.jit.su/github-hook-pull-requests
- # [11:34] <tobie__> oh--
- # [11:34] <tobie__> it that GH alerting you?
- # [11:34] <MikeSmith> http://ganesh.jit.su/github-hook works fine
- # [11:34] <MikeSmith> tobie__: passive alert https://github.com/w3c/web-platform-tests/settings/hooks
- # [11:34] * jgraham would prefer to meet a common porpoise
- # [11:35] <darobin> jgraham: you know what, I was just looking for a way to make that joke
- # [11:35] <MikeSmith> tobie__: since http://ganesh.jit.su/github-hook does work if we don't actually need http://ganesh.jit.su/github-hook-pull-requests should we just delete it?
- # [11:36] <darobin> I was at "They keep telling me I'm a dull Finn, but really I'm just a common porpoise"
- # [11:36] <darobin> which doesn't really fly
- # [11:36] <MikeSmith> tobie__: i'd assumed they were hooks for doing two different things but it's sounding more like the 404 is a redundant earlier one or something
- # [11:37] <tobie__> Yeah, I was just checking what that one was.
- # [11:38] <tobie__> Think it's one I deleted earlier
- # [11:38] <tobie__> But still somehow stuck.
- # [11:38] <tobie__> or maybe re-surfaced with the UI change
- # [11:38] <tobie__> the GH UI change, that is.
- # [11:38] <tobie__> Just strike it.
- # [11:41] <tobie__> Just did it myself, actually.
- # [11:41] <tobie__> Impressed with the new interface.
- # [11:41] <tobie__> Much better/clearer than what they had previously.
- # [11:43] <Ms2ger> As in, it exists?
- # [11:44] <tobie__> True. It was all CLI before, wasn't it?
- # [11:44] <tobie__> Or mostly CLI, with confusing documentation.
- # [11:45] <jgraham> It was mostly ipython+requests :p
- # [11:54] * heycam is now known as heycam|away
- # [11:56] * Quits: ArtB (~abarsto@public.cloak) ("Leaving.")
- # [11:57] * Joins: abarsto (~abarsto@public.cloak)
- # [11:57] * abarsto is now known as ArtB
- # [12:39] <darobin> jgraham: once in a while wptserve gives me that https://gist.github.com/anonymous/b5024c9b5453b53b9f1c
- # [12:39] <darobin> and after that, it behaves erratically
- # [12:39] <darobin> (or the browsers do)
- # [12:40] <darobin> I suspect it happens when I load and reload faster than it serves, such that the socket is closed when it tries to write to it
- # [12:40] <darobin> my python-fu is however not strong enough that I am sure how to fix it
- # [13:11] <jgraham> darobin: Interesting
- # [13:11] <jgraham> I don't remember seeing that
- # [13:12] <jgraham> darobin: File a bug?
- # [13:23] * Quits: ptressel (~chatzilla@public.cloak) ("bbl")
- # [13:29] * Joins: gitbot (~gitbot@public.cloak)
- # [13:29] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 1 new commit to submission/sideshowbarker/meta-names: https://github.com/w3c/web-platform-tests/commit/3e446796cf587d3738867c274d6e02d2c0ac026f
- # [13:29] -gitbot:#testing- web-platform-tests/submission/sideshowbarker/meta-names 3e44679 Michael[tm] Smith: Don't put pass condition in test titles.
- # [13:29] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [13:36] * Joins: Lachy (~Lachy@public.cloak)
- # [13:36] * Quits: Lachy_ (~Lachy@public.cloak) (Client closed connection)
- # [13:50] * Joins: plh (plehegar@public.cloak)
- # [13:50] <darobin> jgraham: will do
- # [13:51] <darobin> jgraham: you want it in https://github.com/w3c/wptserve?
- # [14:04] * Quits: ArtB (~abarsto@public.cloak) ("Leaving.")
- # [14:04] * Joins: abarsto (~abarsto@public.cloak)
- # [14:04] * abarsto is now known as ArtB
- # [14:04] * Joins: gitbot (~gitbot@public.cloak)
- # [14:04] -gitbot:#testing- [web-platform-tests] deniak closed pull request #658: test for the output element (master...output-element) https://github.com/w3c/web-platform-tests/pull/658
- # [14:04] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [14:04] * Joins: gitbot (~gitbot@public.cloak)
- # [14:04] -gitbot:#testing- [web-platform-tests] deniak pushed 5 new commits to master: https://github.com/w3c/web-platform-tests/compare/8d5ae8d62992...448eb5d6bef2
- # [14:04] -gitbot:#testing- web-platform-tests/master 5a7f1d0 Denis Ah-Kang: test for the output element
- # [14:04] -gitbot:#testing- web-platform-tests/master 48133ce Denis Ah-Kang: add tests on setting defaultValue
- # [14:04] -gitbot:#testing- web-platform-tests/master a1dabae Denis Ah-Kang: add tests for value flag mode is in default/value mode
- # [14:04] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [14:05] * Quits: ArtB (~abarsto@public.cloak) (ArtB)
- # [14:05] * Joins: abarsto (~abarsto@public.cloak)
- # [14:05] * abarsto is now known as ArtB
- # [14:10] <darobin> jgraham: I confirm I can repro by reloading like a madman
- # [14:25] * Quits: zcorpan (~zcorpan@public.cloak) (Ping timeout: 180 seconds)
- # [14:25] * Joins: gitbot (~gitbot@public.cloak)
- # [14:25] -gitbot:#testing- [web-platform-tests] darobin pushed 2 new commits to runner-pretty: https://github.com/w3c/web-platform-tests/compare/620973389aec...407cd81cea98
- # [14:25] -gitbot:#testing- web-platform-tests/runner-pretty 1fcd62a Robin Berjon: added a log
- # [14:25] -gitbot:#testing- web-platform-tests/runner-pretty 407cd81 Robin Berjon: working UI
- # [14:25] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [14:42] * Joins: gitbot (~gitbot@public.cloak)
- # [14:42] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to runner-pretty: https://github.com/w3c/web-platform-tests/commit/fba52a32322d76d2add2e8852052b28a750a366a
- # [14:42] -gitbot:#testing- web-platform-tests/runner-pretty fba52a3 Robin Berjon: nice progress
- # [14:42] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [14:43] <jgraham> darobin: Yeah, I guess that's a good plae to file it
- # [14:43] <jgraham> You are on OSX, right?
- # [14:43] <darobin> jgraham: yup
- # [14:43] <darobin> I filed it actually
- # [14:44] <darobin> (thought you'd get some mail)
- # [14:44] <darobin> mmmmm
- # [14:44] <jgraham> Yeah, I get so much mail from github that it's easy to miss
- # [14:44] <jgraham> I have checked and I got this :)
- # [14:44] <darobin> I'm also seeing behaviour where when you've hit stop after a while tests start running again (except unhappily since they have no window)
- # [14:45] <darobin> I suspect a timeout
- # [14:45] <jgraham> Yeah, it does sound like it, doesn't it
- # [14:45] <darobin> heh, yeah
- # [14:45] <darobin> run_next_test sets a timeout to check for, well, timeouts
- # [14:46] <darobin> stop doesn't cancel it
- # [14:47] <darobin> and it happily moves to the next test
- # [14:47] <darobin> (fixing)
- # [14:47] * Joins: gitbot (~gitbot@public.cloak)
- # [14:47] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to runner-pretty: https://github.com/w3c/web-platform-tests/commit/3f37c7a97bf3a0be68922db1799d282251ac435e
- # [14:47] -gitbot:#testing- web-platform-tests/runner-pretty 3f37c7a Robin Berjon: fix zombie testing after stop
- # [14:47] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [14:48] <darobin> mmmm, what's a good suite to try out ref tests with
- # [14:48] <darobin> ah, dnd
- # [14:48] <jgraham> WebVTT has some
- # [14:49] <darobin> or not
- # [14:49] <darobin> ah, thanks
- # [15:17] * Joins: gitbot (~gitbot@public.cloak)
- # [15:17] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 1 new commit to submission/sideshowbarker/meta-names: https://github.com/w3c/web-platform-tests/commit/d3f58e790abd2447ffa165da54687a0a7eddd3d3
- # [15:17] -gitbot:#testing- web-platform-tests/submission/sideshowbarker/meta-names d3f58e7 Michael[tm] Smith: Added some invalid test documents.
- # [15:17] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [15:18] * Joins: gitbot (~gitbot@public.cloak)
- # [15:18] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to runner-pretty: https://github.com/w3c/web-platform-tests/commit/2bb35b1abfd3c70d59a5678070a92e454cb6a2bd
- # [15:18] -gitbot:#testing- web-platform-tests/runner-pretty 2bb35b1 Robin Berjon: manual UI also looking good
- # [15:18] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [15:25] * Joins: gitbot (~gitbot@public.cloak)
- # [15:25] -gitbot:#testing- [web-platform-tests] sideshowbarker pushed 1 new commit to submission/sideshowbarker/meta-names: https://github.com/w3c/web-platform-tests/commit/b06410dd8d9a2a79fb59df41fced0debd1e1182a
- # [15:25] -gitbot:#testing- web-platform-tests/submission/sideshowbarker/meta-names b06410d Michael[tm] Smith: Renamed files for more consistency.
- # [15:25] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [15:28] * Joins: gitbot (~gitbot@public.cloak)
- # [15:28] -gitbot:#testing- [web-platform-tests] darobin pushed 2 new commits to runner-pretty: https://github.com/w3c/web-platform-tests/compare/2bb35b1abfd3...5ed63acdb6c6
- # [15:28] -gitbot:#testing- web-platform-tests/runner-pretty 7cc3810 Robin Berjon: eliminate all jshint errorsgs
- # [15:28] -gitbot:#testing- web-platform-tests/runner-pretty 5ed63ac Robin Berjon: start disabled
- # [15:28] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [15:30] * Joins: gitbot (~gitbot@public.cloak)
- # [15:30] -gitbot:#testing- [web-platform-tests] darobin opened pull request #795: Runner pretty (master...runner-pretty) https://github.com/w3c/web-platform-tests/pull/795
- # [15:30] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [15:30] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [15:30] <darobin> jgraham: https://github.com/w3c/web-platform-tests/pull/795
- # [15:31] <darobin> I maked a pretty, but maybe you won't like it :)
- # [15:48] * Joins: yankhates_cb (~yankhatescb@public.cloak)
- # [15:50] * Joins: dom (dom@public.cloak)
- # [15:53] <jgraham> darobin++
- # [15:55] <darobin> :)
- # [15:55] <darobin> jgraham: you like?
- # [15:55] <darobin> it's tweakable of course
- # [15:55] * Quits: Ms2ger (~Ms2ger@public.cloak) (Ping timeout: 180 seconds)
- # [15:57] <jgraham> Yeah, it's a lot better
- # [15:57] <jgraham> What's the licensing situation with the bootstrap stuff?
- # [15:58] <plh> time darobin, did you see https://github.com/w3c/web-platform-tests/pull/728 ?
- # [15:58] <plh> I wonder how your PR will affect that one
- # [15:58] <darobin> jgraham: Bootstrap is MIT
- # [15:58] <plh> maybe 728 should abandoned?
- # [15:59] <darobin> plh: it can be rewritten, it would certainly conflict
- # [15:59] <darobin> I thought we didn't want iframe tests
- # [15:59] <darobin> that said, for reftests it could be better
- # [16:06] <jgraham> Yeah, I don't know what the right thing to do is
- # [16:06] <jgraham> running in an iframe could give bogus results in some cases
- # [16:07] <jgraham> Really for a mobile device you don't want to be running these tests by hand
- # [16:10] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [16:10] <darobin> it could be an option with a warning
- # [16:13] <jgraham> Yep, sure
- # [16:14] <jgraham> However it seems more sensible to work on adding non-mozilla support to wptrunner or something. It seems like Tizen supports WebDriver so this might not even be a stupid idea
- # [16:17] * Quits: ArtB (~abarsto@public.cloak) ("Leaving.")
- # [16:21] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [16:22] <darobin> oh sure, I wouldn't rank it a priority
- # [16:24] <darobin> jgraham: btw I've noticed that you call window.focus() after opening the popup; are there browsers on which it actually works?
- # [16:24] <darobin> I haven't seen it do anything
- # [16:24] <darobin> (though it would be neat)
- # [16:26] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
- # [16:30] <jgraham> darobin: I'm not sure. My window manager is set up in a strange way so I probably couldn't tell anyway :)
- # [16:30] <darobin> haha
- # [16:30] <darobin> jgraham: I just researched the topic and it's pretty hopeless
- # [16:31] <jgraham> Oh well
- # [16:31] <darobin> it's a whole world of JS hackers trying new horrible tricks to cause the popup to blur and browser vendors detecting those and protecting against them
- # [16:31] <darobin> the first google hit was http://www.blackhatworld.com/blackhat-seo/blogging/563891-how-make-pop-under.html though, pretty funny
- # [16:33] <darobin> the best techniques are actively researched by porn networks
- # [16:33] <darobin> I guess it could justify doing some "research"
- # [16:35] * hober2 is now known as hober
- # [16:41] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [16:44] * Joins: gitbot (~gitbot@public.cloak)
- # [16:44] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to runner-pretty: https://github.com/w3c/web-platform-tests/commit/1f7db1c07d8d7972804dd4608b347d3f07cd3cc4
- # [16:44] -gitbot:#testing- web-platform-tests/runner-pretty 1f7db1c Robin Berjon: add ugly braces
- # [16:44] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [16:46] * Joins: gitbot (~gitbot@public.cloak)
- # [16:46] -gitbot:#testing- [web-platform-tests] darobin pushed 1 new commit to runner-pretty: https://github.com/w3c/web-platform-tests/commit/62447d61170983f999110cff371bdcc3351cfbcf
- # [16:46] -gitbot:#testing- web-platform-tests/runner-pretty 62447d6 Robin Berjon: remove HTML trailing spaces
- # [16:46] * Parts: gitbot (~gitbot@public.cloak) (gitbot)
- # [16:52] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
- # [16:52] <tobie__> Adding non-mozilla support to wptrunner would also make it easier to run the tests on saucelabs
- # [16:56] <jgraham> Yeah, so if you can get a marionette-like interface to their webdriver implementation it seems like it shouldn't be *that* hard
- # [16:57] <jgraham> But obviously isn't something that I'm planning to work on
- # [16:57] <jgraham> (unless I get bored one weekend or something)
- # [16:58] <wilhelm> jgraham: Which marionette-like features are required?
- # [17:00] <jgraham> Well the architecture assumes that you launch the browser and then start a session in two different parts of the code
- # [17:00] <jgraham> So you can't do the normal webdriver thing of letting it launch the browser
- # [17:01] <AutomatedTester> so we just need the transport code in webdriver
- # [17:01] <jgraham> And I only looked at the marionette API docs, so I don't know how non-standard they are
- # [17:01] <wilhelm> So the old Presto approach? Start the browser, then connect to it?
- # [17:01] <jgraham> Yeah
- # [17:02] <jgraham> Start the browser listening on a specific port
- # [17:02] <jgraham> Then later connect to it on that port
- # [17:02] <AutomatedTester> fwiw... webdriver does that too
- # [17:02] <wilhelm> Why? (I'm not questioning the approach, just trying to understand your particular context.)
- # [17:03] <AutomatedTester> because not all platforms allow us to start the browser in the same way
- # [17:03] <tobie__> james: you'll find doc on how saucelabs does it here: https://saucelabs.com/docs/onboarding
- # [17:03] <tobie__> (note you'll have to log in which you can do using your Github account, afaik)
- # [17:03] <jgraham> Also because it makes it easy to control the port and so on
- # [17:03] * wilhelm nods.
- # [17:03] <wilhelm> Sounds familiar. (c:
- # [17:04] <AutomatedTester> wilhelm: like I said, webdriver does that too
- # [17:04] <darobin> mmmm, so, when we drive the SauceLabs stuff it's infrastructure that doesn't need to run on vendors' systems, right? (by definition)
- # [17:04] * wilhelm nods.
- # [17:04] <darobin> I ask because that lifts the Python requirement
- # [17:04] <AutomatedTester> darobin: it works for released versions only
- # [17:04] <tobie__> :)
- # [17:05] <darobin> AutomatedTester: I know, but we'd like to use it anyway
- # [17:05] <tobie__> darobin: I see where you going with this.
- # [17:05] <darobin> we have a free account
- # [17:05] <darobin> tobie__: I wasn't being very discreet was I?
- # [17:05] <darobin> AutomatedTester: one of the things we could do is gather caniuse-like data by running the full TS across all devices on SL
- # [17:06] * Joins: scott_gonzalez (~scott_gonzalez@public.cloak)
- # [17:06] <darobin> it doesn't replace having a WD tool to run on one's own browser; they're different tools
- # [17:06] <AutomatedTester> darobin: ok but they have all browsers
- # [17:06] <darobin> but only released ones
- # [17:06] <AutomatedTester> so it will only give you a subset of data
- # [17:07] <AutomatedTester> dont have all browsers even
- # [17:07] <darobin> oh, yeah
- # [17:07] <darobin> well, they have a lot
- # [17:07] <jgraham> Probably no servo :p
- # [17:07] <darobin> I don't have the credentials for SL though, I guess I'd have to ask tobie__ or plh
- # [17:07] <AutomatedTester> e.g. they dont have blackberry's browser, Firefox (OS and Android), Chrome for Android, Opera that has blink
- # [17:08] <darobin> haha, "Eh mec, t'as pas de servo!" <- good one
- # [17:08] <darobin> AutomatedTester: I know, but it's free in exchange for just writing a script...
- # [17:08] <darobin> and I suspect they'll be adding more devices
- # [17:08] <darobin> also, Blackberry?
- # [17:08] <darobin> HAHAHAHAHAHAHA
- # [17:09] <darobin> *cough* sorry
- # [17:09] <AutomatedTester> darobin: Blackberry are going to be helping webdriver get into webkit since Apple
- # [17:10] <darobin> syntax error at AutomatedTester line 298798776
- # [17:10] <AutomatedTester> darobin: we did hope Google were going to do it but then Blink
- # [17:11] <darobin> well, let's hope they get it in before they vanish
- # [17:12] <AutomatedTester> the US government will keep them going
- # [17:13] <darobin> you mean under Chapter 11 or with contracts?
- # [17:13] <AutomatedTester> contracts
- # [17:13] <AutomatedTester> they just renewed their contracts
- # [17:13] <AutomatedTester> just being in the last couple months
- # [17:13] <darobin> yeah, but if that's all they've got they may lose the funding for teams that work on cool stuff
- # [17:13] * Joins: lukeis (~Adium@public.cloak)
- # [17:14] <AutomatedTester> darobin: they just released a webdriver implementation so they obviously do
- # [17:14] <darobin> oh! *now* you tell me that :)
- # [17:14] <darobin> that's cool news
- # [17:14] <wilhelm> Let's not scare away anyone doing good work here... (c:
- # [17:14] <darobin> next thing you know IE12 will run on OSX
- # [17:15] * wilhelm says nothing.
- # [17:15] <lukeis> noooo not that abomination again ;)
- # [17:15] <AutomatedTester> darobin: https://twitter.com/AutomatedTester/statuses/438558763432169472
- # [17:15] <wilhelm> lukeis: Hey, 5 was _excellent_.
- # [17:15] <tobie__> As long as W3C provides an end-point where vendors can send the results of having run the test suites on their own browser,
- # [17:16] <darobin> AutomatedTester: yeah, that I saw — it's real nice
- # [17:16] <tobie__> using saucelabs is just going to provide useful data points
- # [17:16] <tobie__> and incentivizes vendors to runt the tests too
- # [17:16] <tobie__> (Should they not be on saucelabs, or should they want to share improvements of yet to be released versions)
- # [17:16] <darobin> note that saucelabs integration could also help W3C have a service that let's you check if you're going to break the web with a given spec thing
- # [17:17] <tobie__> Trying to figure out what the credentials for the W3C account are, btw.
- # [17:17] <darobin> you could write a test for it and check what it does in a bunch of ancient browsers to make sure that it doesn't do anything bad there
- # [17:19] <AutomatedTester> tobie__: the downside, that I can see, for vendors to help Saucelabs is why should they give a corporate company things for them to make money (with nothing coming back)
- # [17:19] <AutomatedTester> since its money vendors will have to spend for this
- # [17:19] <tobie__> AutomatedTester: I think your premise that vendors wouldn;t get anything out of it is incorrect.
- # [17:20] <AutomatedTester> its based on historical data, but carry on
- # [17:20] <tobie__> IMHO, FFOS would benefit greatly from being easily testable for anyone using saucelabs.
- # [17:21] <AutomatedTester> tobie__: which is why there will be a spec
- # [17:21] <AutomatedTester> there is investment in the implementation of webdriver
- # [17:21] <AutomatedTester> but I work for a vendor that agrees with the need for webdriver
- # [17:22] <AutomatedTester> MS have *just* agreed
- # [17:22] <AutomatedTester> and Apple havent seen value
- # [17:22] <AutomatedTester> note that the spec has been in the works for 2+ years
- # [17:22] <tobie__> Yeah, they're the dominating player in the mobile field.
- # [17:22] <tobie__> no wonder they're not incentivized to fix the issue.
- # [17:22] <tobie__> people do it for the,
- # [17:23] <tobie__> s/the,/them/
- # [17:23] <AutomatedTester> Apple has no one doing it for them
- # [17:23] <tobie__> case in point, saucelabs lets you run tests on iOS devices.
- # [17:24] <AutomatedTester> so you are proving my point
- # [17:24] <AutomatedTester> vendors won't invest in this because others are doing the work
- # [17:24] <wilhelm> My evil plan from three years ago was this: 1. Spec WebDriver. 2. Point to the spec, and standardize automation of interactive web platform tests using WebDriver. 3. With new incentives, see browser vendors pick up their parts of the work.
- # [17:25] <tobie__> AutomatedTester: I don't think we're talking about the same thing.
- # [17:25] <jgraham> In any case
- # [17:26] <AutomatedTester> I said "the downside for vendors helping saucelabs is they are putting in effort(into a for profit org) and not getting anything back)
- # [17:26] <jgraham> If someone puts in the effort, porting wptrunner to non-Mozilla browsers might not be that hard
- # [17:26] <AutomatedTester> and you disagreed
- # [17:26] <jgraham> Which is a better solution than tools/runner
- # [17:26] <wilhelm> jgraham: Have you approached any other vendors?
- # [17:26] <AutomatedTester> and then said what I just said
- # [17:26] <jgraham> wilhelm: No, I haven't even finished landing it for Mozilla yet
- # [17:27] <wilhelm> jgraham: I'd prod Microsoft sooner rather than later and say "this is relevant to your interests". They may be working on the exact same challenges right now.
- # [17:27] <tobie__> AutomatedTester: no, I'm saying there's incentives for vendors who are not market leaders to put effort in providing saucelabs with devices, etc.
- # [17:28] <jgraham> wilhelm: Once I am convinced it works from PyPI I will send a note to public-test-infra at least
- # [17:28] <tobie__> Agreed of course there's none for market leaders as saucelabs will do the work for them
- # [17:29] <wilhelm> jgraham: Wonderful!
- # [17:30] <AutomatedTester> tobie__: Apple arent interested in making testing easy because it means they can see sell more hardware
- # [17:30] <tobie__> AutomatedTester: meh
- # [17:30] <AutomatedTester> tobie__: example of this, know of a OSX in the cloud provider?
- # [17:30] <AutomatedTester> I know Google have been trying for a long time to help build and internal one and Apple tell them to bugger off
- # [17:31] <tobie__> OSX in the cloud != testing devices
- # [17:31] <AutomatedTester> tobie__: no one tests on real devices at scale
- # [17:32] <AutomatedTester> they either use development boards or emulators
- # [17:36] <tobie__> I'm confused about where you're going with this.
- # [17:36] <tobie__> The only point I was trying to make was: running the tests on as many UA as possible is good.
- # [17:37] <tobie__> If certain UAs aren't provided by saucelabs, relevant vendors can choose to either:
- # [17:37] <tobie__> 1. run the tests themselves and provide the results
- # [17:37] <AutomatedTester> which they need to do otherwise we will never see in development versions
- # [17:38] <tobie__> 2. provide a compatible solution so that such tests can be ran similarly to the way saucelabs-based tests are.
- # [17:38] * Quits: darobin (rberjon@public.cloak) (Client closed connection)
- # [17:39] <AutomatedTester> ok, what is a saucelabs based test? WebDriver?
- # [17:39] <tobie__> Yes. :)
- # [17:39] * wilhelm wields his shoehorn.
- # [17:40] * Quits: Lachy (~Lachy@public.cloak) ("Textual IRC Client: www.textualapp.com")
- # [17:43] <tobie__> (so #2 above would imply something like exposing a WebDriver client that could be remotely driven by a version of wpt-runner hosted on w3c-tests.org)
- # [17:43] * Quits: AutomatedTester (~AutomatedTester@public.cloak) (Client closed connection)
- # [17:43] * Joins: Automate_ (~AutomatedTester@public.cloak)
- # [17:43] <Automate_> anyway, I need to go
- # [17:43] * Quits: Automate_ (~AutomatedTester@public.cloak) (Client closed connection)
- # [18:04] * Joins: Lachy (~Lachy@public.cloak)
- # [18:05] * Joins: mdas (~mdas@public.cloak)
- # [18:21] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
- # [18:22] * Joins: Lachy (~Lachy@public.cloak)
- # [18:25] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
- # [18:25] * Joins: Lachy (~Lachy@public.cloak)
- # [18:27] * Quits: mdas (~mdas@public.cloak) (Client closed connection)
- # [18:27] * Joins: mdas (~mdas@public.cloak)
- # [18:27] * Quits: yankhates_cb (~yankhatescb@public.cloak) (Ping timeout: 180 seconds)
- # [18:29] * Joins: lmclister (~lmclister@public.cloak)
- # [18:51] * Quits: dom (dom@public.cloak) ("")
- # [18:53] * Joins: shepazu (schepers@public.cloak)
- # [19:14] * Quits: Lachy (~Lachy@public.cloak) ("My MacBook Pro has gone to sleep. ZZZzzz…")
- # [19:27] * Quits: shepazu (schepers@public.cloak) ("is sleepy")
- # [20:16] * Quits: mdas (~mdas@public.cloak) (Client closed connection)
- # [20:45] * Joins: AutomatedTester (~AutomatedTester@public.cloak)
The end :)