Skip to content

[AK] Added Autobahn Test Support#26

Open
adamkaplan wants to merge 5 commits intoacmacalister:masterfrom
adamkaplan:test-suite
Open

[AK] Added Autobahn Test Support#26
adamkaplan wants to merge 5 commits intoacmacalister:masterfrom
adamkaplan:test-suite

Conversation

@adamkaplan
Copy link
Contributor

See image below. The setup is enough to run quick Autobahn tests, viewing the results directly in the simulator (checkmark or X for pass/fail).

Note that tests fail randomly because the current Jetfire GCD integration has a few serious bugs that cause messages to arrive out of order. I'll put the fix for that in another PR because it's not related to the tests themselves.

image

Future change should be to support tests on device (i.e. different URL) and generating the Autobahn results web page (not a big deal).

@adamkaplan
Copy link
Contributor Author

Usage note: this implementation requires that you run an Autobahn test server locally. Everything is default per the Autobahn install and usage guide.

just install and wstest -m fuzzing server.

@adamkaplan
Copy link
Contributor Author

@daltoniam I pulled in your branch from #25 (queue-based). There is a problem. Sometimes the didReceiveString callback is triggered with nil as the string – ostensibly because of some new race condition the queue change.

Previously some tests would fail, but Autobahn's "info" endpoints always worked. Now they fail regularly. That's pretty bad because now we can't actually run the test suite itself :-(

@daltoniam
Copy link
Collaborator

Interesting and unfortunate. I just pushed some cleanup changes into the queue branch. I'll tested it against autobahn as well, see if I missed anything

@adamkaplan
Copy link
Contributor Author

I've also got a bunch of changes for that branch almost ready. Want to wait for those please?

Edit: Gah, they're pushed. Ok

@daltoniam
Copy link
Collaborator

Sorry 😞

@adamkaplan adamkaplan changed the title Added Autobahn Test Support [AK] Added Autobahn Test Support Apr 14, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants