A lot of tests can be done without actually running the runtime. This should be automated and run at each commit.