Inspiration
Legacy codebases spanning millions of lines often are accompanied by tens of thousands of tests. When pushing to a test runner like jenkins, often all tests have to be run, which wastes a lot of time and resources, especially when you're waiting on the test results to carry on with your task. That is why we have created TestPilot! TestPilot can analyse supplied github pull requests to decide which tests are relevant to run based on code changes found. TestPilot has support for multiple languages, and future product expansion includes further language support, support for bitbucket, and integration in bitbucket and github as apps.
What it does
TestPilot discovers the tests within your repository, and analyses the code changes for a pull request. Once done, TestPilot recommends tests that should be run, and also gives them an importance, as well as a risk factor, with low risk meaning the tool is fairly certain it's correct and high risk meaning it can't be certain on it's accuracy.
How we built it
The product was developed in python with relevant tests added, as well as end to end testing by finding pull requests from open source github projects, as well as making our own test repo to be used for some testing and the demo.
Challenges we ran into
Some languages were harder to support than others, and some currently dont have support due to the time restrictions of this hackathon, however will be added in the future.
Accomplishments that we're proud of
We are proud of the multi language support of our site, as well as the ease of use. In future we would also support account creation and integration into Github and Bitbucket as Apps, to allow for further ease of use and support.
What we learned
We have learned about languages we are not currently familiar with as we have had to learn the syntax of them in order to be able to analyse. We have also learnt a lot of Python while developing the project.
What's next for TestPilot
TestPilot will continue to be developed, with further language support and support for bitbucket pull requests. We will also implement app integrations into Github and Bitbucket.