I have integration tests written in bash (long time ago, I didn't write them). The tests run predefined queries and compare them to expected results. Problems:
- They are written in bash/ksh which is not scalable beyond writing single scripts
- Queries are not exhaustive and rarely check for error conditions
- Test run on predefined queries only
What's needed:
- Fully automated, apart from initial configuration
- Support both linux command-line programs and web service testing
- Support automated query generation
- Extensions with new queries/classes should be without requiring code changes
- Detailed error reporting when queries fail
Aucun commentaire:
Enregistrer un commentaire