jeudi 20 août 2015

How to test processors in Scrapy?

The short question is: does the framework (Scrapy) provide a way to do unit test? More specific, a way to test processors?

The long question is...

I have a bunch of processors declared in a processors.py file. These processors are used by the items loaders (declared in loaders.py). As I am finding some bugs on the processors I would like to test them against some crafted cases. In Ruby on Rails the framework offers a simple way to do unit test.

Is there any easy way to test the processors in a similar way in Scrapy?

By now all my tests are hard coded in other files. But as I write more tests, I keep coding the same things again... So, I am sure someone somewhere has made up a solution for this!

Aucun commentaire:

Enregistrer un commentaire