Jenkins not failing on tests that fail in coverage

I have Jenkins setup to run tests before anything gets pushed into our QA environment. Recently I added python coverage to check code coverage of the tests.

Issue I have is not I see in the output that tests are failing, but the build still pushes through.

I am running the following in a bash script:

coverage run manage.py test --settings=my.settings.jenkins --noinput

When I was running the tests normally without coverage, if the test failed, the build would fail, this is no longer the case.

The project is a Django project on Python 3, any help would greatly be appreciated.