How to prevent RSpec helper from being loaded

I'm writing integration tests with Capybara at the moment for our Rails 4 application. To make this as light-weight as possible, I have written a capybara_helper.rb file that is located inside the spec folder to be used with RSpec.

However, this file is loaded every time when the RSpec tests are running, destroying the configuration for existing Capybara tests that originally were present inside the test suite.

Is there a way to tell/configure RSpec to not load this file when starting up the "normal" unit tests?

My Integration tests are loaded with the command RAILS_ENV=test bundle exec rspec --tag @type:capybara. Our normal tests are just ran using rake parallel:spec[4]