Automated repository tests running even though disabled

I’ve already posted this question in stack overflow.

Basically I have a repo with multiple dockerfiles and two automated builds with that repo as source.
Only one of the image repositories has auto tests enabled, but the tests are running for both.