Yes. Under the New Jersey Law Against Discrimination, if an automated hiring or management tool produces a discriminatory impact, your business can be held responsible even when the software belongs to a third-party vendor. Employers are expected to take reasonable steps to vet these tools and document that review.
