Conformance Test Suite for data holders

Conformance Test Suite process 

The Australian Competition and Consumer Commission (ACCC) manages the Conformance Test Suite, which is a key part of the Consumer Data Right on-boarding process. 

The Consumer Data Right Conformance Test Suite confirms the technical conformance of your production-ready software using a range of test scenarios targeting specific areas.

The Conformance Test Suite has two modes allowing for either provider (also known as participant) type, data holder and data recipient, to perform relevant tests. If you are a data holder, the tests provide a simulated data recipient and a simulated Register to support the test scenarios. You test in isolation against the simulated providers and the simulated Consumer Data Right Register, so you don’t interact with live consumer data.

The diagram below shows how data holders each interact with the Conformance Test Suite. 

The Conformance Test Suite is not a testing tool to assist you during the development of your software (see Participant tooling), rather, it is available to you during on-boarding, once registered as a data holder and before you become activated on the Register.

The Conformance Test Suite tests your conformance with the Consumer Data Standards before entering into the Consumer Data Right system. You should have a production-ready brand before undertaking the Conformance Test Suite.

Completing the Conformance Test Suite

The Conformance Test Suite is an automated testing suite and can be completed within an hour if all provider configurations are completed correctly and no errors are encountered. It is important to ensure your solution has been adequately tested before executing the Conformance Test Suite to minimise the test completion period.

If errors are encountered, the completion period can be lengthy (for example, days or weeks) as errors need to be diagnosed and resolved, and your solution made ready for retesting.

Conformance Test Suite tests for data holders 

The Conformance Test Suite for data holders comprises a number of test scenarios that are crucial for ensuring compliance. These test scenarios include:

1. Dynamic Client Registration: this scenario tests whether the data holder can respond to a data recipient's registration request via dynamic client registration, validate the request against the Register, and return a client ID.
2. Concurrent Consent: this scenario tests the establishment of multiple consent arrangements for a single data recipient-consumer pairing.
3. Polling the Register for Software Product Status: This scenario tests whether the data holder correctly polls the CTS Register at least every five minutes for a Participant ADR's Software Product Status changes.
4. Polling the Register for Data Recipient: this scenario tests whether the data holder correctly polls the CTS Register at least every five minutes for the list of data recipients.
5. Client Certificates: this scenario tests whether the data holder can handle an invalid client certificate received from a Participant ADR.
6. Holder of Key: this scenario tests the data holder's compliance with the Holder of Key (HoK) mechanism when accessing resource APIs.
7. Client Assertion: this scenario tests whether the data holder responds correctly to poorly formed Client Assertions within requests.
8. Amending Consent: this scenario tests the correct treatment of the amendment of an existing consent arrangement.
9. Removed Software: this scenario tests whether the data holder fulfills its responsibilities when a data recipient software product status changes.
10. Consent Revocation: this scenario tests whether the data holder correctly handles situations when a customer withdraws their consent from the data holder (either via the ADR or directly with the data holder) and that the data holder handles the arrangement revocation correctly.
11. Token Revocation: this scenario tests whether the data holder can receive and handle a token revocation request.

The Conformance Test Suite: version history and guidance page provides in-depth information on each of these test scenarios.