Test and Certify with the SmartThings Test Suite

The SmartThings Test Suite, part of the SmartThings Console, automates Works with SmartThings (WWST) product testing. It checks that your device onboards, works, and can be removed in line with WWST standards.

How the Test Suite Works

The Test Suite connects to a device in your Samsung account and creates a test plan based on the device definition. It then runs the test cases and reports the results. Some test cases run automatically. Others ask you to physically interact with the device or confirm what you see or hear.

The Test Suite offers two types of tests:

Test type	What it covers	When to use it	Counts toward self-test certification?
Full Integration Test	The complete end-user experience: onboarding, device functionality, and device removal.	When your integration is complete and you are ready to certify.	Yes. A passed Full Integration Test is required.
Operational Test	A single part of the Full Integration Test, such as onboarding or device functionality.	During development, to check specific parts of your integration.	No. Operational Tests alone do not qualify a device for self-test certification.

Supported Connection Types

You can test devices of all the connection types below in the Test Suite. However, not every connection type qualifies for self-test certification.

Connection type	Can be tested in the Test Suite	Qualifies for self-test certification
Matter	✅ Yes	✅ Yes
Zigbee	✅ Yes	✅ Yes
Z-Wave	✅ Yes	✅ Yes
Cloud Connected (SmartThings Schema)	✅ Yes	✅ Yes
Direct Connected (MQTT)	✅ Yes	⚠️ Partially. Covers functional and onboarding testing only. A Security Review is also required.
LAN	✅ Yes	✅ Yes

Direct Connected (MQTT) Devices and the Security Review

Self-test certification for Direct Connected devices covers functional and onboarding testing only

Direct Connected devices must still complete a Security Review and submit the WWST Security Request Form, as described in Security Requirements for Direct Connected Devices, as part of the certification submission.

For Direct Connected devices, this means:

• A passed Full Integration Test can replace functional and onboarding testing by the Authorized Test Provider.
• The Test Suite does not replace the Security Review. The Security Review is always required, so Direct Connected devices do not qualify for fully no-cost self-test certification.
• The Security Review may involve the Authorized Test Provider and may have a cost. After you submit your certification request, SmartThings will tell you the next steps for your device.

Self-Test Certification Requirements

Your device qualifies for self-test certification only if it meets all of the following requirements:

1. Connection type: It connects using Matter, Zigbee, Z-Wave, LAN, Cloud Connected (SmartThings Schema), or Direct Connected (MQTT). Direct Connected devices also need a Security Review.
2. Device type: It matches a device type supported by the Test Suite.
3. Capabilities: It uses only Capabilities supported by the Test Suite.
4. Test results: It has passed a Full Integration Test in the Test Suite, and the results are linked to your product in the SmartThings Console.

Your device must also meet all general WWST requirements, such as the required Capabilities for its device category and our Product Policies.

Some device types always need testing by our Authorized Test Provider

Some device types, such as cameras, doorbells, smart locks, and health and safety products, may not qualify for self-test certification for any connection type. These devices require testing by our Authorized Test Provider.

If your device does not meet all of these requirements, you can still use the Test Suite to find and fix issues before you submit your device for certification. Certification testing will then be done by our Authorized Test Provider. See Apply for Certification for details.

Test and Certify Your Device Step by Step

Follow these steps to test and certify your device with the Test Suite:

1. Check that your device qualifies.
   Compare your device with the self-test certification requirements and the lists of supported device types and Capabilities.

2. Prepare your account, device, and documentation.
   Meet the general prerequisites and complete the preparation for your connection type. For example, Cloud Connected devices need a screenshot and possibly a video, and Direct Connected devices need a photo of the QR code. See Before You Begin.

3. Start a Full Integration Test and onboard your device.
   Start a test in the Test Suite and onboard your device to SmartThings as part of the test. See Start a Test and Onboard Your Device.

4. Run and monitor the test cases.
   Review the test plan, start the test session, and complete any manual actions the Test Suite asks for. See Run and Monitor Your Tests.

5. Review your test results.
   Check the Test Summary, download your test report, and fix any failed test cases. See Review Your Test Results.

6. Link your test results to your product and submit for certification.
   Create your product in the SmartThings Console, link it to your test results, and submit a certification request. Direct Connected devices also submit the WWST Security Request Form at this step. See Submit for Certification.

7. Wait for the SmartThings review.
   SmartThings reviews your request and contacts you with the next steps. If your device qualifies for self-test certification, it can be certified based on your test results. Otherwise, your request moves on to our Authorized Test Provider.

Who Can See Your Test Sessions

A test session belongs to the account that created it and to the Organization selected when it was created. Members of that Organization can view the session and download its reports, but only you, as the owner, can change it. You can also share a finished session with another Organization. See Test Session Access and Sharing.

Have a question or need help?

Contact us at partners@smartthings.com.