Skip to main content
DocsSmartThings APIEnterprise API
Docs

Test and Certify with the SmartThings Test Suite

The SmartThings Test Suite automates Works with SmartThings (WWST) product testing, ensuring device compatibility with the SmartThings platform. In many cases, completing the required tests may qualify your products for no-cost WWST certification.

tip

The Test Suite currently supports the following integrations: Matter, Zigbee, Z-Wave, LAN, MQTT, and Cloud Connected Devices (SmartThings Schema).

Prerequisites​

  1. A Samsung account.
  2. The latest version of the SmartThings app installed on your iOS or Android device.
  3. A device connected to the SmartThings platform using Matter, Zigbee, Z-Wave, LAN, MQTT, or SmartThings Schema.
  4. If testing a device that is part of a Developer Center Organization, ensure that your Samsung account is associated with the Organization. Visit Brand and Organization Management to learn about Organizations and how to invite others to an Organization.

Using the Test Suite​

Sign in to the Test Suite using your Samsung account, and confirm that your device appears in the Test Suite device list.

After logging in, the Test Suite will display a list of all devices associated with your Samsung account. The device list is your central hub for managing and organizing devices in the Test Suite. It includes:

  • Connected Devices: All devices linked to your SmartThings account.
  • Shared Devices: Devices available through Locations and Organizations shared with your SmartThings account.
  • Previously Connected Devices: Devices no longer connected but have completed tests in the past to ensure you have complete history available.

From the device list page, you can view the test history for each device, or select New Test to create a new session.

Descriptive text for the image
Missing a shared device?

If you are not seeing an expected device, visit my.smartthings.com/advanced/devices to confirm your device is visible in your Samsung account. If not visible, ensure your Samsung account is associated with the shared Location and/or Organization. For further assistance, email support.

Start a Test Session​

Begin by clicking New Test from the Test Suite device list. The Test Suite will analyze your device and generate a customized test plan.

You can exclude specific Capabilities, commands, or attributes from testing (useful if you are refining your integration and want to focus on specific elements). Test cases will run in the order in which they are displayed on the page.

Certain Capabilities may automatically be excluded from testing. Any automatically excluded Capabilities are listed in the Not Supported in Test Suite section. If your device contains automatically excluded Capabilities, you may still submit your device for WWST certification; we will evaluate your submission to determine if additional testing is required.

Start a test session stylized representative
info

For WWST certification, we recommended including all elements in the test session. If exclusions are necessary, provide a detailed explanation in the "Notes for SmartThings Team" field on the Test Summary page.

Certain Capabilities may automatically be excluded from testing. Any automatically excluded Capabilities are listed in the "Not Supported in Test Suite" section for your reference. If your device contains automatically excluded Capabilities, you may still submit your device for WWST certification; we will evaluate your submission to determine if additional testing is required.

Manual tests will have a time limit to be completed. You can use the extend button to request additional time to complete the test, with longer tests having a maximum extension of up to three (3) hours.

Types of Test Cases​

  1. Fully Automated Test Cases: These cases run automatically and without user intervention; simply monitor progress. For example, an RGBW lightbulb will automatically turn on, dim, and change color. The Test Suite will monitor to confirm all events have occurred as expected

  2. Manual Action Test Cases: Some test cases require specific manual interaction within a limited time frame. These include events where physical engagement with the device is needed to create an event, such as motion detection, contact sensor operation, or a temperature change.

  3. User Feedback Test Cases: Require input or feedback; follow on-screen instructions.

After reviewing your device test plan, click Start Test Session to begin testing.

Monitor Your Test Session​

The Test Session in Progress page provides real-time monitoring of test case execution.

Skipping Manual Operations

Manual actions or user feedback can be skipped, even if not unchecked during setup. The type of testing you are conducting influences whether skipping an action is recommended or not:

  • Integration Testing: Skipping is acceptable.
  • WWST Certification: We recommend completing all test cases for full compliance.
The <i>Test Session in Progress</i> page provides real-time monitoring of test case execution

Review Your Test Results​

After all test cases are completed (or skipped), you’ll be redirected to the Test Summary page, which provides a detailed overview of results, including failed cases or issues requiring attention.

The Test Summary provides a detailed overview of your test session, including results from all executed test cases.

  • View Test Case Details: Review pass/fail statuses and any issues encountered.
  • Download Test Summary Logs: Access a detailed log for deeper analysis, useful for troubleshooting integration problems.
  • Share Logs With Support: Share logs with the SmartThings support team to investigate major issues.
Review Test Results
tip

If your device does not fully pass all tests, WWST certification may still be possible. If you think your device may still qualify for certification, describe your case in the “Notes to the SmartThings Team” section in your certification submission form.

If your device passes all tests required by the Test Suite, your device may now be submitted for Works with SmartThings certification. In order to certify based on Test Suite results, you must associate your test results with the product you are certifying.

tip

Before you can associate your test results with a product, you must first create a product in the Certification Console.

To associate your test results with your product:

  1. Expand the Test history of your device.
  2. Select Link to product and select the desired product to associate with the specified device test history.
  3. Submit your product for certification in the Certification Console. We recommend reviewing the certification guidelines before submitting your request.

After you submit your certification request, SmartThings will review your request and contact you with your next steps. You can read about the certification review process in-depth in Apply for Certification.