Skip to content
Software development
ASD ISMISM-2032

ASD ISM 2032 Ensure automated tests are completed before building

What it says

The build solution ensures that all automated testing is completed without warnings, alerts or errors before building software artefacts.

Quoted as published. Everything else on this page is written by Control Stack.

What it means

In plain English

Before creating software, complete all automated tests without errors or warnings.

Before software goes live, it's important to run tests to catch any problems or errors. This helps prevent issues that could lead to the software not working properly, risking data loss, unhappy customers, or unexpected costs in fixing things later.

Why it matters

Building artefacts when automated tests have warnings, alerts or failures can ship defects, causing outages, rework and security regressions.

How to implement

  1. The IT team should set up automated testing software that runs all necessary tests whenever new software changes are made.

    They can use tools that automatically check for errors and send alerts if something is wrong, ensuring the team can fix issues promptly.

  2. Project managers should ensure that developers write proper test scripts for new features or changes.

    They can hold workshops to train developers on creating effective test scripts that thoroughly check for common mistakes and vulnerabilities.

  3. Business owners should require a test report before approving software for release.

    They could ask for a brief summary of test results, which shows everything was checked and passed successfully without errors.

  4. Developers should regularly update and maintain test scripts to include new scenarios based on customer feedback and previous issues.

    They can set a monthly review to add new tests, ensuring continued software performance and security.

  5. The IT manager should oversee a final review meeting before any software release.

    In this meeting, the team can confirm that all tests were completed, no issues were left unresolved, and everyone agrees the software is ready for deployment.

Keep it running

Configure the build to block artefact creation unless the full automated test suite completes with zero warnings, alerts or errors; fail the pipeline on any test issue.

Evidence and audit

  1. Check 1 of 5What an auditor asks for

    Ask for

    Access to the build pipeline documentation: Request details on the automated testing setup and execution process.

    Look at

    Defined procedures and tools used for testing before building software.

    Good evidence

    Shows clear documentation outlining the automated tests applied consistently.

  2. Check 2 of 5What an auditor asks for

    Ask for

    Recent automated test reports: Request records of recent automated test results before a software build was approved.

    Look at

    The timestamps, test names, and outcomes to confirm all tests ran as expected without errors.

    Good evidence

    Includes comprehensive, error-free test logs.

  3. Check 3 of 5What an auditor asks for

    Ask for

    A list of resolved testing issues: Request records of any issues identified by automated tests and how they were resolved.

    Look at

    A well-maintained list showing each issue, the time it was identified, and the solution applied.

    Good evidence

    Demonstrates a tracking system that promptly addresses and resolves all identified problems.

  4. Check 4 of 5What an auditor asks for

    Ask for

    Evidence of testing tool maintenance: Request documentation on the updates and maintenance of testing tools.

    Look at

    A schedule of regular tool checks and updates to ensure tools are functioning correctly.

    Good evidence

    Shows up-to-date records indicating proactive maintenance and testing tool reliability.

  5. Check 5 of 5What an auditor asks for

    Ask for

    To view the final sign-off record for software releases: Request proof of business owner sign-off after successful testing.

    Look at

    Dated signatures or approval emails indicating software passed all tests and is safe to deploy.

    Good evidence

    Ensures sign-off was given after a thorough review of testing results.

Mappings

Closest match in ISO/IEC 27001: A.8.29, Security testing in development and acceptance, which this control partially meets.

ISO 27001

ISO/IEC 27001: 1 mapping

Mappings show how controls relate across frameworks. They do not imply full equivalence or certification.