Participant testing

The 5MS Program developed the Industry Testing and Market Trial Strategy in consultation with the Readiness Working Group. Three types of participant testing were identified:

  1. Industry testing

    Self-testing of functionality such as connectivity, and/or coordinated multiparty testing of functional scenarios.

  2. Invitation industry testing

    Coordinated testing of business process scenarios with a select number or subset of participants with systems ready for testing.

  3. Market trials

    Coordinated multi-party end-to-end testing of business process scenarios.

AEMO Pre-production environment

AEMO has pre-production and production environments, each separately maintained. New features are added to pre-production first, and announced in change notices and technical specifications. The pre-production environments are intended for participant testing and training purposes.

The 5MS Program will release 5MS and GS system changes into the AEMO pre-production environment at least four weeks prior to deployment into the production environment. Participants may use the AEMO pre-production environment to carry out their own tests (including B2B testing) and to take part in the 5MS and GS Market Trials.

Information on how to connect to the AEMO pre-production environment is available here.

5MS Staging environment

The 5MS Staging Environment is a dedicated environment for supporting participants in preparing for the 5MS and GS rules. It contains early versions of various features that are being developed by AEMO for 5-minute settlement and global settlement. Participants may use the 5MS Staging Environment to carry out participant testing including B2B testing utilising eHub.

For more details on the capabilities and releases into the 5MS Staging Environment see the dedicated webpage.

Functionality deployment schedule

The Functionality Deployment Matrix provides a detailed list of the 5MS and GS capabilities and when they are available in the 5MS Staging Environment and AEMO pre-production environment. The Matrix is maintained by the 5MS Program and updated as necessary.

Market trial

The market trials will be coordinated by AEMO and the plan will be developed in consultation with the ITWG. The approach to market trials is outlined in the Industry Testing and Market Trials Strategy. Market trials will take place in AEMO’s pre-production environment.

 

Plan development with participants

Plan finalisation

Market Trial

5MS Market Trial

Feb 2020

May 2020

Jul 2021

GS Market Trial

Sep 2021

Dec 2021

Feb 2022

For a more detailed version of this time, refer to the 5MS and GS Program Timeline.

Frequently asked questions

  • How does the deployment of 5MS changes interact with other market changes such as Customer Switching and Wholesale Demand Response?
    AEMO has established a Regulatory Implementation Roadmap Forum and is consulting on proposed changes needed as a result of the three-month deferral of 5MS and GS to the regulatory roadmap that was established earlier in the year.
  • Will the pre-production environment be in five-minute mode or 30-minute mode?

    The pre-production environment for each component of the Wholesale and Retail streams will reflect the upcoming mode of operation for that component.

    The 5MS Functional Deployment Matrix will indicate when MSATS, Settlements and Bidding/Dispatch will be in 30-minute state, five-minute state, and subsequently Global Settlement state where applicable.  

     

  • What is the difference between Industry Testing and Market Trial?

    Market Trial will consist of the coordinated multi-party end-to-end testing of business process scenarios. The development of these scenarios will be led by AEMO. 

    Industry testing refers to a participants self- testing functionality such as connectivity and/or a participant coordinating multi-party testing of functional scenarios with other participants using the AEMO environments.  

    Industry testing can take place any time once the functionality is available in the selected environment whereas Market Trials will be scheduled for specific times.  

    The strategy for each capability release has been developed in consultation with Industry and is documented in the Industry Test and Market Trial Strategy.

  • What support is available for participants that want to test in the AEMO environments?

    Support will be provided to participants preparing for Industry Testing through the ITWG and Support Hub. 

    Any issues encountered while testing in the 5MS Staging Environment can be emailed to 5MS or the AEMO Support Hub and will be investigated on a best endeavour basis.

  • How and when will the scenarios for the 5MS and GS Market Trials be developed?

    The scenarios for the 5MS and GS Market Trials will be developed in consultation with the ITWG. Engagement for the 5MS Capability Market Trial will begin in February 2021 and the plan will be finalised in May 2021. Engagement for the GS Market Trial will begin in September 2021 and the plan will be finalised in December 2021.

  • Is participation in Market Trial mandatory?

    Participation in Market Trial is not mandatory. However, we strongly encourage all participants to participate in Market Trial as it is an opportunity to test their systems and process prior to a major market change which will aid in mitigating cutover and go-live risk.  

  • My organisation will not be ready to participant in Industry Testing. Is it possible to test in the AEMO environments prior to Market Trial?

    Yes, once functionality is deployed into the pre-production environment it remains there and will be available during the transitional period prior to the commencement of 5MS and Global Settlements. 

    Due to the three-month deferral, AEMO is currently reviewing if the 5MS Staging Environment should be extended to cover the transitional period. This will be discussed with the ITWG and RWG. 

    AEMO will publish when the changes are available in the 5MS Staging or pre-prod environments so a participant can commence testing whenever they are ready.  The release notes will also indicate what a participant can functionally test outside of a market trial and what testing will be done as part of the market trial.  

    Participation in industry testing and market trials is voluntary.   The capability is available for participant testing in the pre-prod environment in the lead up to the production deployments and remains in pre-prod post deployment.   Participants are also able to test their capability in the 5MS Staging Environment. 

  • If my organisation is not intending to participate in Market Trial, will it be possible to test in an AEMO environment during the scheduled Market Trials?

    Yes, the pre-prod environment is available during the Market Trial period, however, where participants are testing defined scenarios consideration should be given to not impacting those scenarios being run through the Market Trial.  Participants who choose to take part in market trials will have the ability to select which of the test offered they want to execute, they can do some or all of the tests and AEMO will coordinate pairing with other participants to enable end to end testing to be completed.    

  • Is the 5MS Staging Environment in five-minute mode or 30-minute mode?

    In the 5MS Staging Environments, the Settlements systems have moved from 30-minute to five- minute state, Bidding is in five-minute state and MSATS is in 30-minute state.  The 5MS Functional Deployment Matrix will indicate when MSATS will be in five-minute state, and subsequently Global Settlement state.  

  • When will the 5MS and GS functionality be available in AEMO’s pre-production environment?

    This information is available in the 5MS Functional Deployment Matrix.  

  • Can the AEMO environments be used for B2B testing?

    Yes, B2B testing can take place in the pre-prod environment. B2B testing will not be coordinated by AEMO.  

    AEMO will also deploy eHub into the 5MS Staging Environment to support B2B testing between participants. This will be available from 31 August 2020. 

     
  • Is AEMO coordinating any B2B testing?

    No. Participants that wish to engage in B2B testing should coordinate bilateral testing with other participants independently of AEMO. 

  • Why do the Industry Tests finish a few days before the AEMO deployment into production?

    We have left a few days between the milestones for completing Industry Testing and the AEMO go-live milestones (i.e. MDM, Settlements and Dispatch) to allow for cutover activities for AEMO and those participants that will cutover at that time.  

X
Cookies help us improve your website experience.
By using our website, you agree to our use of cookies.
Confirm