The dashboard tells you at a glance whether the practitioner lodgment service is functioning normally or is experiencing problems. This is real-time data sourced directly from ATO monitoring systems.
For details of upcoming maintenance events, visit the systems maintenance page.
Upgrade of SRP service failed. It had been tested in Level 4 but did not work in Level 5. Decision to do roll back not taken until 11am ACDT and then only for 1 node (Node 1). Rollback failed but in the interim a fix was found (configuration change missed) and applied to Node 2. This came back to life and by around 4pm, transactions were getting through - although degraded performance. Over the course of the next hour or so, all Nodes except 1 were returned.
Node 1 was returned by 9:30 ACDT.
Communications were issued around midday advising overnight maintenance went over-time. It took about that long for the incident to become a P2 status - invoking all the communications requirements.
I spotted the problem at 7:20am ACDT and started to raise alarm. Dashboard was updated by around 8am ACDT.
Prod 1 SRP only affected. Prod 2 was operational throughout.