tag:status.rodin.com.au,2005:/historyRODIN Business Solutions Status Status - Incident History2024-03-29T16:22:51+11:00RODIN Business Solutions Statustag:status.rodin.com.au,2005:Incident/202195542024-03-14T05:30:56+11:002024-03-14T05:30:56+11:00RODIN Cloud Services Maintenance<p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>05:30</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>04:00</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>09:42</var> AEDT</small><br><strong>Scheduled</strong> - The provider will be performing scheduled maintenance on RODIN Cloud services during the following times<br /><br />Start: Thursday, March 14th, 2024 at 4:00 AM AEDT<br />End: Thursday, March 14th, 2024 at 5:30 AM AEDT<br /><br />RODIN will review post-maintenance to ensure all systems are operational</p>tag:status.rodin.com.au,2005:Incident/201020552024-03-01T21:00:56+11:002024-03-01T21:00:56+11:00Scheduled Maintenance - Remote Support and RODIN Control<p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>21:00</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>20:30</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>11:30</var> AEDT</small><br><strong>Scheduled</strong> - Remote Support and RODIN Control will be undergoing Maintenace during this time and will be unavailable.</p>tag:status.rodin.com.au,2005:Incident/200334402024-02-22T05:30:56+11:002024-02-22T05:30:56+11:00RODIN Cloud maintenance<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>05:30</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>04:00</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>10:16</var> AEDT</small><br><strong>Scheduled</strong> - The provider will be performing scheduled maintenance on RODIN Cloud services during the following times<br /><br />Start: Thursday, February 22nd, 2023 at 4:00 AM AEDT<br />End: Thursday, February 22nd, 2023 at 5:30 AM AEDT<br /><br />RODIN will review post-maintenance to ensure all systems are operational</p>tag:status.rodin.com.au,2005:Incident/200243792024-02-20T20:10:04+11:002024-02-20T20:10:04+11:00Scheduled Maintenance - Remote Support and RODIN Control<p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>20:10</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>20:08</var> AEDT</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>20:00</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>10:14</var> AEDT</small><br><strong>Scheduled</strong> - Remote Support and RODIN Control will be undergoing Maintenace during this time and will be unavailable.</p>tag:status.rodin.com.au,2005:Incident/199792632024-02-14T10:22:02+11:002024-02-14T10:22:02+11:00RODIN VOICE Connectivity Issues<p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>10:22</var> AEDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>09:58</var> AEDT</small><br><strong>Monitoring</strong> - A reboot of a core cloud infrastructure component has resolved the issue and we are seeing the phone systems online again. We are monitoring for any further issues</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>09:50</var> AEDT</small><br><strong>Investigating</strong> - We are seeing reports of multiple RODIN VOICE systems being offline. We are investigating with the provider as a priority. Updates to follow</p>tag:status.rodin.com.au,2005:Incident/197998602024-01-23T11:38:52+11:002024-01-23T11:38:52+11:00RODIN Managed WAN issues<p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>11:38</var> AEDT</small><br><strong>Resolved</strong> - The upstream provider has advised the issue has been resolved, and our monitoring has not shown any issues since 10:50am<br />All services are showing back online and operational</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>10:54</var> AEDT</small><br><strong>Monitoring</strong> - Links have returned and are currently stable. RODIN are still actively investigating with the provider. Updates to follow</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>10:41</var> AEDT</small><br><strong>Identified</strong> - Our monitoring has detected a brief series of drops in the RODIN Managed WAN - this has affected cloud servers, PBX and internet services starting around 10:27am today<br />We are investigating with the provider as a priority</p>tag:status.rodin.com.au,2005:Incident/197575462024-01-19T08:40:09+11:002024-01-19T08:40:09+11:00RODIN VOICE - Xelion Call Issues<p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>08:40</var> AEDT</small><br><strong>Resolved</strong> - Issue has been resolved - calls have been tested OK. RODIN will provide a status report when it becomes available</p><p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>08:20</var> AEDT</small><br><strong>Investigating</strong> - We have identified an issue this morning with RODIN Voice customers using Xelion phone systems - some customers may be impacted by what appears to be an upstream provider incident. Engineers are actively investigating and working on a resolution.</p>tag:status.rodin.com.au,2005:Incident/197431742024-01-18T08:39:40+11:002024-01-18T08:39:40+11:00RODIN VOICE - Xelion call issues<p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>08:39</var> AEDT</small><br><strong>Resolved</strong> - Issue has been resolved - a core system service appeared to have hung. This has been restarted and calls have been tested. RODIN will provide a status report when it becomes available</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>08:02</var> AEDT</small><br><strong>Investigating</strong> - We have identified an issue this morning with RODIN Voice customers using Xelion phone systems - some customers may be impacted by what appears to be an upstream provider incident. Engineers are actively investigating and working on a resolution.</p>tag:status.rodin.com.au,2005:Incident/194428072023-12-15T17:02:09+11:002023-12-15T17:02:09+11:00RODIN 1300 Number Maintenance<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>17:02</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>16:00</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>08:49</var> AEDT</small><br><strong>Scheduled</strong> - This afternoon Friday 15th December, inbound RODIN 1300 numbers (1300 138 761 and 1300 138 762) will be unavailable for a brief period from 4pm as they are ported to a new service<br /> <br />During this time, the RODIN Helpdesk can still be contacted on 02 4222 7001, and RODIN Sales/Admin on 02 4222 7000<br /> <br />We will update the RODIN status page once the process is complete</p>tag:status.rodin.com.au,2005:Incident/194324962023-12-14T23:00:25+11:002023-12-14T23:00:25+11:00Scheduled Maintenance Window - RODIN VOICE - Hosted 3CX<p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>23:00</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>22:00</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>10:08</var> AEDT</small><br><strong>Scheduled</strong> - Please be advised RODIN will be performing scheduled maintenance on all RODIN VOICE – 3CX platforms tonight. All RODIN VOICE – 3CX services will be temporarily unavailable during the scheduled window tonight from 10:00PM AEDT Thursday 14th December for approximately 1hr.<br />If you have any questions or issues, please reach out to us at support@rodin.com.au or phone on 1300 138 762.</p>tag:status.rodin.com.au,2005:Incident/191340152023-11-17T07:51:52+11:002023-11-17T07:51:52+11:00Users may be unable to access Microsoft Power App<p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>07:51</var> AEDT</small><br><strong>Resolved</strong> - Final status and update from Microsoft: After an extended period of monitoring, we've confirmed that impact has been resolved and that the service has fully recovered. Additionally, we've determined the isolated issue within a small section of the European infrastructure is also resolved.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>22:10</var> AEDT</small><br><strong>Update</strong> - Latest update from Microsoft: 16 November 2023 at 10:00 pm AEDT<br />More info: Additionally, some users may also be experiencing the following issues:<br /><br />- Runtime failures when playing apps and creating connections<br />- Integration with SharePoint Online would not function as expected<br /><br />Current status: We're continuing to monitor an increase in service availability as the rollback progresses further. In parallel, we're expediting the rollback process to deliver a quicker resolution for the remaining affected infrastructure.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>17:26</var> AEDT</small><br><strong>Update</strong> - Current status: Microsoft have identified a recent API update, intended to address a separate issue, that may be causing the impact. They are reverting the API update while monitoring service health and continuing to investigate possible causes.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>16:50</var> AEDT</small><br><strong>Update</strong> - More info: Users may see the following error messages when attempting to load Power Apps:<br />- There was no response from the server.<br />- The data did not load correctly. Please try again.<br /><br />Current status: We've identified that infrastructure responsible for Power App functionality isn't processing traffic as efficiently as expected. We're reviewing potential options for this unexpected performance, including recently deployed updates.<br /><br />Scope of impact: Our investigation currently indicates that users located in Australia and Japan are most impacted.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>16:34</var> AEDT</small><br><strong>Identified</strong> - User impact: Users may be unable to access Microsoft Power Apps.<br />Current status: We're investigating a potential issue and checking for impact.<br />Further updates from Microsoft will be posted below as they are provided.</p>tag:status.rodin.com.au,2005:Incident/190500902023-11-09T06:58:54+11:002023-11-09T06:58:54+11:00Optus Network (LTE Services) - Unplanned Service Disruption<p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>06:58</var> AEDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>08:19</var> AEDT</small><br><strong>Identified</strong> - Optus has reported a nationwide outage impacting mobile voice and mobile broadband services for all Optus brands and resellers including providers used by RODIN .<br /><br />This outage will specifically impact LTE services.<br /><br />Optus engineers have identified the suspected root cause of the impact on nationwide mobility network traffic and on-site technical staff are currently working on resolution<br /><br />Optus Status page can be viewed here: https://www.optus.com.au/living-network/service-status</p>tag:status.rodin.com.au,2005:Incident/189721862023-10-31T09:21:41+11:002023-10-31T09:21:41+11:00RODIN VOICE - Offline<p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>09:21</var> AEDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>08:34</var> AEDT</small><br><strong>Update</strong> - RODIN have confirmed all servers that were affected are back online and operational<br /><br />We will continue to monitor this morning, however all systems are working again</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>08:16</var> AEDT</small><br><strong>Monitoring</strong> - Core issue has been identified and addressed and servers are showing online again:<br /><br />The issue has been identified as a SAN issue. We have forced a controller failover and workloads are now resuming<br /><br />RODIN will continue to confirm all servers online and are monitoring</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>08:01</var> AEDT</small><br><strong>Update</strong> - We have confirmed an outage with the upstream provider - we are currently experiencing an unscheduled incident that is impacting some NSW based IaaS/DaaS workloads and we are currently investigating both the impact and root cause.<br /><br />Updated to follow</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>07:48</var> AEDT</small><br><strong>Investigating</strong> - We have identified an issue with RODIN VOICE servers reporting as offline as of 7:30am AM. We are in contact with the provider currently. Updates to follow</p>tag:status.rodin.com.au,2005:Incident/187730102023-10-13T17:02:52+11:002023-10-13T17:02:52+11:00Internet Outage<p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>17:02</var> AEDT</small><br><strong>Resolved</strong> - Upstream provider has completed works to mediate the outage and all services are now back online. If you experience any further issues, please contact the RODIN Helpdesk on 1300 138 762.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>14:58</var> AEDT</small><br><strong>Monitoring</strong> - The upstream provider has successfully implemented a workaround to bypass the faulty equipment. As a result, services are beginning to return online. Our team is continuing to monitor services and links to ensure services are functioning correctly.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>13:43</var> AEDT</small><br><strong>Identified</strong> - Upstream provider believe they have found the cause of the issue and engineers are working to resolve the issue as quickly as possible. Further updates will be provided as they become available.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>13:15</var> AEDT</small><br><strong>Update</strong> - Upstream provider updates.<br />https://status.hostednetwork.com.au/incident/395031</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>13:15</var> AEDT</small><br><strong>Investigating</strong> - There is currently an internet outage with an upstream provider.<br />Engineers are working to identify and resolve these issues as quickly as possible.<br />Further updates will be provided shortly.</p>tag:status.rodin.com.au,2005:Incident/185607602023-10-07T21:30:40+11:002023-10-07T21:30:40+11:00Scheduled Maintenance - RODIN Documentation Platform & MyGlue<p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>21:30</var> AEDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>20:01</var> AEDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>21</var>, <var data-var='time'>09:43</var> AEST</small><br><strong>Scheduled</strong> - RODIN's password manager (MyGlue) and documentation system (ITGlue) systems will be unavailable during this time.</p>tag:status.rodin.com.au,2005:Incident/185394002023-09-22T20:01:11+10:002023-09-22T20:01:11+10:00Scheduled Maintenance - Remote Support and RODIN Control<p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>20:01</var> AEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>18:00</var> AEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>19</var>, <var data-var='time'>07:36</var> AEST</small><br><strong>Scheduled</strong> - Due to scheduled system maintenance the RODIN Control (Remote Support/Access), Automate (RMM) and Manage (Ticket) platforms will be unavailable for a period of up to 2 hours between the hours of 6.00pm and 8.00pm Friday 22nd September 2023 AEDT. RODIN Control includes the remote access tool provided by RODIN for remote workstation access to office computers. This service will be unavailable during this time. We apologies for an inconvenience caused.</p>tag:status.rodin.com.au,2005:Incident/182388312023-08-26T09:58:00+10:002023-08-26T09:58:00+10:00Scheduled Maintenance - Remote Support and RODIN Control<p><small>Aug <var data-var='date'>26</var>, <var data-var='time'>09:58</var> AEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>26</var>, <var data-var='time'>07:00</var> AEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>09:25</var> AEST</small><br><strong>Scheduled</strong> - Due to scheduled system maintenance the RODIN Control and Support platform will be unavailable for a period of up to 2 hours between the hours of 7.00am and 12.00pm Saturday 26/08/2023 AEDT. RODIN Control includes the remote access tool provided by RODIN for remote workstation access to office computers. This service will be unavailable during this time. We apologies for an inconvenience caused.</p>tag:status.rodin.com.au,2005:Incident/182388182023-08-24T22:00:22+10:002023-08-24T22:00:22+10:00Scheduled Maintenance - Remote Support and RODIN Control<p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>22:00</var> AEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>21:01</var> AEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>09:23</var> AEST</small><br><strong>Scheduled</strong> - Due to scheduled system maintenance the RODIN Control and Support platform will be unavailable for a period of up to 30 minutes hours between the hours of 9.00pmm and 10.00pm Thursday 24/08/2023 AEDT. RODIN Control includes the remote access tool provided by RODIN for remote workstation access to office computers. This service will be unavailable during this time. We apologies for an inconvenience caused.</p>tag:status.rodin.com.au,2005:Incident/181667652023-08-19T12:01:30+10:002023-08-19T12:01:30+10:00Scheduled Maintenance - Remote Support and RODIN Control<p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>12:01</var> AEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>07:00</var> AEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>17</var>, <var data-var='time'>07:31</var> AEST</small><br><strong>Scheduled</strong> - Due to scheduled system maintenance the RODIN Control and Support platform will be unavailable for a period of up to 2 hours between the hours of 7.00am and 12.00pm Saturday 19/08/2023 AEDT. RODIN Control includes the remote access tool provided by RODIN for remote workstation access to office computers. This service will be unavailable during this time. We apologies for an inconvenience caused.</p>tag:status.rodin.com.au,2005:Incident/178021292023-07-10T17:06:34+10:002023-07-10T17:06:34+10:00RODIN Cloud (Hosted servers)<p><small>Jul <var data-var='date'>10</var>, <var data-var='time'>17:06</var> AEST</small><br><strong>Resolved</strong> - We have been advised from the upstream provider all affected services are back to full operation.<br /><br />We anticipate no further complications stemming from this incident. However, if you should encounter any persisting issues, we encourage you to contact our support team at support@rodin.com.au</p><p><small>Jul <var data-var='date'> 9</var>, <var data-var='time'>12:01</var> AEST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results. <br />We encourage any customers that are still experiencing any difficulties to reach out to RODIN via our After-Hours service.</p><p><small>Jul <var data-var='date'> 9</var>, <var data-var='time'>09:58</var> AEST</small><br><strong>Identified</strong> - There is currently an issue affecting some RODIN Cloud Hosted Servers and Virtual Machines. <br />This incident also has the potential to affect some customers internet and network connectivity (if the customer has a cloud hosted firewall). <br />RODIN are actively working towards resolution with an upstream provider. <br />The issue has been identified and a fix is being implemented.</p>tag:status.rodin.com.au,2005:Incident/167019852023-05-04T18:58:28+10:002023-05-04T18:58:28+10:003CX Desktop App Security Alert<p><small>May <var data-var='date'> 4</var>, <var data-var='time'>18:58</var> AEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>18:56</var> AEST</small><br><strong>Update</strong> - 3CX have confirmed that the compromised Desktop App has since been completely checked and cleaned and can be considered secure. <br /><br />https://www.3cx.com/blog/news/security-plans/<br />https://www.3cx.com/blog/news/pwa-desktop-native/<br /><br />RODIN can now confirm the app is safe to reinstall and use.<br /><br />RODIN has arranged for the removal of the compromised app from all affected machines and removed the blocks in place from reinstalling/running the 3CX Desktop App. <br />RODIN has also confirmed that all managed phone systems and app are up to date and reade for reinstall.<br />Instructions are here to reinstall the 3CX Desktop App: https://rodin.com.au/kb/how-to-install-the-new-3cx-windows-desktop-app/<br /><br />If you do not know your login you can find it in the 3CX Welcome Email sent to you when your extension was setup.<br />If you need a copy of your welcome email or need any assistance reinstalling the 3CX Desktop App please email support@rodin.com.au<br /><br />Rodin would like to take this opportunity to thank all users for their patience and understanding during this time.</p><p><small>Apr <var data-var='date'>27</var>, <var data-var='time'>20:24</var> AEST</small><br><strong>Update</strong> - 3CX have confirmed that the compromised Desktop App has since been completely checked and cleaned and can be considered secure. <br /><br />https://www.3cx.com/blog/news/security-plans/<br />https://www.3cx.com/blog/news/pwa-desktop-native/<br /><br />RODIN is in the process of rolling out the updates and will confirm when the app is safe to reinstall and use.<br /><br />Further updates to follow.</p><p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>12:27</var> AEDT</small><br><strong>Update</strong> - We continue to monitor updates from 3CX and Security support vendors and have made the decision to block the 3CX Desktop App from all workstations.<br />User will need to move to the Web Client as previously advised, this can be accessed from the 3CX welcome email. <br />If you require assistance moving to the Web Client, please contact the RODIN Helpdesk.<br /><br />We are currently rolling out the latest version to devices however the advice is to not use the 3CX desktop app on Windows or MAC until it's confirmed safe.<br /><br />Instructions for the 3CX Web Client: https://www.3cx.com/user-manual/web-client/<br />Instructions for the 3CX PWA Client: https://www.3cx.com/blog/releases/web-client-pwa/<br /><br />RODIN sincerely apologises for any inconvenience caused.</p><p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>09:02</var> AEDT</small><br><strong>Identified</strong> - We have been made aware of the following Security alert for the 3CX desktop application utilised in our RODIN Voice system.<br />RODIN are working closely with 3CX support guidance and security vendors and will be proceeding with upgrading the 3CX desktop application to all managed customers and sites utilising the RODIN VOICE platform.<br />Further details and information can be found here.<br /><br />https://news.sophos.com/en-us/2023/03/30/3cx-desktop-attack-sophos-customer-information/<br /><br />https://www.3cx.com/blog/news/desktopapp-security-alert/<br /><br />During these works access to the 3CX desktop app will be limited and we recommend using the 3CX Web App. A link to the Web App can be found in the 3CX Extension welcome email.<br />Please contact the RODIN helpdesk if you require any assistance with this access. We are currently rolling out the latest version to devices.<br /><br />Further updates to follow</p>tag:status.rodin.com.au,2005:Incident/164630982023-03-13T11:53:17+11:002023-03-14T08:40:50+11:00RODIN Voice outage<p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>11:53</var> AEDT</small><br><strong>Resolved</strong> - The provider has confirmed the outage has been resolved and we have tested with several customers to confirm calls are now working correctly<br /><br />If you are still experiencing any issues with outbound calls please reach out to the RODIN Helpdesk for further investigation</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>11:02</var> AEDT</small><br><strong>Update</strong> - Update:<br />The provider has confirmed a major incident is underway at their data centre<br />Power had been lost on-site including protected circuits.<br />Engineers are continuing to work through the restoration of all services at this time.<br />An investigation of the cause is underway, further updates will follow</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>09:48</var> AEDT</small><br><strong>Update</strong> - We have confirmed the provider is experiencing a network outage and are currently investigating<br />Updates to follow</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>09:21</var> AEDT</small><br><strong>Investigating</strong> - We are seeing outbound call failure with a handful of RODIN Voice customers this morning. We're investigating now with the provider - updates to come shortly</p>tag:status.rodin.com.au,2005:Incident/163174112023-03-02T09:05:46+11:002023-03-02T09:05:46+11:00Exchange Online Outage<p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>09:05</var> AEDT</small><br><strong>Resolved</strong> - Microsoft have updated advisory EX522020 confirming this issue is now resolved after re-routing traffic to alternate infrastructure</p><p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>06:43</var> AEDT</small><br><strong>Identified</strong> - Microsoft have reported issues for APAC customers accessing exchange online and some customers are receiving a "550 5.4.1 Recipient address rejected: Access denied" when sending emails.<br />Microsoft are investigating this and updates can be found here:<br />https://twitter.com/MSFT365Status/status/1630983423694077979?t=qK8GrhRunoa8jXfqkSVCag&s=19</p>tag:status.rodin.com.au,2005:Incident/160590692023-02-09T07:50:26+11:002023-02-09T07:50:26+11:00Teams users unable to send messages or update meetings<p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>07:50</var> AEDT</small><br><strong>Resolved</strong> - Microsoft have confirmed the issue is resolved: https://twitter.com/MSFT365Status/status/1623240696013651969?t=HsoB6o8iuifN6iyWbQEqLA&s=19</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>16:34</var> AEDT</small><br><strong>Monitoring</strong> - Current status: We've finished rerouting the affected service traffic to alternate infrastructure and our monitoring indicates that Microsoft Teams start up and sign-in have been recovered for users in the affected regions. We'll continue monitoring the service health and perform any additional steps necessary to fully resolve the issue for all users.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>12:22</var> AEDT</small><br><strong>Update</strong> - Microsoft have identified the root cause: A portion of infrastructure supporting users' ability to access and send messages in Microsoft Teams is operating below acceptable performance thresholds, resulting in impact.<br /><br />Next update by: Wednesday, February 8, 2023, 1:00 PM (2:00 AM UTC)</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>11:50</var> AEDT</small><br><strong>Identified</strong> - Microsoft have advised of an issue where Teams users may be unable to send messages or update meetings.<br />This is only affecting a handful of 365 tenants and Microsoft are working on the issue under Microsoft advisory TM512596.<br />Further updates to come as the issue progresses.</p>tag:status.rodin.com.au,2005:Incident/159306972023-01-26T15:58:04+11:002023-01-26T15:58:04+11:00Microsoft 365 Outage<p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>15:58</var> AEDT</small><br><strong>Resolved</strong> - Microsoft has upgraded their incident status to resolved.<br />If anyone continues to experience any issues accessing Microsoft 365 services please contact our helpdesk via email on support@rodin.com.au or by calling 1300138762.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>06:25</var> AEDT</small><br><strong>Monitoring</strong> - Microsoft has confirmed that the impacted services have recovered and remain stable. They are still investigating some potential impact to the Exchange Online Service.<br />Updates available direct from Microsoft here:<br />https://mobile.twitter.com/MSFT365Status</p><p><small>Jan <var data-var='date'>25</var>, <var data-var='time'>21:59</var> AEDT</small><br><strong>Identified</strong> - Currently there is a major Microsoft 365 outage.<br />Users may be unable to access multiple Microsoft<br />365 services.<br /> <br />More info: Impact is occurring to the following services<br />but is not limited to them: <br />-Microsoft Teams <br />-Exchange Online <br />-Outlook <br />-SharePoint Online <br />-OneDrive for Business <br />-Microsoft Graph <br />-Power BI <br />-Microsoft 365 admin portal <br />-Microsoft Intune <br />-Microsoft Defender for Cloud Apps, Identity and<br />Endpoint.<br /> <br />Current status: Microsoft has identified that a wide-area<br />networking (WAN) routing change caused impact to the service. They have rolled back the change and monitoring the service as it recovers. Some of the customers whohad previously reported impact are also reporting recovery.<br /> <br />Scope of impact: Any user serviced by the affected<br />infrastructure may be unable to access multiple Microsoft 365 services.<br /><br />Updates available direct from Microsoft here:<br />https://status.office365.com/<br />https://mobile.twitter.com/MSFT365Status</p>