HomeTeam Inspection Service - Notice history

All systems operational

ISN - Operational

CloudInspect - Operational

Email - Operational

Website - Operational

Phone - Operational

Operational

EMSL Analytical - Operational

Notice history

Dec 2024

EMSL Outage
  • Resolved
    Resolved

    From Kim:

    EMSL Lab Connect, the online account portal, is accessible again!

    Shipping labels can be created for sending samples to the lab again!

  • Monitoring
    Monitoring

    Update from Kim at EMSL:

    Happy New year!


    EMSL Servers are back online which will allow for standard report formats to be sent. All reports published over the last few weeks will be the final report, not a preliminary report as I had thought. If there are any questions about reports received, please email me a copy of the report and I will be happy to help!

    Reporting is still slightly delayed as we continue to catch up on reports due to you. If you are missing results, please email me and let me know the lab you sent samples to, the project name, type of analysis needed, and when the lab would have received it and I will address the lab for you.

    Orders for supplies are able to be placed with Ground shipping again!

    EMSL Lab Connect, your online portal is still not accessible but we anticipate this being available again very soon. This includes shipping labels. I will let you know as soon as shipping labels are accessible again!

    We are looking forward to a great 2025. What goes down must come up and we will be better and stronger for you moving forward.


    We are very thankful for all of you and your continued partnership. I am looking forward to seeing everyone at Summit 2025, the second most wonderful time of year!

    Thanks!

  • Update
    Update

    From EMSL, 12/30/24 5:45 pm

    EMSL update:
    We are making great strides to return to business as usual. 75% of our labs are back online, sending reports and communications via email again.  (My emails should be available this week, as soon as tomorrow).  

    Preliminary reports are being provided for mold, lead, asbestos, ERMI (and more).
    Allergen results are available verbally and final results to follow via email.


    Radon is being analyzed and verbal results are available at request. Final reports will be sent out as soon as they are available.


    Water kits are being analyzed and reported.  EMSL Indy and Orlando are sending reports and we anticipate Charlotte water reporting this week too.


    Reporting will be based on the lab location and the lab’s specific capabilities at this time though but we anticipate another, better update end of week!

    Shipping labels cannot be created at this time, but we do anticipate having shipping labels available again in the near future.

    Orders for sampling supplies for overnight shipping are available.  We hope to have ground shipping available again soon for orders.  

    Thank you again for navigating this situation with us and continuing as our partner!


    Happy new year to all!

    We will likely have another update from them today.

  • Identified
    Identified

    From EMSL:

    EMSL update: EMSL is still currently offline. 

     

    Labs are able to provide verbal results for some analysis but this option is location dependent. We are still working on options to report yet. Please do not bombard the lab with calls but if you have a report due and need verbal results, call the lab directly and they can update you. The labs will be closed tomorrow afternoon for Christmas Eve and Christmas Day. Thank you for the patience as we navigate this technical event.  We will continue working diligently to resolve all matters.

  • Update
    Update

    From Kim at EMSL:

    EMSL is currently experiencing a technical event impacting our servers and all online presence. This started over the weekend and is impacting all business functions. We are working diligently to get systems back online.


    Here is the long and short of details at this time:


    Chain of custodies are available on www.laboratorytesting.com under forms.


    Shipping labels from the lab portal are not available at this time. If owners have older shipping labels they created but haven’t used, they can use those. We accept all shipments and you can ship to us however you would like.


    Labs are still accepting samples but reporting is back logged.  We are working on a preliminary report  for mold air and surface samples. Preliminary report will not be standard EMSL format at this time.


    Water testing- the labs are able to analyze bacteria and provide verbal results.  Lead, nitrate and nitrite require instrumentation connected to the server so this portion of analysis is still on hold.


    ERMI,  allergen, VOC/TO-15, and many other analyses require instrumentation for analysis and reporting and these are still currently offline also.


    EMSL teams are working quickly and making strides forward but we are still offline at this time.  (This includes emails)


    Please contact [Kim] via phone at this time.


    ----------

    Update: water testing in Indy is fully running again. Verbal reports only until we can get emails going again but they are running the full panel on FHA/VA water kits. ... this is only possible if you all ready have a shipping label for Indy lab.

    Kim’s number is (843) 628-3134.

  • Investigating
    Investigating

    EMSL has posted to their website (https://laboratorytesting.com):

    We are presently experiencing a technical event that is causing a disruption to several of our servers in Cinnaminson, NJ.

    All systems are down, and users are not able to log in. EMSL tells us that they will call anyone with outstanding lab results as soon as they have them.

Nov 2024

Users may be unable to access or use some Microsoft 365 services and features
  • Resolved
    Resolved

    Microsoft reports that this incident has been resolved, and steps have been taken to help ensure it does not happen again.

  • Identified
    Identified

    From Microsoft:

    Services are showing significant signs of restoration following our infrastructure optimizations to redistribute traffic and restart affected servers, upwards of 90 percent recovery as we continue to increase processing capability. We're continuing to perform appropriate optimizations on the subset of remaining affected machines to resolve the issue for all users.

  • Investigating
    Investigating

    Microsoft is experiencing worldwide outages across multiple platforms today, including email.

    From Microsoft:

    Users may be unable to access or use some Microsoft 365 services and features

    Issue ID: MO941162

    Affected services: Exchange Online, Microsoft 365 suite, Microsoft Power Automate in Microsoft 365, Microsoft Purview, Microsoft Teams, SharePoint Online

    Status: Service degradation

    Issue type: Incident

    Start time: Nov 24, 2024, 9:54 PM EST

    More info

    The impacted services and their impact are as follows:

    Exchange Online

    - Users may be unable to access using the following impacted connection methods: Outlook on the web, Outlook desktop client, Representational State Transfer (REST), Exchange ActiveSync (EAS)

    - Users may experience mail transport delays.

    Microsoft Teams

    - Users are unable to create or update Virtual Events, including webinars and Town Halls.

    - Users may be unable to access or modify their calendar in Microsoft Teams. This would include loading calendar, viewing meetings, creating/updating meetings and joining meetings.

    - Users are unable to create chat, add users and create or edited meetings.

    - Users are unable to create or modify new teams and channels.

    - Users may be unable to update presence.

    - Users may be unable to use the search function.

    - Users may not see updated list of files and links failing to load within the Chat shared tab.

    Microsoft Purview

    - Users may be unable to access the Purview Portal, or Purview Solutions.

    - Users may experience delays in policy stamping and with Adaptive Scope Evaluations.

    Microsoft Fabric

    - Users may be unable to export content or set and view labels within

    - Some Microsoft Fabric users with Purview Information Protection Policies with sensitivity labels enabled, may be unable to use interactive operations on Power BI Desktop format files and reports, including export operations on Fabric artifacts with Sensitivity labels applied.

    SharePoint Online

    - Users may be unable to use the search feature within

    Microsoft Defender for Office365

    - Users may be unable to create simulations, simulation payloads or end user notifications.

    - Users may experience issues with delivery for end user notifications and simulation messages

    - Some users may experience failures in manual or AIR approved Remediation Actions submitted through ThreatExplorer, Advanced Hunting or the Action Center.

    - Users may experiences issues with viewing simulation reports, and content.

    - Users may get a “You can’t access this section” error when accessing sections of the Defender XDR portal, such as the Incidents and Alerts pages, that include affected Defender for Office 365 shared components.

    Universal Print

    - Users may be unable to Print via Universal Print.

    - Users may be unable to list Printers/Printer Shares on the Azure Portal Universal Print blade.

    - Users may be unable to Register Printers via Universal Print.

    Power Automate for Desktop

    - Users may experience errors running flows that utilize cloud connectors.

    Microsoft Bookings

    - Users may be unable to access their bookings.

    Microsoft Copilot

    - Users are unable to use the personal Copilot panel in meetings and post meetings.

    - Users are unable to see historic Copilot conversation history in meetings and post meetings.

    Scope of impact

    Any user routed through affected infrastructure and attempting to use the functionalities outlined in the More info section of this communication may be affected by this event.

    Preliminary root cause

    A recent change has resulted in a portion of infrastructure not operating as expected.

    Current status

    Nov 25, 2024, 2:15 PM EST

    Our mitigative actions haven't provided relief as expected, and a portion of infrastructure remains in an unhealthy state. We determined that some of the targeted server restarts did not succeed due to processing issues, which are under investigation. We’re currently focused on spreading traffic to healthy infrastructure, and we're seeing some recovery.

    Next update by:

    Monday, November 25, 2024 at 4:00 PM EST

Oct 2024

No notices reported this month

Oct 2024 to Dec 2024

Next