All Systems Operational

dataforest Network Operational
Edge Network (affects all locations) Operational
DDoS Protection (affects all locations) Operational
Dedicated Servers (EQX-FR4 & DRT-FRA8) Operational
Datacenter MC-FRA01 Operational
Datacenter Core Routing & Switching Operational
Ceph Cluster Operational
Virtual Servers Operational
Dedicated Servers Operational
Plesk Web Hosting Operational
TeamSpeak3 Servers Operational
Network Storage Operational
Facilites Operational
Datacenter FC-FRA4 Operational
Datacenter Core Routing & Switching Operational
Dedicated Servers Operational
Facilites Operational
General Services Operational
Avoro CP & Support Operational
PHP-Friends CRM & Support Operational
Hotline Operational
Dedicated Control Panel Operational
IPMI VPN Operational
DDoS Manager Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance

Scheduled Maintenance

DDoS Protection Software Update Sep 28, 2026 16:30-17:30 CEST

Start: 28.09.2026, 16:30 CEST
End: 28.09.2026, 17:30 CEST

We will carry out maintenance on our DDoS protection infrastructure.

What we are doing
We will deploy software updates to our redundant scrubbing cluster. Filter appliances will be taken out of production and updated one by one to ensure mitigation capacity is always sufficient. After each update, functionality will be verified before we move on to the next filter.

Expected impact
No customer impact is expected, but it cannot be ruled out entirely. Idle (inactive) connections/sessions may time out; active ones should not, as they are synchronized during the startup of a new software release. If you notice anything unusual, such as timeouts of active sessions or the inability to connect to your server, please contact our support.

Affected customers
All IP prefixes routed through our DDoS protection (which is the default).

Fallback plan
Should the update fail and cause issues, we will disconnect the respective filters within a few seconds.
Posted on Sep 25, 2026 - 20:01 CEST

[FC-FRA4] Power Infrastructure Upgrades Oct 12, 2026 08:00 - Oct 23, 2026 17:00 CEST

Start: 12.10.2026, 08:00 CEST
End: 23.10.2026, 17:00 CEST

Power infrastructure upgrades will be carried out at FC-FRA4 across two phases. The work is intended to improve redundancy and operational stability while providing additional capacity for future growth. No downtime is planned for connected systems.

From 12.10.2026 to 16.10.2026, the power feeds of distribution systems A and B will be modified to improve selectivity and operational safety. The work will be performed sequentially, with only one power path being worked on at a time. During each respective phase, the affected power path will be supplied by the datacenter's diesel generator system, while UPS protection remains active throughout generator operation.

As this phase involves switching and work on the active power infrastructure, a small residual risk remains. In the (unlikely and unexpected) event of a disruption affecting the respective path, some rack feeds will become unavailable.

From 19.10.2026 to 23.10.2026, additional electrical supply lines will be installed, tested and commissioned to expand the site's power infrastructure and provide additional capacity.

We will provide an update should any unexpected impact occur.
Posted on Sep 19, 2026 - 16:15 CEST

Sep 25, 2026

DDoS Protection Software Update
Completed - The scheduled maintenance has been completed.
Sep 25, 17:24 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 25, 17:00 CEST
Scheduled - Start: 25.09.2026, 17:00 CEST
End: 25.09.2026, 18:00 CEST

We will carry out maintenance on our DDoS protection infrastructure.

What we are doing
We will deploy software updates to our redundant scrubbing cluster. Filter appliances will be taken out of production and updated one by one to ensure mitigation capacity is always sufficient. After each update, functionality will be verified before we move on to the next filter.

Expected impact
No customer impact is expected, but it cannot be ruled out entirely. Idle (inactive) connections/sessions may time out; active ones should not, as they are synchronized during the startup of a new software release. If you notice anything unusual, such as timeouts of active sessions or the inability to connect to your server, please contact our support.

Affected customers
All IP prefixes routed through our DDoS protection (which is the default).

Fallback plan
Should the update fail and cause issues, we will disconnect the respective filters within a few seconds.
Sep 24, 21:04 CEST
[DRT-FRA8] Edge Router Replacement & Core Switch Updates
Completed - We were able to recover cs1 at 03:26 and successfully completed the maintenance, including the pending cs2 reboot (03:29 - 03:41), followed by the necessary follow-up work till 06:00. A few minor tasks remain and will be completed tomorrow without customer impact, after which we will publish the announced maintenance summary.
Sep 25, 06:15 CEST
Update - DRT-FRA8 connectivity was cut at 01:11 as planned. One of the site's core switches (cs1) failed during the required firmware update and no longer provides serial console output. Customers connected to cs2 were restored at 01:58 via the new router.

Customers connected only to cs1 remain offline while we recover the switch or move their connections to cs2. To avoid risking the remaining operational core switch, we have deliberately postponed the cs2 reboot. Its update will follow only after cs1 has been recovered, so restored services may be interrupted once more.

Our priority is restoring directly connected DRT-FRA8 customers. Reintegrating the PoP into our network is secondary, as all other locations remain unaffected.

The maintenance window has been extended by 3 hours for now.
Sep 25, 02:11 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 24, 23:00 CEST
Scheduled - Start: 24.09.2026, 23:00 CEST
End: 25.09.2026, 03:00 CEST

We will upgrade our DRT-FRA8 PoP by replacing the site's Juniper MX edge router with a new device. This will significantly increase our backbone and DDoS protection capacity at this PoP. Only customers connected locally at DRT-FRA8 are expected to experience downtime.

Who is affected:
Directly affected (downtime): All BGP, GRE, IP Transit, and dedicated server customers connected locally at DRT-FRA8 (identifiable by the server's hostname).
Indirectly affected (no downtime): All other customers. Temporary reroutings of some peering connections may result in slightly increased latency. Traffic and DDoS protection will be handled by our secondary PoP EQX-FR4. Our available backbone capacity will be reduced by roughly half but remains sufficient for the expected traffic levels. As usual, a residual risk remains when working on critical backbone infrastructure.

Fallback Plan:
In the highly unlikely event of a critical failure at our secondary PoP before the new router is fully operational, we will immediately abort the migration and restore service via the existing router within 30 minutes. The same applies to any production issues with the new router.

Maintenance schedule & impact for DRT-FRA8:
• Up to 30 minutes: We will disconnect the PoP from the dataforest network and validate correct rerouting behaviour. Local customers will remain online but without connectivity to other dataforest locations. To avoid blackholing, drain your services at this PoP at the start of the maintenance window if possible.
• Up to 60 minutes: Full disruption for all local connections and servers at DRT-FRA8. In parallel, we will perform necessary software updates on the site's core switches to avoid a separate maintenance window. Depending on your connectivity, service may be restored and interrupted multiple times during this timeframe.
• Up to 30 minutes: We will integrate the PoP back into the dataforest network. Once complete, connectivity will be fully restored and traffic can be routed back to this PoP.

The durations are estimates for each step and do not represent fixed start or end times within the maintenance window.

Customer action suggested (DRT-FRA8 only):
• BGP, GRE & IP Transit Customers: Please actively reroute traffic away from your DRT-FRA8 sessions for the entire maintenance window to avoid disruptions or traffic blackholing.
• High-Availability Workloads: We strongly recommend temporarily draining affected nodes from your global load balancing prior to the maintenance.

During the maintenance, our team will focus on the work itself rather than providing live status updates. We will report the actual duration of each step and any issues encountered once the maintenance is complete.
Sep 21, 00:28 CEST
Network Storage Infrastructure
Completed - We finished the maintenance well ahead of schedule.
Sep 25, 06:10 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 24, 11:00 CEST
Scheduled - Start: 24.09.2026, 11:00 CEST
End: 25.09.2026, 09:00 CEST

We will carry out maintenance on our network storage infrastructure to permanently resolve an issue with the underlying RAID system.

The network storage is primarily used as external backup storage for managed servers and web hosting platforms. During the maintenance window, existing backups will be temporarily inaccessible, and no new backups can be created.

Additionally, booting from ISO images will be unavailable for Avoro VMs. We strongly recommend fully unmounting any ISOs before the maintenance begins to prevent the VM from becoming unmanageable via the customer portal.

Some customers also use the network storage for active workloads. You can check whether you are affected by looking for active mounts beginning with nfs-xxxxx.php-friends.de on your server.
Sep 21, 00:50 CEST
Temporary Packet Loss at EQX-FR4 PoP
Resolved - We have validated our findings, and the situation has remained fully stable. We will publish the postmortem shortly.
Sep 25, 05:52 CEST
Monitoring - An issue at our EQX-FR4 PoP caused brief packet loss between 20:17:30 and 20:22:30 CEST. Traffic handled through our DRT-FRA8 PoP continued to operate normally throughout the incident, meaning a large part of our overall traffic was not affected.

Across our network, total traffic dropped by around 40% for approximately one minute at the beginning of the incident. During recovery, we observed another much shorter drop of around 40% between 20:20:26 and 20:20:38. Within the following two minutes, traffic returned to normal levels.

The issue was alerted internally at 20:22, followed by an incident call shortly after. During the investigation, we identified a likely root cause and implemented a first fix. The situation has remained stable since then.

We will follow up within the next two days with a detailed postmortem, including the root cause and further corrective actions.
Sep 24, 00:30 CEST
Investigating - Between 20:18 and 20:23, we observed two brief periods of packet loss at one of our two PoPs, which affected some connections. Everything has been stable since then, and we're investigating the cause.
Sep 23, 20:36 CEST

Sep 24, 2026

DDoS Protection Software Update
Completed - The scheduled maintenance has been completed.
Sep 24, 16:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 24, 15:00 CEST
Scheduled - Start: 24.09.2026, 15:00 CEST
End: 24.09.2026, 16:00 CEST

We will carry out maintenance on our DDoS protection infrastructure.

What we are doing
We will deploy software updates to our redundant scrubbing cluster. Filter appliances will be taken out of production and updated one by one to ensure mitigation capacity is always sufficient. After each update, functionality will be verified before we move on to the next filter.

Expected impact
No customer impact is expected, but it cannot be ruled out entirely. Idle (inactive) connections/sessions may time out; active ones should not, as they are synchronized during the startup of a new software release. If you notice anything unusual, such as timeouts of active sessions or the inability to connect to your server, please contact our support.

Affected customers
All IP prefixes routed through our DDoS protection (which is the default).

Fallback plan
Should the update fail and cause issues, we will disconnect the respective filters within a few seconds.
Sep 23, 15:31 CEST
vnode16 (PHP-Friends) Migration
Completed - The scheduled maintenance has been completed.
Sep 24, 01:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 23, 21:00 CEST
Scheduled - We need to carry out maintenance on the host system vnode16 which is containing PHP-Friends G1/G2 VMs. The VMs will be migrated to other (identical or better) host systems which involves a short downtime (depending on the disk size of the VM, about 20 minutes per 50 GB). Customers may check in our control panel (SolusVM) if they have any VMs running on vnode16.

To minimize the impact for affected customers, we migrate one VM after another and we will do it over night only (21:00 CEST - 01:00 CEST).

Please make always sure that your VM is configured to be "reboot resistant", so that all software you need starts at boot time and is stopped cleanly when the host system sends an ACPI shutdown signal.
Sep 20, 15:55 CEST

Sep 23, 2026

DDoS Protection Software Update
Completed - The scheduled maintenance has been completed.
Sep 23, 15:30 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 23, 15:00 CEST
Scheduled - Start: 23.09.2026, 15:00 CEST
End: 23.09.2026, 16:00 CEST

We will carry out maintenance on our DDoS protection infrastructure.

What we are doing
We will deploy software updates to our redundant scrubbing cluster. Filter appliances will be taken out of production and updated one by one to ensure mitigation capacity is always sufficient. After each update, functionality will be verified before we move on to the next filter.

Expected impact
No customer impact is expected, but it cannot be ruled out entirely. Idle (inactive) connections/sessions may time out; active ones should not, as they are synchronized during the startup of a new software release. If you notice anything unusual, such as timeouts of active sessions or the inability to connect to your server, please contact our support.

Affected customers
All IP prefixes routed through our DDoS protection (which is the default).

Fallback plan
Should the update fail and cause issues, we will disconnect the respective filters within a few seconds.
Sep 23, 13:21 CEST

Sep 22, 2026

DE-CIX Frankfurt Peering
Completed - The scheduled maintenance has been completed.
Sep 22, 06:00 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 21, 23:00 CEST
Scheduled - The internet exchange DE-CIX has announced maintenance on its Frankfurt peering platform.

When our own port is affected by such maintenance, we gracefully reroute the affected traffic in advance. Our port is not affected by this maintenance, so no action is required from our side.

Please note: DE-CIX Frankfurt is one of the world's largest internet exchanges. Other networks affected by the maintenance may not reroute their traffic in advance, potentially causing connectivity issues on paths to or from dataforest even though our own network remains fully operational.

We have seen this during previous DE-CIX maintenance windows and publish this notice as a precaution. Such issues occur outside our control and cannot be prevented or resolved by us.
Sep 8, 18:16 CEST

Sep 21, 2026

Sep 20, 2026

vnode16 (PHP-Friends) Migration
Completed - We were unable to migrate all vnode16 VMs during tonight's maintenance window. We are stopping now as scheduled. A follow-up maintenance window for the remaining VMs will be announced shortly and is planned for next week.
Sep 20, 01:02 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 19, 22:00 CEST
Scheduled - We need to carry out maintenance on the host system vnode16 which is containing PHP-Friends G1/G2 VMs. The VMs will be migrated to other (identical or better) host systems which involves a short downtime (depending on the disk size of the VM, about 5 minutes per 50 GB). Customers may check in our control panel (SolusVM) if they have any VMs running on vnode16.

To minimize the impact for affected customers, we migrate one VM after another and we will do it over night only (22:00 CEST - 01:00 CEST).

Please make always sure that your VM is configured to be "reboot resistant", so that all software you need starts at boot time and is stopped cleanly when the host system sends an ACPI shutdown signal.
Sep 6, 20:54 CEST

Sep 19, 2026

Sep 18, 2026

No incidents reported.

Sep 17, 2026

Network Storage
Completed - The maintenance has been postponed.
Sep 17, 12:55 CEST
Scheduled - We have to carry out maintenance work on our network storage infrastructure to resolve a critical issue with the underlying RAID system.

This product is primarily intended and used as external backup storage for managed servers and web hosting platforms. During the maintenance window, existing backups will be temporarily inaccessible, and no new backups can be created.

Some customers utilize the network storage for other active workloads. You can verify if you are affected by checking your server for any active mounts beginning with nfs-xxxxx.php-friends.de.
Sep 16, 22:26 CEST

Sep 16, 2026

DDoS Protection Software Update
Completed - The scheduled maintenance has been completed.
Sep 16, 16:30 CEST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 16, 16:00 CEST
Scheduled - We will carry out maintenance on our DDoS protection infrastructure.

What we are doing
We will deploy software updates to our redundant scrubbing cluster. Filter appliances will be taken out of production and updated one by one to ensure mitigation capacity is always sufficient. After each update, functionality will be verified before we move on to the next filter.

Expected impact
No customer impact is expected, but it cannot be ruled out entirely. Idle (inactive) connections/sessions may time out; active ones should not, as they are synchronized during the startup of a new software release. If you notice anything unusual, such as timeouts of active sessions or the inability to connect to your server, please contact our support.

Affected customers
All IP prefixes routed through our DDoS protection (which is the default).

Fallback plan
Should the update fail and cause issues, we will disconnect the respective filters within a few seconds.
Sep 14, 21:27 CEST

Sep 15, 2026

No incidents reported.

Sep 14, 2026

Partial Packet Loss in DDoS Protection Infrastructure
Resolved - At the previously specified times, an incorrect handling of dynamic attack pre-filtering during specific, very large DDoS attacks overwhelmed some of our filtering appliances, causing the issues described in this post.

A permanent fix was deployed at 21:00, which has since been successfully verified under real-world traffic conditions. We can confirm that no further issues occurred other than those detailed here.
Sep 14, 22:31 CEST
Update - The issue recurred at 20:39 for a few seconds, but with less impact as only one of our POPs was affected. We are still working on a permanent solution; our temporary fix has already reduced the impact.
Sep 14, 20:50 CEST
Update - We have updated the initial version of this post, as we originally assumed that only one of our POPs was affected. In fact, both were.
Sep 14, 17:05 CEST
Monitoring - At 16:25, 16:32, and 16:35, a particular DDoS attack overloaded the DDoS filters at both POPs, causing temporary packet loss. A temporary fix has been implemented, and we are working on a permanent solution. Unprotected traffic was unaffected.
Sep 14, 16:47 CEST

Sep 13, 2026

No incidents reported.

Sep 12, 2026

No incidents reported.

Sep 11, 2026

No incidents reported.

Incident History Powered by Atlassian Statuspage