
Helping everyone know what time it is. @ntpool@mastodon.social
Joined February 2012
- Tweets89
- Following5
- Followers322
- Likes3
[status] Scheduled (Oct 18, 2026, 23:40 UTC): We're migrating the backend database to Postgres and a new API backend. The DNS and NTP service is unaffected, but the management portal and monitoring will be unavailable for a short whil… stspg.io/bsrv3kyq17gx?u=3xpk…
[status] In Progress: Scheduled maintenance is currently in progress. We will provide updates as necessary. stspg.io/bsrv3kyq17gx?u=p4vc…
[status] Verifying: This is done! Please report any trouble or errors you see.
I have one more maintenance to do to the database storing the monitoring scores. The graphs will not update for a few hours while I do this, but the actua… stspg.io/bsrv3kyq17gx?u=zfxr…
[status] Investigating: The newly reset database cluster (from last night) decided to blow itself up again. I think the extra query load and data from the new monitoring system is making the setup fragile.
Investigating. stspg.io/q6zwnw4h3hfb?u=sdms…
[status] Identified: The database croaked again! I'm restoring from a ~20 minute old backup. stspg.io/q6zwnw4h3hfb?u=6986…
[status] Monitoring: ok, we are stable again -- hopefully. stspg.io/q6zwnw4h3hfb?u=v793…
[status] Investigating: The database is having an outage (again!). Investigating. stspg.io/7kkszvyb911h?u=s1xj…
[status] Monitoring: A fix has been implemented and we are monitoring the results. stspg.io/7kkszvyb911h?u=3jtd…
[status] Resolved: Database cluster has been re-installed and stable for about an hour now. stspg.io/7kkszvyb911h?u=f388…
[status] Scheduled (Aug 3, 2025, 00:45 UTC): The system will be upgraded to support the new monitoring agent.
news.ntppool.org/2025/07/mon…
community.ntppool.org/t/prod… stspg.io/j72z814m3c8y?u=n29s…
[status] In Progress: Scheduled maintenance is currently in progress. We will provide updates as necessary. stspg.io/j72z814m3c8y?u=2kmz…
[status] Completed: The monitoring system was paused for about an hour, otherwise the upgrade was uneventful.
github.com/abh/ntppool/blob/… stspg.io/j72z814m3c8y?u=wpsb…
[status] Investigating: The upgraded database is having a hard time, again! stspg.io/1fm8szs2jghr?u=flqj…
[status] Monitoring: It's been recovered (since about an hour ago). More information at community.ntppool.org stspg.io/1fm8szs2jghr?u=dktn…
[status] Investigating: A couple days ago I upgraded the older MySQL cluster to a newer one. It worked fine and then ... DIdn't.
The DNS and NTP services continue to operate, but the management website and monitoring is having a comp… stspg.io/ytv8kmjqhb8g?u=1qtn…
[status] Resolved: This incident has been resolved. stspg.io/ytv8kmjqhb8g?u=4t1d…
We published a postmortem on our July 3rd incident: stspg.io/ytv8kmjqhb8g
[status] Identified: A fiber cut is affecting the management system kubernetes cluster. The NTP Pool DNS service is unaffected.
status.equinixmetal.com/inci… stspg.io/rd8mz7q3n2sg?u=jqvs…
[status] Identified: Fiber cut has been fixed and kubernetes cluster restored (over night). stspg.io/rd8mz7q3n2sg?u=ww72…
[status] Resolved: The system has been fully functional since the previous update; we've been monitoring since. stspg.io/rd8mz7q3n2sg?u=fh3l…