All services are online

Our servers encountered a problem that’s sadly familiar to us by now: data is entering the pipeline but not being processed. You’ll see missing signals for the last 6 hours or so, but we’re on it and expect to replay the missing data soon.

For the last 5 hours, our ingest servers didn’t work correctly. We probably lost some signals. We apologize deeply for this.

Our data servers are running a bit hot. We‘re investigating.

We’re updating our server installations. Over the next 2 hours, there might be occasional errors when requesting data from TelemetryDeck. However, ingestion will keep working as normal and your data is safe.

Our main Query Server will reboot for updates, resulting in queries not working for a minute or so.

Our deep storage server is going down for a bigger disk. The query servers should chug along without it just fine, but things might be a bit slower for a quarter hour or so.

Context: https://t.co/mxxPJm6VJa

We’re getting some timeouts on our API server every now and then, sorry for the inconvenience. Looking into it!

This is super smart and helpful for users too! You can see instantly which apps have 14 trackers and stuff installed, and which apps just use TelemetryDeck 😊 https://t.co/6qYNSijSIi

We’re updating parts of our infrastructure, expect some slowdowns over the next hour.