11 posts
Anthonin Bonnefoy At Datadog, we track the life cycle of millions of ephemeral hosts that report telemetry data to our platform. When a host stops emitting data, we eventually need to clean it up to avoid bloating our metadata store. To detect inactive hosts, the Datadog team th…
Christoph Hamsen Kylian Serrania Christophe Tafani-Dereeper Cloud Security Researcher and Advocate At Datadog, our commitment to open source means operating transparently and accepting that our repositories will be probed by adversaries. A few months ago, we shared our approach…
Sanketh Balakrishna Andrew Zhang At Datadog, we operate thousands of services that rely on consistent, low-latency data access. Moving data between diverse systems—quickly and reliably—is essential, but complex. Each application may have its own requirements for data freshness,…
Fabiana Scala Tali Gutman Like many other organizations, Datadog has long relied on the convenience of a large, shared relational database across multiple teams. This pattern is pervasive in the industry because it works well for many workloads—and continues to work well even at…
Anthonin Bonnefoy Mitch Ward Gillian McGarvey Here’s an error that no developer wants to see in their Postgres server logs: server process was terminated by signal 11: Segmentation fault. When our team was paged about one of our Postgres clusters crashing with this error, we wer…
Thomas Sobolik Technical Content Writer Ivo Dimitrov In this edition of the Datadog Engineering Spotlight, Tom from the Community team sat down with Ivo Dimitrov, one of our Engineering VPs. Tom and Ivo spoke about Ivo's career as an engineering manager for several top organizat…
Austin Lai Jean-Mathieu Saponaro In October at the Crunch Conference in Budapest, Jean-Mathieu Saponaro, Data & Analytics Senior Engineering Manager at Datadog, delivered a presentation about how he and his teams scaled self-serve analytics within Datadog up to the 5,000 employe…
Jason Satti Rishi Dhar Employees at companies of all types use dozens and even hundreds of types of commercial software to do their jobs and to develop their product. Many of these services have a monthly recurring cost per user model (Datadog does not follow a monthly recurring…
Laurent Bernaille David Lentz This story began when a routine update to one of our critical services caused a rise in errors. It looked like a simple issue—logs pointed to DNS and our metrics indicated that the impact to users was very low. But weeks later, our engineers were st…
Quentin Francois At Datadog, our data pipelines process trillions of data points every day to power core product features like long-term metrics queries. As data engineers, ensuring that data pipelines deliver good data in time at such a large scale is challenging. In this post,…
Stephen Lechner A large part of our job on the Datadog Solutions Team is to reproduce problems that customers run into while they try using our many integrations in their own, always-unique environments. If, for example, someone’s Ceph use_sudo configuration option doesn’t seem…