Staff Software Engineer - ML Observability
The ML Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI workloads, including drift detection and model evaluation, and behavior tracing, e
What this role actually needs.
The ML Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI workloads, including drift detection and model evaluation, and behavior tracing, e Responsibilities: - Drive design and implementation of LLM observability features. - Ideate, prototype, and scale new product features to provide insights and drive improvements for generative AI systems - Work cross-functionally with other eng teams, product, UX, and applied science to iterate fast and find product-market fit - Develop and extend tools for tracing, evaluating, and debugging LLMs - Influence architecture decisions and mentor engineers to build resilient, high-performance systems - Stay close to customer pain points and use those insights to guide product and engineering priorities Requirements: - Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development. - Have a lot of influence on product direction and impact on the business . - Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn - Competitive global benefits - Continuous professional development Benefits: - Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development. - Have a lot of influence on product direction and impact on the business . - Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn - Competitive global benefits - Continuous professional development Company context: Datadog operates a cloud observability and security platform with meaningful hiring across infrastructure, security, AI, and developer tooling.
Day-to-day expectations
Datadog lists these responsibilities for the Staff Software Engineer - ML Observability role.
- Drive design and implementation of LLM observability features.
- Ideate, prototype, and scale new product features to provide insights and drive improvements for generative AI systems
- Work cross-functionally with other eng teams, product, UX, and applied science to iterate fast and find product-market fit
- Develop and extend tools for tracing, evaluating, and debugging LLMs
- Influence architecture decisions and mentor engineers to build resilient, high-performance systems
- Stay close to customer pain points and use those insights to guide product and engineering priorities
What a strong candidate brings
These requirements are extracted from the source listing and normalized for UpJobz readers.
- Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
- Have a lot of influence on product direction and impact on the business .
- Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
- Competitive global benefits
- Continuous professional development
Why people would want this job
Datadog published these compensation, benefits, or working-context details with the role.
- Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
- Have a lot of influence on product direction and impact on the business .
- Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
- Competitive global benefits
- Continuous professional development
Why this listing is more than a copied job post.
Staff Software Engineer - ML Observability is framed against UpJobz source checks, country scope, compensation visibility, and work-authorization signals so candidates can make a faster go/no-go decision.
United States tech market
United States roles on UpJobz are filtered for high-tech relevance, source freshness, and actionable employer detail before they are allowed into SEO surfaces.
Compensation read
The employer source does not expose a reliable salary range, so candidates should ask for compensation early instead of waiting until late-stage interviews.
Work authorization read
Current extracted signal: United States residents. UpJobz treats this as a search signal, not legal advice, and links visa-sensitive roles back to the relevant visa hub where possible.
Location read
On-site roles in Boston should be compared against commute, local salary bands, and nearby employer demand.
Browse similar jobs
Turn this listing into an application plan.
This is the first pass at the premium UpJobz layer: a fast brief that helps serious applicants move with more clarity.
Next moves
- Tailor your resume around ai and llm instead of sending a generic application.
- Use the first two bullets of your application to connect your background directly to staff software engineer - ml observability is a high-signal on-site role in boston, and it is most realistic for united states residents.
- Open the role quickly if it fits and bookmark three similar jobs before you leave the page.
Interview themes
Watchouts
- Compensation is hidden, so get range clarity in the first recruiter conversation.
- Use united states residents as part of your positioning so the recruiter does not have to infer it.
- Show concrete examples of succeeding in on-site environments.
Keywords to match against your background
Use these terms to decide whether your resume, portfolio, and recent projects line up with the role.
Apply through the employer source
Open the source listing from careers.datadoghq.com, confirm the role is still active, then apply on the employer or ATS page.
Source: careers.datadoghq.com Β· Source ID: 7107437 Β· Confidence: 93/100 Β· Last checked: May 7, 2026
How UpJobz verifies job sourcesContinue browsing tech jobs