Most Loved Workplace® Certified JobStaff Applied Scientist - Dashboards
Assessed by Most Loved Workplace®About the Role
At Datadog, a Most Loved Workplace® certified employer in the Technology space, Observe, Secure, and Optimize Modern Cloud Infrastructure at Scale.
<p>The Dashboards product is Datadog's unified single-pane-of-glass for metrics, logs, and traces—a comprehensive treasure trove of observability data. We are transforming Dashboards into an AI-native control surface and the central hub where every team moves seamlessly from question to insight to action – providing a guided experience that feels like having an expert SRE at your side and ensuring the entry point is never an empty canvas.</p>
<p><br>We're hiring a Staff Applied Scientist to define and guarantee the quality of this AI system at scale. "Good" isn't one number — it spans answer quality, tool-selection accuracy (critical given the growing catalog of data sources and visualizations), retrieval relevance, latency, token cost, and end-to-end agent success.</p>
<p><br>The space is full of open questions. How do you evaluate an agent end-to-end when the trajectory is non-deterministic? How do you score tool selection when a user’s query can result in the agent making decisions against dozens of visualizations and data sources – both of which are growing month over month? How do you build a measurement system that catches regressions across all widget types and data sources (e.g., enforcing correct grouping, sorting, and time overrides), and is easy to use and extend by dozens of teams? If those are the problems you want to spend your time on, come build this with us.<br><br><em data-renderer-mark="true">At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.</em></p>
<p><strong><br>What You’ll Do:</strong></p>
<ul>
<li>Own the evaluation strategy for Dashboards, as well as sister teams within our organization. Define the metri
Want to learn more about what it's like to work at Datadog? View our full profile.
Prefer to apply on the company's career site?
View Original Posting
Why This Is a Most Loved Workplace® Certified Job
What It's Like to Work Here
Frequently Asked Questions About Working at Datadog
Common questions candidates ask about this role and Datadog's workplace
Apply for Staff Applied Scientist - Dashboards
Submit your application directly to the Datadog team. Let them know why you'd be a great addition to their loved place to work.

