Staff Applied Scientist - Dashboards

Overview Datadog is hiring a Staff Applied Scientist for its Dashboards product to lead evaluation and measurement for AI-native dashboard experiences. The role centers on defining metrics, building datasets and regression systems, and improving retrieval and tool selection quality. Responsibilities - Own the evaluation strategy for Dashboards and related sister teams - Define offline and online metrics for quality, cost, single-turn, and multi-turn performance - Build eval datasets, golden traces, and regression harnesses to catch quality changes before they reach customers - Make evaluation assets reusable across teams building dashboards and widgets through agents - Drive improvements to retrieval relevance, tool-selection accuracy, and context efficiency - Provide technical leadership through design reviews, working groups, and mentorship Requirements - BS/MS/PhD in a scientific field or equivalent experience - 10+ years of relevant engineering or applied science experience, including technical leadership - Track record of leading ML or GenAI initiatives in a product-driven environment from research through production - Significant experience with evaluation, experimentation, or measurement of ML systems at scale - Strong product mindset and comfort driving cross-functional initiatives - Ability to work effectively in ambiguity and make sound technical decisions Benefits - New hire stock equity (RSUs) and employee stock purchase plan (ESPP) - Continuous professional development, product training, and career pathing - Inclusive company culture and Community Guilds - Global benefits, including Spring Health benefits for eligible employees and dependents - Healthcare, dental, parental planning, mental health benefits, 401(k) match, paid time off, fitness reimbursements, and discounted employee stock purchase plan - Estimated yearly salary: $276,000 - $345,000 USD Source https://careers.datadoghq.com/detail/7984962?gh_jid=7984962