What are the responsibilities and job description for the Sr. Engineering Manager - AI Observability Platform position at Databricks?
RDQ326R257
Join Databricks: Pioneering the Future of Data and AI
At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems—from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks
About The Role
Enterprise customers demand high-quality GenAI Agents. Yet, without a robust platform to evaluate and monitor these agents in production, continuous improvement is impossible.The AI Quality Observability Platform team tackles this challenge by leveraging LLMs and custom models to evaluate responses for correctness, relevance, and custom-defined metrics. We apply advanced analytics techniques to deliver actionable insights that drive quality improvements. We help customers build, optimize, and monitor GenAI applications at scale. We've integrated our evaluation and monitoring capabilities into MLflow to streamline observability and model quality tracking. With our AI Agent Evaluation suite GA, MLflow3 launched, Agent Monitoring and Agent Bricks in Beta, we are ready to take this product to the next level—and we need a senior engineering leader to drive it.
The Impact You Will Have
As a federal government contractor, Databricks requires new U.S. employees to be fully vaccinated against COVID-19. Proof of vaccination will be required as a condition of employment. Databricks will make reasonable accommodations based on medical conditions or religious grounds for qualified candidates in accordance with applicable law.
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
Local Pay Range
$217,000—$288,400 USD
About Databricks
Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Join Databricks: Pioneering the Future of Data and AI
At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems—from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks
About The Role
Enterprise customers demand high-quality GenAI Agents. Yet, without a robust platform to evaluate and monitor these agents in production, continuous improvement is impossible.The AI Quality Observability Platform team tackles this challenge by leveraging LLMs and custom models to evaluate responses for correctness, relevance, and custom-defined metrics. We apply advanced analytics techniques to deliver actionable insights that drive quality improvements. We help customers build, optimize, and monitor GenAI applications at scale. We've integrated our evaluation and monitoring capabilities into MLflow to streamline observability and model quality tracking. With our AI Agent Evaluation suite GA, MLflow3 launched, Agent Monitoring and Agent Bricks in Beta, we are ready to take this product to the next level—and we need a senior engineering leader to drive it.
The Impact You Will Have
- Lead the product strategy and development for the GenAI Quality Observability.
- Drive the Agent Monitoring product from Beta to General Availability.
- Build a highly scalable AI Quality Observability platform that powers multiple products, including Agent Bricks, Lakehouse Monitoring, and beyond.
- Innovate and optimize to ensure the highest quality and performance.
- Collaborate with cross-functional teams to deliver scalable solutions.
- Engage with customers to understand their needs and enhance their experience.
- 5 years of experience working on AI
- Experience building highly-available cloud services
- Building, growing, and managing high performance teams
- Experience in defining and meeting SLOs for highly-available systems
- Ability to attract and hire engineers who meet the Databricks hiring standards
- Knowledge of database internals (highly Preferred)
- BS in Computer Science (Masters or PhD Preferred)
As a federal government contractor, Databricks requires new U.S. employees to be fully vaccinated against COVID-19. Proof of vaccination will be required as a condition of employment. Databricks will make reasonable accommodations based on medical conditions or religious grounds for qualified candidates in accordance with applicable law.
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
Local Pay Range
$217,000—$288,400 USD
About Databricks
Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Salary : $217,000 - $288,400
