Sr Machine Learning Engineer - Personalization (NY)

About The Opportunity

The Personalization team makes deciding what to play next easier and more enjoyable for every listener. We built them by understanding the world of music and podcasts better than anyone else. Join us and you’ll keep millions of users listening by making great recommendations to each and every one of them.

The Personalization team makes deciding what to listen to next feel effortless for hundreds of millions of users — from Discover Weekly to our newest AI-powered experiences. We’re now building conversational AI capabilities that let users interact in natural language. You’ll join a squad working at the core of this space, shaping how users discover and engage with audio through intelligent, responsive systems.

This role is based in New York. We offer you the flexibility to work where you work best! There will be some in person meetings, but it still allows for flexibility to work from home.

Responsibilities

• Design and ship production-grade machine learning systems powering conversational and agentic AI experiences
• Build systems that interpret user intent, manage context across multi-turn interactions, and handle ambiguity reliably at scale
• Develop and evolve agentic workflows including memory, context management, and multi-step tool orchestration
• Create evaluation frameworks, including LLM-as-judge pipelines, to measure quality and guide iteration
• Partner closely with product, engineering, and design to deliver seamless, user-facing experiences
• Balance experimentation with production rigor, ensuring performance, latency, and reliability at Spotify scale
• Continuously improve agent behavior through tight feedback loops between evaluation and real-world usage

Required Qualifications

• You have 5 years of experience building and shipping machine learning systems in production environments
• You are experienced with large language models and have worked on real-world applications beyond experimentation; shipped and maintained large scale systems with LLMs
• You have a deep understanding of challenges in conversational or agentic systems, such as context handling and multi-step reasoning
• You know how to evaluate ML systems rigorously and have experience designing metrics or evaluation pipelines
• You are comfortable debugging complex interactions between models, tools, and system constraints like latency
• You care about building reliable, scalable systems that deliver high-quality user experiences
• You enjoy working cross-functionally and contributing to a collaborative, inclusive team environment

Nice To Have Skills

Avenue Code discloses salary range information based on our commitment to fairness and transparency. We consider a wide range of factors such as internal equity, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, business or organizational needs, and others. At Avenue Code, it is not typical for an individual to be hired at or near the top of the range for their role, and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for a Senior Machine Learning Engineer is from $155 to $180 yearly.

Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code’s consultants are allocated to perform its services.