Demo

Machine Learning Engineer (LLM)

DeepRec.ai
Boston, MA Full Time
POSTED ON 1/6/2026
AVAILABLE BEFORE 1/25/2026
Machine Learning Engineer (LLM)
$170,000 - $200,000 (DOE)
Boston OR Berkeley, 2-3 days per week in-office
 
We’re working a fast-growing AI company on a mission to automate complex workflows in the financial services sector, starting with insurance. Their technology leverages cutting-edge AI to simplify high-value processes, from multi-turn conversations to full workflow automation.
 
As an ML Engineer within LLMs, you’ll be building and scaling advanced AI systems that power intelligent, multi-agent workflows. You’ll take ownership of designing, fine-tuning, and productionizing large language models, integrating them with backend systems, and optimizing their performance. You’ll collaborate closely with data science, DevOps, and leadership to shape the AI infrastructure that drives the company’s automation solutions.
 
What You’ll Do:
  • Build, fine-tune, and productionize large language model (LLM) pipelines, including PEFT, RLHF, and DPO workflows.
  • Develop APIs, data pipelines, and orchestration systems for multi-agent, multi-turn AI conversations.
  • Integrate models with backend services, including voice orchestration platforms and transcript generation.
  • Optimize model usage and efficiency, transitioning from external APIs to in-house solutions.
  • Collaborate cross-functionally with data scientists, DevOps, and leadership to deliver scalable machine learning solutions.
 
What We’re Looking For:
Essential Skills & Experience:
  • Strong proficiency in Python and ML frameworks (e.g., scikit-learn, TensorFlow, PyTorch).
  • Hands-on experience fine-tuning and training LLMs.
  • PEFT, DPO, Prefence Optimization, post-training, supervised fine tuning, RLHF
  • Familiarity with AWS suite and deploying ML models to production.
  • Ability to reason deeply about ML principles, architectures, and design choices.
  • Knowledge of multi-agent orchestration and conversational AI systems.
Desirable Skills & Experience:
  • Background in voice AI, speech-to-text, or text-to-speech systems.
  • Exposure to financial services or insurance applications.
  • Familiarity with optimizing models for long-context scenarios.
 
If you’d like to hear more, please apply or get in touch!

Salary : $170,000 - $200,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Engineer (LLM)?

Sign up to receive alerts about other jobs on the Machine Learning Engineer (LLM) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$179,606 - $233,815
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at DeepRec.ai

  • DeepRec.ai Denver, CO
  • AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate about shaping how AI is deployed safely, reliably, and at scale? This is a rare opport... more
  • 6 Days Ago

  • DeepRec.ai Jersey, NJ
  • AI Research Scientist – Medical Imaging On-site | East Coast USA A well-funded medical AI company is hiring a PhD-level AI Research Scientist to build deep... more
  • Just Posted


Not the job you're looking for? Here are some other Machine Learning Engineer (LLM) jobs in the Boston, MA area that may be a better fit.

  • 7AI Boston, MA
  • We are seeking a Senior Machine Learning Engineer to join our core engine team. You will work on developing and enhancing our multi-agent AI technology, fo... more
  • 1 Month Ago

  • Motion Recruitment Partners, LLC Boston, MA
  • Job Details Job Overview We're hiring a full-time Machine Learning Engineer to join an AI technology company in the financial services space. The client bu... more
  • 12 Days Ago

AI Assistant is available now!

Feel free to start your new journey!