Demo

Senior Data Scientist - AI/ML Engineer

Altimate AI
Sunnyvale, CA Full Time
POSTED ON 10/29/2025
AVAILABLE BEFORE 11/28/2025
Who are we?

Mission

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

By leveraging a proprietary framework that combines multiple language models and a custom-built knowledge graph, we enable contextually aware AI agents that integrate seamlessly into existing workflows. Our solutions, including ambient AI for continuous monitoring and optimization, are designed to meet the growing demands of data operations, business intelligence, and analytics in an era of ever-increasing data volumes. Used by thousands of users across the world, and backed by prominent investors, we're positioned at the forefront of the AI-powered data engineering revolution. You can read more about us in a recently published venture beat article.

Team

As a team, we are Silicon Valley veterans who previously created category-defining data and AI products loved by thousands of companies worldwide. We have experienced the journey of a small startup to IPO very closely. We have started on a similar journey again and are backed by prominent advisors and VC firms with multi-billion dollar portfolios.

What are we looking for?

We're in search of a Senior Generative AI Engineer who brings deep expertise in building and deploying large language models and AI systems at scale. This role is for those with extensive experience in developing production-grade AI solutions, particularly in the realm of generative AI and language models. The ideal candidate will play a crucial role in advancing our AI capabilities, designing intelligent agent architectures, and implementing sophisticated RAG pipelines that power our products used by thousands of data teams worldwide.

Professional Experience:

  • 5 years of hands-on ML/AI experience with at least 1 year of hands-on experience in GenAI/LLM projects
  • Track record of successfully deploying ML/AI systems in production environments
  • Experience working with enterprise customers and understanding their unique requirements

Technical Skills Required:

  • Strong programming skills in Python, including expertise in ML stack (Hugging Face, NumPy, Pandas, scikit-learn)
  • Production experience with deep learning frameworks (PyTorch/Tensorflow) and transformer architectures
  • API development expertise (FastAPI) and production deployment experience
  • Proven experience with prompt engineering best practices and LLM evaluation metrics

Technical Skills Preferred:

Infrastructure & Deployment

  • Experience with vector databases (e.g., Pinecone, Weaviate) and RAG pipelines
  • Experience with observability and monitoring of LLM applications
  • Proficiency in model compression, distillation, and deployment at scale

Model Development & LLMs

  • Expertise in semantic search and embedding models
  • Experience in LLM frameworks (LangChain, LlamaIndex) and agentic AI systems
  • Advanced model fine-tuning techniques, including LoRA, Prompt Tuning, and Adapter Training

Why you should join Altimate AI?

Projects You'll Work On:

  • Advanced AI Agent Architecture: Design and implement sophisticated multi-agent systems that can understand context, make decisions, and enable seamless collaboration between AI and human data professionals.
  • Large-Scale RAG Systems: Build and optimize retrieval-augmented generation pipelines that can efficiently process and utilize enterprise-scale knowledge bases.
  • Model Optimization & Deployment: Implement advanced techniques (LoRA, Prompt Tuning) to adapt off-the-shelf models for specific enterprise data tasks, ensuring faster, more accurate performance.
  • Scalable AI Infrastructure: Develop and optimize cloud-native architectures (AWS, Kubernetes) for large-scale training, inference, and multi-agent orchestration.
  • Enterprise Security & Compliance: Implement robust security measures for LLM applications, including data anonymization, prompt injection prevention, and compliance with enterprise security standards.

Impact:

  • Innovation Leadership: Shape the future of enterprise AI by developing novel approaches to autonomous data operations and AI-driven automation.
  • Product Development: Direct influence on our flagship products, DataPilot and DataMates, working on cutting-edge features that define the next generation of AI-powered data tools.
  • Team Growth: Help build and mentor a growing team of AI engineers, shaping our technical culture and practices.
  • Open Source Contribution: Lead and contribute to our open-source initiatives, establishing yourself as a thought leader in the AI community.
  • Technical Growth: Opportunity to work with the latest advancements in AI technology and shape the architecture of next-generation AI systems.

What we offer

  • Competitive salary and equity
    • Base Salary Range: $185,000 - $250,000 [influenced by your expertise, how the interview goes, and how well you match the role]
    • Equity: 0.05% - 0.5%
  • Access to cutting-edge AI infrastructure and resources
  • Team offsite and opportunities to attend and present at leading industry conferences (across the world)
  • Learning budget for AI courses, books, and computing resources
  • Dynamic and intellectually stimulating work environment with a team of talented engineers
  • Opportunities to shape the direction of the company and leave a lasting impact

Salary : $185,000 - $250,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior Data Scientist - AI/ML Engineer?

Sign up to receive alerts about other jobs on the Senior Data Scientist - AI/ML Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$116,765 - $144,626
Income Estimation: 
$142,836 - $179,016
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$143,391 - $179,890
Income Estimation: 
$168,522 - $211,152
Income Estimation: 
$189,259 - $248,928
Income Estimation: 
$71,122 - $96,652
Income Estimation: 
$92,929 - $122,443
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Altimate AI

Altimate AI
Hired Organization Address Sunnyvale, CA Full Time
About Us:Altimate AI is at the forefront of the AI-driven data revolution, tackling one of the biggest pain points in mo...
Altimate AI
Hired Organization Address Sunnyvale, CA Full Time
About Us:Altimate AI is at the forefront of the AI-driven data revolution, tackling one of the biggest pain points in mo...
Altimate AI
Hired Organization Address Sunnyvale, CA Full Time
About Us: Altimate AI is at the forefront of the AI-driven data revolution, tackling one of the biggest pain points in m...
Altimate AI
Hired Organization Address Sunnyvale, CA Full Time
Why Join Us Altimate AI is at the forefront of the AI-driven data revolution, solving one of the biggest pain points in ...

Not the job you're looking for? Here are some other Senior Data Scientist - AI/ML Engineer jobs in the Sunnyvale, CA area that may be a better fit.

Senior AI/ML Engineer

Vectra AI, San Jose, CA

Data Scientist AI/ML

ExecutivePlacements.com, Palo Alto, CA

AI Assistant is available now!

Feel free to start your new journey!