What are the responsibilities and job description for the AI Engineer position at Hippocratic AI?
About Us
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Why Join Our Team
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA unless explicitly noted otherwise in the job description.
About The Role
As an AI Engineer at Hippocratic AI, you’ll play a pivotal role in shaping the future of voice-based generative AI in healthcare. You’ll design and build the intelligent systems that power our clinically safe healthcare agents, working at the intersection of large language models, real-time voice, and human-centered product design.
This is a deeply hands-on and cross-functional role, partnering closely with AI researchers, product managers, and clinical experts to bring advanced language and speech models into production. From building scalable RAG and multi-agent pipelines to conversational interactions, your work will directly influence how patients and providers safely interact with generative AI at scale.
We’re looking for experienced engineers who are passionate about AI in the real world—people who love taking cutting-edge research, turning it into robust products, and advancing the frontier of what’s possible in safe, agentic healthcare systems.
What You'll Do:
Must Have:
Join Hippocratic AI and help shape the future of clinically safe, voice-enabled AI systems that are already transforming patient care at scale.
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Why Join Our Team
- Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.
- Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
- Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.
- World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA unless explicitly noted otherwise in the job description.
About The Role
As an AI Engineer at Hippocratic AI, you’ll play a pivotal role in shaping the future of voice-based generative AI in healthcare. You’ll design and build the intelligent systems that power our clinically safe healthcare agents, working at the intersection of large language models, real-time voice, and human-centered product design.
This is a deeply hands-on and cross-functional role, partnering closely with AI researchers, product managers, and clinical experts to bring advanced language and speech models into production. From building scalable RAG and multi-agent pipelines to conversational interactions, your work will directly influence how patients and providers safely interact with generative AI at scale.
We’re looking for experienced engineers who are passionate about AI in the real world—people who love taking cutting-edge research, turning it into robust products, and advancing the frontier of what’s possible in safe, agentic healthcare systems.
What You'll Do:
- Design, build, and optimize production-grade AI pipelines that power our voice-based generative healthcare agents—from retrieval-augmented generation (RAG) to multi-step reasoning systems.
- Collaborate cross-functionally with product, clinical, and engineering teams to translate healthcare workflows into safe, scalable, and human-centered AI experiences.
- Prototype and deploy zero-to-one features using state-of-the-art LLMs, retrieval systems, and streaming architectures—balancing innovation with reliability.
- Develop and refine AI-native workflows that support real-time, conversational, and long-running interactions across diverse healthcare contexts.
- Drive continuous improvement in model evaluation, safety testing, and observability, ensuring every agent interaction meets clinical safety standards
Must Have:
- 3 years of professional experience in software, ML, or AI engineering.
- Proven track record building and shipping AI- or ML-powered products in production environments.
- Strong programming skills in Python with experience in distributed systems, APIs, and data pipelines.
- Deep understanding of prompt engineering, vector databases, and retrieval systems (RAG), voice agents or willingness to learn rapidly.
- Experience with cloud environments (AWS/GCP/Azure) and modern DevOps practices (Terraform, CI/CD, monitoring).
- Excellent communication, cross-functional collaboration, and an ability to move fast in high-impact domains.
- Experience building or deploying LLM-based or multi-agent systems at scale.
- Hands-on work with speech recognition, text-to-speech, or streaming architectures for real-time AI experiences.
- Prior exposure to healthcare, safety-critical domains, or regulated product development.
Join Hippocratic AI and help shape the future of clinically safe, voice-enabled AI systems that are already transforming patient care at scale.
- Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process. If anything