What are the responsibilities and job description for the Product Manager – AI and Apps Platform position at Hippocratic AI?
About Us
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Why Join Our Team
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA, unless explicitly noted otherwise in the job description.
About The Role
We are seeking a Product Manager – AI and Apps Platform to define the vision, roadmap, and execution for the systems powering our large language and audio models, inference clusters, and SaaS applications across multiple clouds.
You’ll partner closely with engineering, AI research, and GTM teams to build a scalable, cost-efficient, and extensible platform for model training, deployment, and application hosting. This role blends product strategy, technical depth, and cross-team leadership to ensure the platform enables rapid innovation and operational excellence at scale.
What You'll Do:
Must Have:
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Why Join Our Team
- Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.
- Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
- Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.
- World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA, unless explicitly noted otherwise in the job description.
About The Role
We are seeking a Product Manager – AI and Apps Platform to define the vision, roadmap, and execution for the systems powering our large language and audio models, inference clusters, and SaaS applications across multiple clouds.
You’ll partner closely with engineering, AI research, and GTM teams to build a scalable, cost-efficient, and extensible platform for model training, deployment, and application hosting. This role blends product strategy, technical depth, and cross-team leadership to ensure the platform enables rapid innovation and operational excellence at scale.
What You'll Do:
- Define and execute the roadmap for HippocraticAI’s cross-cloud AI and application platform.
- Partner with engineering and research on capacity planning for inference and application clusters.
- Maintain model capacity and utilization tracking across LLM and Audio workloads.
- Coordinate with GTM on deployment strategy, onboarding, and demand forecasting.
- Collaborate with cloud vendors on capacity, pricing, and new feature evaluation.
- Build and refine cost-optimal platform to balance performance and margins.
- Lead pricing and margin analysis to align product performance with business goals.
- Define and track success metrics around latency, cost, utilization, and adoption.
Must Have:
- 7 years of product management experience, with at least 2 years in AI/ML platform or infrastructure products.
- Strong technical understanding of model training, inference, and cloud compute architectures (AWS, GCP, or Azure).
- Proven ability to align engineering, research, and GTM teams around shared goals.
- Experience with capacity planning, cost optimization, and multi-cloud infrastructure.
- Knowledge of cloud economics, performance trade-offs, and observability frameworks.
- Excellent communication and analytical skills, with a focus on measurable outcomes.
- Hands-on background in cloud infrastructure, MLOps, or distributed systems.
- Experience with GPU orchestration, multi-cloud cost optimization, or AI inference workloads.
- Familiarity with LLM and voice-agent technologies.
- Passion for building platforms that empower both developers and customers.
- Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process. If anything
