What are the responsibilities and job description for the Principal Engineer – Platform Engineering position at Hippocratic AI?
About Us
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Why Join Our Team
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA, unless explicitly noted otherwise in the job description.
About The Role
We are seeking a Principal Engineer – Platform Engineering to design, scale, and evolve the infrastructure that powers our AI models and SaaS applications across multiple clouds.
You’ll define the technical direction for our platform, architect systems for large-scale model training and inference, and help with hiring and mentoring engineers. This role blends deep hands-on engineering with technical leadership, partnering closely with AI research and product engineering teams to deliver secure, high-performance, and cost-efficient systems.
What You'll Do:
Must Have:
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Why Join Our Team
- Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.
- Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
- Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.
- World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.
We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA, unless explicitly noted otherwise in the job description.
About The Role
We are seeking a Principal Engineer – Platform Engineering to design, scale, and evolve the infrastructure that powers our AI models and SaaS applications across multiple clouds.
You’ll define the technical direction for our platform, architect systems for large-scale model training and inference, and help with hiring and mentoring engineers. This role blends deep hands-on engineering with technical leadership, partnering closely with AI research and product engineering teams to deliver secure, high-performance, and cost-efficient systems.
What You'll Do:
- Architect and scale the multi-cloud platform for AI inference and SaaS workloads.
- Lead design for performance, reliability, and cost optimization.
- Build automation and tooling using infrastructure-as-code and CI/CD best practices.
- Partner with research to productionize models efficiently.
- Improve observability, telemetry, and incident response.
- Foster a culture of technical and operational excellence
- Hire and mentor strong engineers to guide long-term technical strategy.
- Evaluate emerging technologies in AI infra, GPU orchestration, and distributed systems.
Must Have:
- 12 years in software engineering with strong experience in platform or distributed systems.
- Deep knowledge of AWS, GCP, or Azure, and multi-cloud architectures.
- Expertise in IaC tools (Terraform, Pulumi) and CI/CD automation.
- Experience with Kubernetes, GPU orchestration, or model-serving (e.g., Ray, Triton, SGLang).
- Proficiency with observability tools (Prometheus, Grafana, OpenTelemetry, Datadog).
- Strong understanding of cloud security, networking, and cost optimization.
- Excellent communicator and mentor; strong cross-team collaboration skills.
- Experience with LLM or AI infrastructure, including large-scale inference or fine-tuning.
- Background in data pipelines or developer platform tooling.
- Exposure to hybrid-cloud or edge AI systems.
- Track record of technical leadership and long-term architectural vision.
- Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process. If anything