What are the responsibilities and job description for the Staff Software Engineer position at Storm3?
👩 💻 Staff Software Engineer (LLM focused)
👩 ⚕️ AI-Driven Healthcare Automation
📍 Hybrid in Burlingame
💸 Competitive base with Big Tech equity
We are working with a fast-growing AI-native healthcare company transforming how healthcare providers manage administrative operations. By combining modern software infrastructure with applied AI, they are building intelligent systems that can navigate complex payer workflows, handle repetitive phone-based processes, and streamline some of the most inefficient parts of the healthcare system.
They are looking for an experienced Staff Software Engineer with strong backend engineering fundamentals and exposure to applied AI systems to join their growing team.
About the Role
- AI Platform Engineering – Design and build the backend systems that power AI-driven products, creating scalable services that support language models in production healthcare environments.
- Data Infrastructure – Develop pipelines that ingest, clean, and structure complex healthcare and operational data so models can generate more accurate and context-aware outputs.
- Model Reliability – Build the tooling needed to monitor performance, measure quality, manage costs, and ensure AI systems behave consistently in production.
- Scalability & Efficiency – Improve how AI workloads run by optimizing throughput, reducing latency, and supporting high-volume usage across cloud infrastructure.
- Security & Governance – Help implement secure systems with strong auditability and data controls suitable for sensitive healthcare data.
- Cross-Team Partnership – Work closely with product, AI, and clinical teams to turn real-world healthcare problems into robust technical solutions.
- Technical Ownership – Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design.
About you:
- 5 years of backend or full-stack software engineering experience, with 3 years working on ML/LLM-enabled applications.
- Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript).
- Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.).
- Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale.
- Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc.
- Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility.
- Excellent system design skills and the ability to align technical architecture with product goals.
Preferred qualifications:
- Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA). Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration
- Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter
- Knowledge of responsible AI, safety, and privacy-preserving ML techniques.
📧 Interested in applying? Please click on the ‘Easy Apply’ button or alternatively email me your resume at stefani.lukic@storm3.com
⚡ Storm3 is a HealthTech recruitment firm with clients across major Tech hubs in Europe, APAC and North America. To discuss open opportunities or career options, please visit our website at storm3.com and follow the Storm3 LinkedIn page for the latest jobs and intel
Salary : $250,000 - $325,000