What are the responsibilities and job description for the Senior ML / LLM Engineer position at IDR, Inc.?
IDR is seeking a Senior ML / LLM Engineer to join one of our top clients for a remote opportunity.
This role is with an organization at the forefront of healthcare technology, focusing on advancing clinical intelligence and workflow automation to improve patient outcomes and clinician support. No C2C for this position.
Position Overview for the Senior ML / LLM Engineer:
- Design and implement advanced AI systems, including AI Agents using frameworks like LangGraph, Semantic Kernel, or custom orchestration layers.
- Build and maintain Retrieval-Augmented Generation (RAG) pipelines based on clinical guidelines, evidence-based medicine, and real-time patient data.
- Develop scalable inference services capable of low-latency performance within clinical environments.
- Synthesize fragmented clinical data from sources such as EHR, labs, and notes into prioritized insights for clinicians.
- Ensure AI systems comply with HIPAA, data privacy standards, and security requirements, while collaborating with cross-functional teams to deliver reliable solutions.
Requirements for the Senior ML / LLM Engineer:
- Deep experience with LLM orchestration, tool-calling, and handling long-context documents.
- Strong proficiency with vector databases such as Pinecone, Milvus, or Weaviate.
- Experience with MLOps tools including Docker, Kubernetes, CI/CD, and model deployment.
- Proficiency in C#/.NET for backend service development.
- Understanding of healthcare standards like FHIR and HL7, and familiarity with handling PHI and HIPAA compliance.
What's in it for you?
- Competitive compensation package
- Full Benefits; Medical, Vision, Dental, and more!
- Opportunity to get in with an industry leading organization.
Why IDR?
- 25 Years of Proven Industry Experience in 4 major markets
- Employee Stock Ownership Program
- Dedicated Engagement Manager who is committed to you and your success.
- Medical, Dental, Vision, and Life Insurance
- ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.