Demo

AI Prompt & Product Engineer

Simbie AI
New York, NY Full Time
POSTED ON 12/26/2025
AVAILABLE BEFORE 1/25/2026
About The Role

We’re hiring an AI Prompt & Product Engineer to help turn cutting-edge AI into real impact in healthcare. You’ll be responsible for shaping how our platform thinks, speaks, and solves problems — from designing prompts and fine-tuning models to scoping MVPs and testing new AI workflows.

In an early-stage startup, no two days look the same. Some days you’ll be experimenting with multi-agent setups or refining intake flows; others you’ll be pressure-testing our platform, breaking it on purpose, and helping translate ambitious client ideas into something we can ship in weeks, not months. If you enjoy blending engineering, product, and experimentation — this role is for you.

What You’ll Do

Prompt Design & Model Development

  • Craft and refine prompts that support healthcare tasks like scheduling, eligibility checks, patient education, and intake.
  • Contribute to fine-tuning by preparing datasets, running training jobs, and evaluating results.
  • Explore new model behaviors and compare approaches across LLMs.
  • Build internal tools and scripts to test and benchmark prompts at scale.

Product Discovery & Workflow Design

  • Translate broad client requests into focused, testable solutions.
  • Work with clinicians and staff to uncover bottlenecks and identify the core workflows worth automating.
  • Break down complex problems into phased rollouts that let us learn quickly while reducing risk.
  • Prototype new use cases and validate them with real users.

Testing & Quality Assurance

  • Be the first user and toughest critic of our AI platform.
  • Design testing scenarios that catch edge cases and failure modes early.
  • Define metrics to measure conversation quality, accuracy, and user trust.
  • Stress-test new features, models, and integrations before release.

Engineering & Technical Leadership

  • Contribute directly to product code with Python/JavaScript for automation, integrations, and evaluation pipelines.
  • Partner with engineers on architecture and deployment decisions.
  • Identify opportunities to apply emerging AI techniques (RAG, multi-agent orchestration, lightweight fine-tuning).
  • Explain technical trade-offs clearly to both internal and external stakeholders.

What You Bring

Core Experience

  • 2 years in AI/ML engineering, product engineering, or similar roles (startup or fast-paced environments a plus).
  • Hands-on experience with LLMs, prompt engineering, and evaluation.
  • Proficiency in Python and/or JavaScript/TypeScript.
  • A track record of turning complex requirements into shipped products.
  • Comfort with hypothesis-driven development and rapid iteration.

Technical Background

  • Knowledge of AI frameworks, APIs, and fine-tuning techniques.
  • Understanding of conversational AI design and multi-agent systems.
  • Familiarity with A/B testing and metrics-driven decision-making.
  • Ability to collaborate closely with engineers on system design and implementation.

Nice to Have

  • Background in healthcare technology or regulated environments.
  • Familiarity with standards like HL7/FHIR or insurance workflows.
  • Awareness of compliance requirements (HIPAA, SOC 2).
  • Interest in AI safety, reliability, and alignment.

Who You Are

  • You thrive in ambiguity and enjoy experimenting your way to clarity.
  • You want to see AI solve real, human problems in healthcare, not just toy use cases.
  • You’re comfortable moving between roles — one day coding, the next mapping out workflows with clinicians.
  • You believe speed, learning, and responsibility go hand in hand.

About The Role

We’re looking for a Prompt Engineer to join our early-stage healthcare AI startup. In this role, you’ll design, test, and optimize prompts and workflows that power real-world use cases such as patient scheduling, insurance eligibility and prior auth, medical history collection, and patient education. You’ll also contribute to model fine-tuning and evaluation to ensure outputs meet the accuracy, compliance, and usability standards needed in healthcare. Expect to wear many hats — from prototyping prompts to coding integrations — as we rapidly iterate and scale.

Key Responsibilities

  • Design, refine, and test prompts to enable accurate and reliable outputs for healthcare scheduling, insurance workflows, patient intake, and education.
  • Build and maintain reusable prompt libraries and evaluation frameworks to improve performance and reproducibility.
  • Contribute to fine-tuning models (collecting and curating datasets, running training jobs, evaluating outputs) to improve domain-specific accuracy.
  • Write code to automate testing, integrate AI workflows into APIs and applications, and monitor performance in production.
  • Collaborate directly with clinicians and operations teams to understand real-world pain points and rapidly prototype solutions.
  • Establish quality guardrails to ensure safety, compliance, and trust in patient-facing outputs.
  • Contribute to broader product development beyond prompts—helping with data pipelines, integrations, and deployment.

Required Qualifications

  • Bachelor’s degree in Computer Science, Data Science, or related field (or equivalent startup experience).
  • Proficiency in Python and/or JavaScript/TypeScript for scripting, automation, and API integration.
  • Hands-on experience with large language models (OpenAI, Anthropic, etc.) and prompt design.
  • Familiarity with fine-tuning workflows (data preprocessing, evaluation metrics, supervised/LoRA training, or similar).
  • Strong problem-solving skills and creativity in working with language and workflows.
  • Excellent communication skills to translate between technical, clinical, and operational needs.
  • Comfort operating in a fast-paced startup environment with limited structure.

Preferred Qualifications

  • Experience with healthcare data standards and workflows (EHR, HL7/FHIR, insurance claims).
  • Knowledge of cloud platforms (AWS, GCP, Azure) and deployment best practices.
  • Familiarity with compliance frameworks (HIPAA, SOC 2).
  • Experience working cross-functionally in small teams where responsibilities overlap.

What We’re Looking For

  • Entrepreneurial mindset — resourceful, adaptable, and eager to experiment.
  • Excitement about applying AI to reduce friction in healthcare access and operations.
  • Willingness to roll up your sleeves and contribute wherever needed — from prompt design to coding to dataset prep for fine-tuning.

Salary : $60,000 - $120,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Prompt & Product Engineer?

Sign up to receive alerts about other jobs on the AI Prompt & Product Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,272 - $153,570
Income Estimation: 
$150,776 - $185,671
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other AI Prompt & Product Engineer jobs in the New York, NY area that may be a better fit.

  • Blueflame AI York, NY
  • Datasite and its associated businesses are the global center for facilitating economic value creation for companies across the globe. From data rooms to AI... more
  • 3 Days Ago

  • Controlled Combustion Co York, NY
  • Description:Controlled Combustion is the leading heating contractor in NYC. We serve a variety of industries, including luxury apartments, hospitals, unive... more
  • 1 Month Ago

AI Assistant is available now!

Feel free to start your new journey!