Demo

AI Backend Engineer, Work From Home

Parallel Partners
San Francisco, CA Remote Full Time
POSTED ON 7/6/2026
AVAILABLE BEFORE 9/3/2026

Job Description

AI Backend Engineer, Work From Home

 

We are looking for talented AI Backend Engineers to build systems that power AI-driven decisioning, automation, and orchestration across our platform.  This role sits at the core of our AI stack, between models, backend systems, and real users, where latency, correctness, reliability, and cost directly impact production experience.  This is a fully remote position where you will be part of a global engineering team working across multiple countries to build reliable, scalable AI systems.  We have multiple openings for this position.  This position is 100% Remote.

 

AI Backend Engineer Responsibilities:

 

- Build and operate backend systems that serve AI-powered insurance workflows in production.

- Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.

- Build inference pipelines for LLM-based and AI-assisted automation systems.

- Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).

- Design stable service boundaries between backend systems, ML components, and product APIs.

- Implement observability: logging, metrics, tracing, alerting, and incident response workflows.

- Debug production issues across distributed AI systems and resolve root causes.

- Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features.

- Continuously improve system reliability, scalability, and performance.

 

AI Backend Engineer Outcomes:

 

- AI backend systems run reliably at scale with low latency and high availability.

- AI workflows are stable, observable, and production-ready across multiple products.

- System performance improves continuously through real-world feedback and optimization.

- Production incidents are quickly detected, diagnosed, and resolved.

- AI capabilities are seamlessly integrated into global customer and internal workflows.

Qualifications

AI Backend Engineer Qualifications:

 

- Strong backend engineering experience in production systems.

- Experience building or operating high-throughput, low-latency services.

- Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).

- Experience with distributed systems and production debugging.

- Strong understanding of APIs, data flows, and system design principles.

- Experience with observability tools (logging, monitoring, tracing).

- Strong ownership mindset and bias toward shipping.

- Comfortable working in fast-paced, globally distributed teams.

- Tech Stack:  Anthropic, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL.

 

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

 

Keywords:  San Francisco CA Jobs, AI Backend Engineer, AI, Anthropic, Artificial Intelligence, Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Low Latency, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL, Software Engineer, Software Developer, Programming, Programmer Analyst, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting

 

Looking to hire an AI Backend Engineer in San Francisco, CA or in other cities?  Our IT recruiting agencies and staffing companies can help.

 

We help companies that are looking to hire AI Backend Engineers for jobs in San Francisco, California and in other cities too.  Please contact our IT recruiting agencies and IT staffing companies today!

Additional Information

All your information will be kept confidential according to EEO guidelines.

Salary : $140,000 - $200,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Backend Engineer, Work From Home?

Sign up to receive alerts about other jobs on the AI Backend Engineer, Work From Home career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Parallel Partners

  • Parallel Partners San Francisco, CA
  • Job Description Applied AI Engineer, Work From Home We are looking for an Applied AI Engineer to design, build, and optimize AI-powered features that sit d... more
  • 11 Days Ago

  • Parallel Partners Charlotte, NC
  • Company Description Job Description Senior Network/Infrastructure Engineer, Onsite in Charlotte, NC We are seeking a Senior Network/Infrastructure Engineer... more
  • 1 Day Ago

  • Parallel Partners Charlotte, NC
  • Company Description Job Description Director of Technology, Onsite in Charlotte, NC The Director of Technology is responsible for the entire technology pla... more
  • 1 Day Ago

  • Parallel Partners Charlotte, NC
  • Company Description Job Description Software Development Engineer in Test (SDET), Level 3, Onsite in Charlotte, NC We are seeking a highly skilled Software... more
  • 1 Day Ago


Not the job you're looking for? Here are some other AI Backend Engineer, Work From Home jobs in the San Francisco, CA area that may be a better fit.

  • Parallel Partners San Francisco, CA
  • Job Description Applied AI Engineer, Work From Home We are looking for an Applied AI Engineer to design, build, and optimize AI-powered features that sit d... more
  • 11 Days Ago

  • Recruiting From Scratch San Francisco, CA
  • Senior Backend Engineer (Generalist) Location: New York, NY Company Stage of Funding: Series A DeFi Infrastructure Startup ($44M Raised) Office Type: Hybri... more
  • 11 Days Ago

AI Assistant is available now!

Feel free to start your new journey!