Demo

Software Engineer (AI Infrastructure / Training / Inference)

SPREEAI
San Francisco, CA Full Time
POSTED ON 4/17/2026
AVAILABLE BEFORE 5/24/2026
About The Role

We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering — including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency.

You Will Work On

  • Scalable model serving and inference pipelines.
  • Distributed GPU infrastructure.
  • Performance and cost optimization.
  • Reliability, observability, and production readiness.

You will operate at the boundary between systems engineering and machine learning — building the “paved roads” that allow advanced AI systems to scale safely and efficiently.

What You'll Do

  • Design and build scalable infrastructure supporting training and inference workflows.
  • Develop high-performance APIs and backend services for AI model serving.
  • Optimize GPU utilization, latency, and throughput for multimodal workloads.
  • Build distributed systems supporting large-scale generative models.
  • Improve observability, monitoring, and reliability of AI systems.
  • Partner closely with Applied Science teams to productionize research systems.
  • Drive improvements in deployment workflows, automation, and platform usability.

Qualifications

  • Degree in Computer Science, Engineering, or comparable combination of education and practical experience.
  • Strong object-oriented programming skills (Python, C , Java, Go, or similar).
  • Strong data structures and algorithms foundations.
  • Experience building production backend or distributed systems.
  • Understanding of cloud infrastructure concepts and containerized systems.

Preferred Qualifications

  • Experience with Kubernetes, Docker, or container orchestration.
  • Familiarity with GPU-based ML workloads or distributed training/inference systems.
  • Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar).
  • Experience with observability tools and performance debugging.
  • Familiarity with PyTorch or ML workflows.
  • Interest in optimizing systems for efficiency, scalability, and developer velocity.

SPREEAI is a fast-growing, innovative AI company at the forefront of fashion and e-commerce, revolutionizing how consumers engage with fashion through lifelike photorealistic try-on technology and hyper-personalized shopping experiences. Our mission is to redefine the retail landscape with cutting-edge AI solutions that blend high fashion and technology. We thrive in a dynamic, fast-paced environment where creativity meets technology to drive real impact. If you are passionate about innovation and shaping the future of fashion, SPREEAI offers a platform to make your mark.

Salary.com Estimation for Software Engineer (AI Infrastructure / Training / Inference) in San Francisco, CA
$113,597 to $138,292
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Software Engineer (AI Infrastructure / Training / Inference)?

Sign up to receive alerts about other jobs on the Software Engineer (AI Infrastructure / Training / Inference) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$77,657 - $95,021
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$123,167 - $152,295
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at SPREEAI

  • SPREEAI York, NY
  • About The Role Ready to launch your social media career at the intersection of fashion and AI? SPREEAI – a fast-growing, innovative startup blending high f... more
  • 1 Day Ago


Not the job you're looking for? Here are some other Software Engineer (AI Infrastructure / Training / Inference) jobs in the San Francisco, CA area that may be a better fit.

  • Beacon Software San Francisco, CA
  • Beacon Software is a permanent capital holding company which acquires and grows essential businesses. We are a profitable series B firm that combines great... more
  • 2 Days Ago

  • Advent Software, Inc. San Francisco, CA
  • As a leading financial services and healthcare technology company based on revenue, SS&C is headquartered in Windsor, Connecticut, and has 27,000 employees... more
  • 1 Month Ago

AI Assistant is available now!

Feel free to start your new journey!