LLM Applications Engineer

LLM Applications Engineer (DevTool Start-Up)

$120,000 – $180,000 Equity Benefits PTO

San Francisco, CA

Are you passionate about building production-grade application systems on top of large language models? Do you thrive in environments where you directly own customer-facing infrastructure that ships alongside the fastest-moving AI models in the world?

This is an opportunity to join a fast-growing, profitable start-up at the forefront of AI infrastructure, building the systems layer that powers how real customers deploy and use language models in production.

Backed by top-tier investors and trusted by major enterprises, the team has built a unified API framework that makes it seamless for developers to integrate across multiple LLM providers. Now, they’re looking for a Founding Application / Systems Engineer to own the translation, rollout, and reliability of new models and endpoints across the platform.

As a founding member of the engineering team, you’ll take ownership of the customer-facing systems layer, shaping how new LLM models, providers, and APIs are translated, normalized, and deployed. You’ll work closely with paying customers, internal teams, and the developer community to ensure new models are available, reliable, and production-ready from day one.

If you’re looking for a role where you can combine hands-on systems engineering with real customer impact and directly influence the infrastructure that underpins modern AI applications, this is an outstanding opportunity.

The Role:

• Own and resolve LLM translation issues for paid customers in production
• Roll out support for new LLM models, providers, and endpoints across the platform
• Lead day0 launches for new model releases from OpenAI, Anthropic, and Google
• Implement and maintain translation and normalization logic across differing LLM APIs
• Maintain provider integrations and ensure consistent behavior, reliability, and performance
• Improve observability, error handling, and system resilience for AI driven workloads
• Collaborate with internal teams and customers to turn real world usage into platform improvements

The Person:

• Proficiency in Python and async frameworks
• Strong familiarity with LLM APIs and application level translation or integration layers
• Solid understanding of backend systems, API design, and distributed services
• Comfortable owning production systems and debugging customer facing issues
• Excited to work in an early stage, high-ownership, fast-shipping environment