What are the responsibilities and job description for the Member of Technical Staff, CI/CD Infrastructure position at Inferact?
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About The Role
vLLM is growing at a fast pace, and every bit of that growth lands on the CI system. More models, more hardware, more contributors, more ways for things to break. Your job is to make sure none of that slows anyone down.
You’ll get to:
Minimum qualifications:
About The Role
vLLM is growing at a fast pace, and every bit of that growth lands on the CI system. More models, more hardware, more contributors, more ways for things to break. Your job is to make sure none of that slows anyone down.
You’ll get to:
- Maintain and scale the compute infrastructure that powers CI, release, performance benchmark, accuracy evaluation for vLLM project, across a wide range of models and accelerators including H100/H200, (G)B200/300, AMD MI325/355X, TPU, Intel Gaudi, etc..
- Get creative about cutting CI time-to-signal from hours to minutes
- Make sure every corner of vLLM code base is well-tested
- Keep vLLM releases rock-solid
- Build out tooling that helps 3,000 vLLM contributors move fast
Minimum qualifications:
- Strong experience with Docker, Kubernetes, and containerized build or test environments.
- Built CI/CD pipelines from scratch using GitHub Actions, Buildkite, or similar systems.
- Familiar with CI design patterns and CI techniques: compute orchestration, handling flaky tests, dependency/environment management, caching, remote execution, test target determination, etc, test coverage, and so on.
- Fluent in Python, Bash, Go, or similar for automation and tooling.
- Solid fundamentals of Linux, security, networking, storage, package management,.
- Setting up infrastructure for ML, inference, CUDA, ROCm, or accelerator-heavy workloads.
- Running Buildkite at scale, including agents, queues, dynamic pipelines, test sharding, caching, and artifact management.
- Operating Kubernetes clusters for CI, batch jobs, test execution, or internal developer infrastructure.
- Managing CI/CD in large open-source project
- Building dashboards, alerts, runbooks, or tooling for CI observability.
- Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
- Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD equity.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Salary : $200,000 - $400,000