Demo

Infrastructure Engineer - AI, Kubernetes & Edge Systems

UMATR
Austin, TX Full Time
POSTED ON 8/4/2026
AVAILABLE BEFORE 9/27/2026

We're partnering with an AI company transforming industrial environments through intelligent, on-premise AI systems. Their platform processes live operational data on customer hardware, delivering real-time insights for critical industries.


They're looking for an Infrastructure Engineer to own platform deployment, reliability and scaling across Kubernetes, GPU infrastructure and cloud environments. As an early engineer, you'll have significant ownership in shaping the architecture, tooling and future direction of the platform.


What You'll Do

  • Own the end-to-end deployment lifecycle for customer environments, from bare hardware through to fully operational systems.
  • Build and maintain Kubernetes-based deployments across single-node and multi-node on-premise environments.
  • Develop reliable GitOps workflows, managing deployments through version-controlled infrastructure and automated reconciliation.
  • Build and maintain cloud infrastructure for development and staging environments using Infrastructure as Code.
  • Own CI/CD pipelines, including automated builds, testing workflows, deployment processes and release management.
  • Deploy and optimise AI inference workloads running on customer GPU hardware.
  • Configure and tune model serving infrastructure, balancing performance, latency and hardware constraints.
  • Improve observability across applications, infrastructure and AI workloads through monitoring, tracing and diagnostics.
  • Build secure systems for managing secrets, permissions and industrial network environments.
  • Create documentation, runbooks and automation that make deployments repeatable and supportable.
  • Identify opportunities to remove manual processes and improve engineering efficiency.


Who We're Looking For

  • Strong experience with Kubernetes, including troubleshooting production environments, networking, storage and cluster operations.
  • Hands-on experience deploying Kubernetes outside managed cloud environments (e.g. k3s, RKE2, MicroK8s or similar).
  • Production experience with Infrastructure as Code tools such as Terraform.
  • Strong Docker experience, including multi-service applications, image optimisation and registry workflows.
  • Experience owning CI/CD pipelines and improving software delivery processes.
  • Experience running AI/ML workloads on GPU infrastructure, including model serving and performance optimisation.
  • Understanding of GPU resources, including VRAM management, batching, quantisation and inference optimisation.
  • Strong Linux and Bash skills, with the ability to work with Python-based applications.
  • A first-principles approach to debugging complex technical issues.
  • Strong ownership mindset and ability to operate independently in a fast-moving environment.


Nice To Have

  • Experience with GitOps tools such as Flux or Argo CD.
  • Background working with edge computing, air-gapped environments or customer-hosted infrastructure.
  • Experience with industrial environments, manufacturing systems, PLCs or industrial protocols.
  • Knowledge of GPU scheduling, multi-model inference or GPU sharing technologies.
  • Experience managing databases such as PostgreSQL or time-series databases.
  • Familiarity with observability tools such as OpenTelemetry or AI tracing platforms.


What Is In It For You?

  • Opportunity to join an early-stage AI company solving complex real-world industrial challenges.
  • High ownership and autonomy from day one, working directly with engineering leadership.
  • Build infrastructure where the challenges go beyond traditional cloud environments.
  • Work on cutting-edge AI systems running directly on physical hardware.
  • Shape engineering practices, architecture and deployment strategy as the company scales.
  • Exposure to complex problems across infrastructure, AI, hardware and software engineering.


Interested?

If you're an Infrastructure Engineer who enjoys solving difficult engineering problems and wants to build the next generation of AI-powered industrial systems, we'd love to hear from you.


Apply today!

Salary.com Estimation for Infrastructure Engineer - AI, Kubernetes & Edge Systems in Austin, TX
$103,501 to $139,141
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Infrastructure Engineer - AI, Kubernetes & Edge Systems?

Sign up to receive alerts about other jobs on the Infrastructure Engineer - AI, Kubernetes & Edge Systems career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$103,114 - $138,258
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at UMATR

  • UMATR York, NY
  • 📍 New York City, NY | 💰 $150,000–$300,000 Founding Equity Benefits | AI | Python | LLMs | Full-Stack We're partnering with a well-funded AI company that'... more
  • 9 Days Ago

  • UMATR York, NY
  • About the Role UMATR are supporting a VC backed startup looking for an experienced Platform Engineer to help build the technical foundation of a rapidly gr... more
  • 9 Days Ago

  • UMATR York, NY
  • AI Engineer New York City Full-time About the Opportunity A well-funded, product-led technology company is quietly building some of the most ambitious AI i... more
  • 10 Days Ago


Not the job you're looking for? Here are some other Infrastructure Engineer - AI, Kubernetes & Edge Systems jobs in the Austin, TX area that may be a better fit.

  • Exacta Systems Austin, TX
  • Title: IT Infrastructure & Systems Engineer Requisition ID#: 1122 Location: Austin, TX, US, 78735 Property: Exacta Pay Range At Exacta Systems, we’re not j... more
  • 20 Days Ago

AI Assistant is available now!

Feel free to start your new journey!