Demo

Infrastructure Operations Engineer

lightningai
York, NY Remote Full Time
POSTED ON 5/22/2026
AVAILABLE BEFORE 7/22/2026

Who We Are

Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with less friction.

Through our merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute. Teams get the tools they need for experimentation, training, and production inference, with security, observability, and control built in.

We serve solo researchers, startups, and large enterprises. Lightning AI operates globally with offices in New York City, San Francisco, Seattle, and London, and is backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute.

Our Values

  • Move Fast: We act with speed and precision, breaking down big challenges into achievable steps.

  • Focus: We complete one goal at a time with care, collaborating as a team to deliver features with precision.

  • Balance: Sustained performance comes from rest and recovery. We ensure a healthy work-life balance to keep you at your best.

  • Craftsmanship: Innovation through excellence. Every detail matters, and we take pride in mastering our craft.

  • Minimal: Simplicity drives our innovation. We eliminate complexity through discipline and focus on what truly matters.

What We're Looking For

Lightning AI is seeking an experienced Infrastructure Operations Engineers to help scale and operate our next-generation AI infrastructure platform. Our InfraOps team sits at the center of reliability, automation, and operational scale for GPU infrastructure. This team owns break/fix operations, incident response, customer provisioning, observability, and the automation systems that keep complex infrastructure running efficiently.

In this role, you’ll work hands-on with large-scale GPU environments, Linux systems, bare metal infrastructure, provisioning workflows, and platform reliability. You’ll partner closely with Infrastructure Engineering, Network Operations, and Software Platform teams to troubleshoot issues, improve operational efficiency, and build automation that reduces manual toil over time.

We’re flexible on location for this team. This role can work hybrid out of one of our US-based hubs (Seattle, NYC, or SF) or fully remote within the U.S., with occasional company and team offsites. We are not able to provide visa sponsorship for this position at this time.

 

What You'll Do

  • At the direction of the Manager of Infrastructure Operations, design, build, and roll out new platforms and patterns to minimize incidents and enable customer facing and internal features.
  • Deploy updates and improvements to support both Voltage Park’s internal and end customer use cases.
  • Collaborate with colleagues in Infrastructure Engineering, Network Operations, Customer Success and Software and Platform Development Teams.
  • Participate in the on-call rotation which is evenly distributed across all team members in a primary / secondary pattern where you are primary then move to a secondary position.

 

What You Will Need

Required Qualifications

  • 8 years working with Linux as a server / hosting platform, extra points for Ubuntu experience.
  • 5 years experience with AWS.
  • 2 years experience with Kubernetes and strong container fundamentals.
  • 2 years experience with Terraform and Ansible
  • 2 years with network attached storage management (via NFS, ceph, or other protocols). Extra points for experience with VAST storage systems.
  • Experience with monitoring systems (Prometheus, ELK stack).
  • Familiarity with the gitops workflow.
  • Software development experience using Python, Go, bash, or other languages for the purposes of automation & connecting systems & APIs together.
  • Deep networking fundamentals, extra points for experience with datacenter level networks, 400Gb ethernet, and Infiniband.
  • Experience building and delivering complex systems.
  • Effective at navigating tradeoffs between design, risk, cost, and outcomes.
  • Comfortable with navigating ambiguity.
  • Strong written and oral communication.

Nice-to-Haves

  • Experience with bare metal hardware troubleshooting and provisioning, extra points for working with Dell hardware.
  • Experience with GPU servers, both in bare metal form or under virtualization.
  • Deep experience with network switches, routers, and firewalls, particularly SONiC switches, Palo Alto firewalls and Juniper Networks as vendors.
  • Experience with VAST storage systems

 

Compensation

 

We are committed to offering competitive compensation that reflects the value each team member brings to our mission. Final offers are based on factors such as experience, skills, geographic location, and role expectations. In addition to base salary, our total rewards package for eligible roles includes a discretionary bonus, a meaningful equity component, and comprehensive benefits.

The anticipated annual base salary range for this role is:

$160,000 - $200,000 USD

Benefits and Perks

We offer a comprehensive and competitive benefits package designed to support our employees’ health, well-being, and long-term success. Benefits may vary by location, team, and role.

Benefits include:

  • Comprehensive medical, dental and vision coverage (U.S.); Private medical and dental insurance (U.K.)
  • Retirement and financial wellness support (U.S.); Pension contribution (U.K.)
  • Generous paid time off, plus holidays
  • Paid parental leave
  • Professional development support
  • Wellness and work-from-home stipends
  • Flexible work environment

 

At Lightning AI, we are committed to fostering an inclusive and diverse workplace. We believe that diverse teams drive innovation and create better products. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic. We are dedicated to building a culture where everyone can thrive and contribute to their fullest potential.

Salary : $160,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Infrastructure Operations Engineer?

Sign up to receive alerts about other jobs on the Infrastructure Operations Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$128,617 - $162,576
Income Estimation: 
$117,033 - $148,289
Income Estimation: 
$86,680 - $110,316
Income Estimation: 
$110,730 - $135,754
Income Estimation: 
$117,033 - $148,289
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at lightningai

  • lightningai San Francisco, CA
  • Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying A... more
  • 2 Days Ago

  • lightningai York, NY
  • Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying A... more
  • 3 Days Ago

  • lightningai York, NY
  • Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying A... more
  • 3 Days Ago

  • lightningai York, NY
  • Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying A... more
  • 5 Days Ago


Not the job you're looking for? Here are some other Infrastructure Operations Engineer jobs in the York, NY area that may be a better fit.

  • Infrastructure Engineering Inc. York, NY
  • Join us at the intersection of INGENUITY & INCLUSION About The Role Infrastructure Engineering Inc. (IEI) New York office is looking for Project Manager - ... more
  • 10 Days Ago

  • Landing Point York, NY
  • Company Overview: A leading financial advisory firm with a legacy as one of the oldest independent investment banks, advising on mergers, acquisitions, and... more
  • 22 Days Ago

AI Assistant is available now!

Feel free to start your new journey!