Demo

AI/LLM SRE Lead Software Engineer

JPMorgan Chase
Columbus, OH Full Time
POSTED ON 4/29/2026
AVAILABLE BEFORE 6/29/2026

Job description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within the Employee Platforms team, you will be responsible for ensuring the reliability, scalability, and automation of AI-powered applications and infrastructure. You will partner with engineering, and other stakeholders to deliver modern observability, intelligent incident response, and autonomic operations across our applications.

Job responsibilities

  • Ensure reliability, scalability, and performance of AI-assisted application and platform operations.
  • Design and implement AI-driven solutions for intelligent alerting, noise reduction & auto-correlation systems.
  • Build and maintain observability, monitoring, and telemetry for AI application and platforms.
  • Build and support automation for alerting, anomaly detection, and self-healing workflows.
  • Collaborate with engineering, and other stakeholders to drive operational excellence.
  • Mentor and guide engineers on AIOps standards and operational excellence.
  • Define and execute the roadmap for AI-assisted SRE and observability.
     

Required qualifications, capabilities, and skills:

  • Formal training or certification on software engineering concepts and 5 years applied experience
  • Demonstrates strong experience in SRE, DevOps, or Platform Engineering roles.
  • Strong hands-on experience with AWS (ECS, Lambda, API Gateway, Bedrock, CloudWatch, RDS, EKS).
  • Hands-on experience with AWS Bedrock, OpenAI, or LLM APIs.
  • Expertise in observability tools: OpenTelemetry, Grafana, Prometheus, ELK, CloudWatch.
  • Experience with CI/CD tools (GitHub Actions, Jenkins, Spinnaker ).
  • Proven track record in automation, operational tooling, and event-driven workflows.
  • In-depth understanding of distributed systems, microservices, and cloud architectures.

Preferred qualifications, capabilities, and skills:

  • Experience with AI-powered coding assistants like GitHub Copilot, windsurf.  
  • Familiarity with prompt engineering, embeddings, and RAG pipelines.
  • Experience building operational copilots or chatbots for runbooks or troubleshooting.
  • Proficiency in Python (Go is a plus).

Salary.com Estimation for AI/LLM SRE Lead Software Engineer in Columbus, OH
$131,254 to $158,676
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI/LLM SRE Lead Software Engineer?

Sign up to receive alerts about other jobs on the AI/LLM SRE Lead Software Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at JPMorgan Chase

  • JPMorgan Chase South Burlington, VT
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 16 Days Ago

  • JPMorgan Chase Wilmington, DE
  • Join our team and make a significant impact through innovative content design and drive customer confidence and satisfaction. As a Content Design Senior As... more
  • 16 Days Ago

  • JPMorgan Chase Wilmington, DE
  • As a Sr Associate- Automation Testing / Selenium / Java Developer at JPMorgan Chase within the Credit Card Line of business you will be working on building... more
  • 16 Days Ago

  • JPMorgan Chase Wilmington, DE
  • Start your automation testing career and make a real impact by helping deliver quality credit card products. Join a supportive team where you can learn, gr... more
  • 16 Days Ago


Not the job you're looking for? Here are some other AI/LLM SRE Lead Software Engineer jobs in the Columbus, OH area that may be a better fit.

  • JPMorganChase Columbus, OH
  • Job Description Job description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As ... more
  • 19 Days Ago

  • hackajob Columbus, OH
  • hackajob is collaborating with J.P. Morgan to connect them with exceptional professionals for this role. Job Description Job description We have an opportu... more
  • 7 Days Ago

AI Assistant is available now!

Feel free to start your new journey!