Demo

Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving

JPMorgan Chase
Palo Alto, CA Full Time
POSTED ON 3/28/2026
AVAILABLE BEFORE 5/28/2026

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Banking team, you will play a pivotal role in an agile team, enhancing and delivering secure, stable, and scalable technology products. As a core technical contributor, you will drive critical technology solutions across multiple technical areas, supporting the firm’s business objectives.

Job Responsibilities

  • Lead the design, development, and troubleshooting of software solutions, applying innovative approaches to complex technical challenges.
  • Write secure, high-quality production code and maintain algorithms integrated with firm systems.
  • Produce architecture and design artifacts for advanced applications, ensuring compliance with design constraints.
  • Analyze and visualize large, diverse data sets to improve software applications and systems.
  • Identify and resolve hidden issues and patterns in data to enhance code quality and system architecture.
  • Collaborate with software engineering communities to explore and adopt emerging technologies.
  • Guide system design and architecture discussions, focusing on reliability and scalability.
  • Optimize deep learning models for production inference, including quantization and batching.
  • Deploy and manage GPU workloads in Kubernetes environments.
  • Build scalable, low-latency systems using web services and APIs.
  • Partner with product and program management teams to deliver business-driven solutions.

 

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 5 years applied experience
  • Professional software development experience, with emphasis on ML systems.
  • Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar).
  • Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP).
  • Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server).
  • Experience deploying and managing GPU workloads in Kubernetes.
  • Familiarity with scalable, low-latency systems based on web services and APIs.
  • Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access.
  • Understanding of GPU resource management and cost optimization.
  • Experience with modern microservices architecture.
  • Ability to lead the design of large-scale systems and evaluate tradeoffs.

 

Preferred qualifications, capabilities, and skills

  • MS/PhD in Computer Science, Machine Learning, or a related field.
  • Proficiency in Java, Python, Scala, or C .
  • Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX).
  • Knowledge of GPU programming (CUDA) and performance optimization.
  • Experience with model monitoring, A/B testing, and ML observability tools.
  • Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker).
  • Experience serving large-scale models and optimizing for performance.

 

FEDERAL DEPOSIT INSURANCE ACT:

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries.

 

Salary.com Estimation for Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving in Palo Alto, CA
$173,592 to $216,718
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving?

Sign up to receive alerts about other jobs on the Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at JPMorgan Chase

  • JPMorgan Chase Newark, DE
  • Step into a pivotal role at JPMorganChase, where your expertise in control management will shape our compliance and risk framework. Elevate your career wit... more
  • 10 Days Ago

  • JPMorgan Chase Albuquerque, NM
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 10 Days Ago

  • JPMorgan Chase Reno, NV
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 10 Days Ago

  • JPMorgan Chase Riverton, UT
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 10 Days Ago


Not the job you're looking for? Here are some other Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving jobs in the Palo Alto, CA area that may be a better fit.

  • JPMorganChase Palo Alto, CA
  • Job Description Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. A... more
  • 1 Day Ago

  • JPMorganChase Palo Alto, CA
  • Job Description Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. A... more
  • 1 Day Ago

AI Assistant is available now!

Feel free to start your new journey!