Demo

Software Engineer III - AI/ML Deep Learning & GPU ML Serving

JPMorganChase
Palo Alto, CA Full Time
POSTED ON 4/18/2026
AVAILABLE BEFORE 5/27/2026
Job Description

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Banking team, you will be a key member of an agile team, designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across multiple technical areas, supporting the firm’s business objectives.

Job Responsibilities

  • Develop, test, and troubleshoot software solutions, applying creative approaches to solve technical challenges.
  • Write secure, high-quality production code and maintain algorithms integrated with firm systems.
  • Produce architecture and design artifacts for complex applications, ensuring alignment with design constraints.
  • Analyze and visualize large, diverse data sets to drive continuous improvement of applications and systems.
  • Identify and address hidden issues and patterns in data to enhance code quality and system architecture.
  • Collaborate with software engineering communities to explore and adopt new technologies.
  • Participate in system design and architecture discussions, focusing on reliability and scalability.
  • Optimize deep learning models for production inference, including quantization and batching.
  • Deploy and manage GPU workloads in Kubernetes environments.
  • Build scalable, low-latency systems using web services and APIs.
  • Partner with product and program management teams to deliver business-driven solutions.

Required Qualifications, Capabilities, And Skills

  • Formal training or certification on software engineering concepts and 3 years applied experience
  • Professional software development experience, with emphasis on ML systems.
  • Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar).
  • Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP).
  • Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server).
  • Experience deploying and managing GPU workloads in Kubernetes.
  • Familiarity with scalable, low-latency systems based on web services and APIs.
  • Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access.
  • Understanding of GPU resource management and cost optimization.
  • Experience with modern microservices architecture.
  • Ability to lead the design of large-scale systems and evaluate tradeoffs.

Preferred Qualifications, Capabilities, And Skills

  • MS/PhD in Computer Science, Machine Learning, or a related field.
  • Proficiency in Java
  • Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX).
  • Knowledge of GPU programming (CUDA) and performance optimization.
  • Experience with model monitoring, A/B testing, and ML observability tools.
  • Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker).
  • Experience serving large-scale models and optimizing for performance.

Federal Deposit Insurance Act

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries.

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

About The Team

J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.

Salary : $133,000 - $185,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Software Engineer III - AI/ML Deep Learning & GPU ML Serving?

Sign up to receive alerts about other jobs on the Software Engineer III - AI/ML Deep Learning & GPU ML Serving career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$97,257 - $120,701
Income Estimation: 
$123,167 - $152,295
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at JPMorganChase

  • JPMorganChase Pawtucket, RI
  • JOB DESCRIPTION At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and unde... more
  • 10 Days Ago

  • JPMorganChase Wilmington, DE
  • Job Description Shape the future of product delivery while crafting solutions that enhance and optimize customer experiences. Lead end-to-end processes, ma... more
  • 10 Days Ago

  • JPMorganChase Wilmington, DE
  • Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software ... more
  • 10 Days Ago

  • JPMorganChase Newark, DE
  • Job Description Are you ready to be at the forefront of digital payments? Join our Foreign Exchange Operations team specializing in payments validation & q... more
  • 10 Days Ago


Not the job you're looking for? Here are some other Software Engineer III - AI/ML Deep Learning & GPU ML Serving jobs in the Palo Alto, CA area that may be a better fit.

  • JPMorgan Chase Palo Alto, CA
  • Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Software Eng... more
  • 22 Days Ago

  • JPMorgan Chase Palo Alto, CA
  • Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Lead Softwar... more
  • 22 Days Ago

AI Assistant is available now!

Feel free to start your new journey!