Demo

Principle Software Engineer

JPMorgan Chase
Palo Alto, CA Full Time
POSTED ON 12/8/2025
AVAILABLE BEFORE 2/7/2026

ob Summary:

We are seeking a highly skilled and experienced Principal AI/ML and Gen AI Engineer to join our dynamic team at CCB COSMIC (CCB Operational Systems for Machine Intelligence and Cognition). The ideal candidate will possess a strong foundation in AWS, AI/ML, Databricks, and the Gen AI ecosystem. This role is primarily focused on scaling infrastructure and platforms from a serving and fine-tuning standpoint. The candidate should also have extensive experience in LLM Ops and the productionalization of Gen AI use cases.

 

Key Responsibilities:

  • Design, implement, and scale AI/ML infrastructure and platforms on AWS to support serving and fine-tuning of models.
  • Collaborate with cross-functional teams to ensure seamless integration and deployment of AI/ML solutions.
  • Develop and optimize machine learning models and algorithms to meet business objectives.
  • Stay updated with the latest advancements in AI/ML and Gen AI technologies and incorporate them into the organization's strategy.
  • Leverage Databricks for data processing, model training, and deployment.
  • Utilize Gen AI tools and frameworks to enhance model performance and capabilities.
  • Implement best practices for LLM Ops to ensure efficient model lifecycle management.
  • Lead the productionalization of Gen AI use cases, ensuring robust and scalable solutions.
  • Work closely with data scientists, engineers, and product teams to deliver AI-driven solutions.
  • Mentor and guide junior team members, fostering a culture of innovation and excellence.
  • Monitor the performance of AI/ML models and platforms, identifying areas for improvement.
  • Implement optimization techniques to enhance model accuracy, efficiency, and scalability.

 

Required qualifications, capabilities and skills:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Minimum 8 years of experience experience in AI/ML engineering, with a focus on AWS, Databricks, and Gen AI.
  • Strong understanding of AI/ML algorithms, model serving, and fine-tuning techniques.
  • Proven experience in LLM Ops and the productionalization of Gen AI use cases.
  • Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
  • Strong communication and leadership skills, with the ability to influence and drive change.

 

Preferred qualifications, capabilities and skills:

  • Experience with other cloud platforms and AI/ML tools.
  • Familiarity with data engineering and data science workflows.
  • Knowledge of regulatory and compliance requirements related to AI/ML solutions

Salary.com Estimation for Principle Software Engineer in Palo Alto, CA
$145,998 to $178,493
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Principle Software Engineer?

Sign up to receive alerts about other jobs on the Principle Software Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$77,900 - $95,589
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$179,606 - $233,815
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at JPMorgan Chase

  • JPMorgan Chase Wilmington, DE
  • Chase Card Services is seeking an experienced leader to drive customer and firm value within the Card Authorizations’ product. You will work closely with B... more
  • 13 Days Ago

  • JPMorgan Chase Wilmington, DE
  • We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III - Python/Agent... more
  • 13 Days Ago

  • JPMorgan Chase Wilmington, DE
  • As a Computational Linguist in the Machine Learning & Optimization team, you are an integral part of the group that optimizes features, models, and AI capa... more
  • 13 Days Ago

  • JPMorgan Chase Newark, DE
  • Join a team where your expertise in data governance will shape the future of data management at JPMorgan Chase. As part of the CIB Chief Data Office, you’l... more
  • 13 Days Ago


Not the job you're looking for? Here are some other Principle Software Engineer jobs in the Palo Alto, CA area that may be a better fit.

  • JPMorganChase Palo Alto, CA
  • Job Description ob Summary: We are seeking a highly skilled and experienced Principal AI/ML and Gen AI Engineer to join our dynamic team at CCB COSMIC (CCB... more
  • 17 Days Ago

  • hackajob Palo Alto, CA
  • hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role. Base Pay/SalaryPalo Alto,CA $204,250.00-$285,... more
  • 23 Days Ago

AI Assistant is available now!

Feel free to start your new journey!