Demo

Generative AI - Senior Associate

JPMorgan Chase
York, NY Full Time
POSTED ON 4/2/2026
AVAILABLE BEFORE 6/1/2026

Generative artificial intelligence is transforming how we build products, serve clients, and operate at scale. In the Chief Data and Analytics Office, you will help turn advanced models into dependable, secure, and high-performing production services. You will work with partners across machine learning, cloud engineering, and site reliability engineering to deliver solutions with clear return on investment. If you enjoy hands-on engineering, real-world constraints, and high-impact delivery, this role is for you.

As a Senior Associate, Generative AI Engineer in the Chief Data and Analytics Office, you will help design, build, and support production generative artificial intelligence products and reusable backend application programming interfaces used across the firm. You will combine large enterprise datasets with large language and multimodal models to deliver scalable, measurable solutions. You will collaborate closely with machine learning, cloud engineering, and site reliability engineering partners to ensure reliability, performance, and strong operational controls. You will contribute to technical design decisions, delivery planning, and continuous improvement of our platforms and products.

 

Job responsibilities 

  • Build and operate production generative artificial intelligence services and reusable backend application programming interfaces for firmwide use
  • Combine enterprise data assets with large language and multimodal models to deliver high-quality user experiences
  • Design scalable architectures with clear interfaces and separation of concerns to enable broader developer adoption
  • Implement batch and real-time processing patterns to support high-throughput, low-latency use cases
  • Collaborate with cloud engineering and site reliability engineering partners to deliver resilient, observable systems
  • Translate research concepts into production-ready software through experimentation, evaluation, and iterative hardening
  • Optimize system performance, scalability, and cost across inference, storage, and compute
  • Define and track measurable outcomes, including objectives and key results aligned to business needs
  • Ensure responsible artificial intelligence practices, controls, and governance are embedded into delivery and operations
  • Troubleshoot production issues, drive root-cause analysis, and implement preventative improvements

 

Required qualifications, capabilities, and skills 

  • PhD in a quantitative discipline such as Computer Science, Mathematics, or Statistics, or equivalent practical experience
  • 3 years of experience as an individual contributor in machine learning engineering or applied machine learning software engineering
  • Demonstrated experience delivering production machine learning services in an enterprise environment, including being accountable for service health
  • Strong fundamentals in statistics, optimization, and machine learning theory with applied depth in natural language processing and/or computer vision
  • Hands-on experience building distributed, multi-threaded, and scalable systems (for example Ray, Horovod, or DeepSpeed)
  • Strong software engineering fundamentals, including data structures, algorithms, and software development lifecycle best practices
  • Experience designing and delivering service-oriented systems and application programming interfaces with scalability and performance requirements
  • Ability to define success metrics and write clear objectives and key results aligned to business expectations
  • Strong problem-framing skills to align machine learning solutions to business objectives and constraints
  • Excellent communication skills with the ability to influence and build trust across technical and non-technical stakeholders

 

Preferred qualifications, capabilities, and skills 

  • Experience designing and implementing pipeline workflows using directed acyclic graph frameworks (for example Kubeflow, DVC, or Ray)
  • Experience building batch and streaming microservices exposed via gRPC and/or GraphQL
  • Demonstrable experience with parameter-efficient fine-tuning, quantization, and quantization-aware fine-tuning for large language models
  • Experience with advanced prompting strategies such as chain-of-thought, tree-of-thought, or graph-of-thought approaches
  • Experience with multimodal large language model use cases (text plus image, speech, or video)
  • Experience partnering closely with cloud engineering and site reliability engineering teams on production readiness and operations
  • Experience measuring and improving model quality using offline evaluation and production monitoring

#LI-RB3

Salary.com Estimation for Generative AI - Senior Associate in York, NY
$144,154 to $186,279
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Generative AI - Senior Associate?

Sign up to receive alerts about other jobs on the Generative AI - Senior Associate career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at JPMorgan Chase

  • JPMorgan Chase Newark, DE
  • Step into a pivotal role at JPMorganChase, where your expertise in control management will shape our compliance and risk framework. Elevate your career wit... more
  • 10 Days Ago

  • JPMorgan Chase Albuquerque, NM
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 10 Days Ago

  • JPMorgan Chase Reno, NV
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 10 Days Ago

  • JPMorgan Chase Riverton, UT
  • At Chase, we are passionate about creating memorable experiences for our clients and employees, making them feel welcomed, valued, and understood. We build... more
  • 10 Days Ago


Not the job you're looking for? Here are some other Generative AI - Senior Associate jobs in the York, NY area that may be a better fit.

  • Sixth Street York, NY
  • The Role This is a full-time role based in New York, NY or San Francisco, CA. We are seeking a strategic and entrepreneurial Product Manager to drive the v... more
  • 1 Day Ago

  • VBeyond Corporation York, NY
  • Senior Generative AI Architect New York City, NY Full-Time Permanent Job Description: We are seeking a Senior Generative AI Architect to define build and s... more
  • 5 Days Ago

AI Assistant is available now!

Feel free to start your new journey!