Demo

Machine Learning Engineer (Training & Inference Systems)

Fintal Partners
York, NY Full Time
POSTED ON 7/26/2026
AVAILABLE BEFORE 8/24/2026

A leading global trading firm is building out its machine learning function and hiring engineers to develop the distributed training and inference systems that take models from research into production. This is the most urgent hire on a team that sits unusually close to the trading desk — you'll feel more like part of the trading floor than a traditional ML function.


What you'll do

  • Build and scale distributed training systems for large models
  • Develop low-latency inference pipelines to get models into production
  • Work directly with researchers training the models and the traders/quants relying on them
  • Operate on a rapidly growing GPU footprint (low thousands today, scaling into the tens of thousands over the next few years)


What we're looking for

  • Strong experience building training and/or inference infrastructure at scale
  • Deep PyTorch fluency and strong performance-engineering instincts
  • Distributed systems experience — multi-GPU/multi-node training, model serving
  • A track record of hands-on building (this is an IC-heavy role, not a strategy seat)
  • Background at a top tech firm, trading firm, or a strong big-tech startup combination
  • 3 years of relevant experience; flexible on level for the right person


Why it's exciting

  • Real impact, fast. Your systems directly enable production models that drive trading decisions — no research-to-nowhere, no shipping into a void.
  • Scale that's actually scaling. A GPU footprint growing 10x over the next two to three years, with the mandate and budget to match.
  • Proximity to the work that matters. You'll sit alongside researchers and traders, not three layers removed. Tight feedback loops, smart people, genuine ownership.
  • Top-of-market comp for engineers who can build at this level.

Salary : $500,000 - $1,500,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Engineer (Training & Inference Systems)?

Sign up to receive alerts about other jobs on the Machine Learning Engineer (Training & Inference Systems) career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Fintal Partners

  • Fintal Partners Chicago, IL
  • We're partnering with a leading proprietary trading firm that's looking to hire a Site Reliability Engineer to support and optimize the infrastructure powe... more
  • 8 Days Ago

  • Fintal Partners Chicago, IL
  • A market-leading high-frequency trading firm is building a next-generation AI infrastructure platform to support large-scale model training and ultra-low l... more
  • 8 Days Ago

  • Fintal Partners Chicago, IL
  • We're looking for a Platform Engineer to help build and scale the infrastructure that powers a high-performance trading environment. You'll work closely wi... more
  • 8 Days Ago

  • Fintal Partners Chicago, IL
  • We’re looking for a hands-on, entrepreneurial Senior Systems Engineer to join our Strategy Development team. This role sits at the intersection of infrastr... more
  • 8 Days Ago


Not the job you're looking for? Here are some other Machine Learning Engineer (Training & Inference Systems) jobs in the York, NY area that may be a better fit.

  • MeeBoss York, NY
  • We're hiring an ML Engineer to lead the modeling work with Kuddo and Stanford Medicine researchers! 🧠 🌲 You'll own the ML end-to-end: turning clinical fi... more
  • 2 Days Ago

  • Fireworks AI York, NY
  • About Us: At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and mo... more
  • 2 Days Ago

AI Assistant is available now!

Feel free to start your new journey!