Demo

Machine Learning Architect

Ayo Semiconductor
Boston, MA Full Time
POSTED ON 6/4/2026
AVAILABLE BEFORE 7/3/2026
About Ayo

We are a venture-backed early-stage startup developing processors specialized for machine learning. The processor will provide orders or magnitude improvement in speed and power efficiency with a goal of unseating the GPU as the dominant computing platform for AI.

The Role

We are seeking a deep ML practitioner to join as a founding team member - someone with hands-on experience working on or alongside a foundation model at scale, who understands what happens under the hood when splitting jobs across thousands of GPUs, and who is excited to bring that depth to novel hardware. They have a full-stack understanding of machine learning architectures, love to optimize algorithms across disciplinary boundaries, and will deploy and train models directly on our prototype chips to help us prove out what our processor can do - no prior hardware experience required.

What You’ll Do:

  • Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on our chips.
  • Develop and adapt algorithms to train models on novel processing environments, including our prototype hardware.
  • Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.
  • Maintain a deep curiosity about what makes machine learning systems work - and bring that curiosity to bear on how they run on new hardware.
  • Support go-to-market strategy development

What We’re Looking For:

  • PhD in machine learning, representation learning, theory of computation, or a related field - or equivalent industry experience working on foundation models at scale.
  • Experience training models at scale - distributed training across many GPUs, working with large datasets and compute.
  • Has built and trained neural networks from scratch
  • Deep knowledge of the structure and internal operation of neural networks - including how and why they behave the way they do (e.g. interpretability or explainability work is a plus).
  • Excitement about applying deep AI expertise to new and novel hardware environments - you don’t need prior experience with photonics or silicon, but you want to learn.
  • Fluent knowledge of Python
  • Fluency in PyTorch (preferred), TensorFlow, JAX, or other industry-standard ML software libraries

Why Ayo

  • You'll be a founding AI team member - shaping how we think about and deploy AI as a company.
  • We are working on a genuinely hard and interesting problem: unseating the GPU as the dominant AI compute platform.
  • Early-stage means real ownership, real impact, and meaningful equity.
  • Competitive salary. Equity commensurate with stage and seniority. Benefits package including health, dental, and vision.
  • Fully onsite in Boston - we are a collaborative, in-person team.

Salary.com Estimation for Machine Learning Architect in Boston, MA
$137,587 to $165,763
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Machine Learning Architect?

Sign up to receive alerts about other jobs on the Machine Learning Architect career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$123,167 - $152,295
Income Estimation: 
$146,673 - $180,130
Income Estimation: 
$89,966 - $112,616
Income Estimation: 
$118,163 - $145,996
Income Estimation: 
$120,777 - $151,022
Income Estimation: 
$129,363 - $167,316
Income Estimation: 
$86,891 - $130,303
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Ayo Semiconductor

  • Ayo Semiconductor Boston, MA
  • About Ayo Ayo is a venture-backed early-stage startup that will radically redefine how humanity performs compute for AI. Our photonic processors will provi... more
  • 1 Day Ago

  • Ayo Semiconductor Boston, MA
  • About Ayo We are a venture-backed early-stage startup developing processors specialized for machine learning. The processor will provide orders or magnitud... more
  • 1 Day Ago

  • Ayo Semiconductor Boston, MA
  • About Ayo Ayo is a venture-backed early-stage startup that will radically redefine how humanity performs computing for AI. Our photonic processors will pro... more
  • 1 Day Ago

  • Ayo Semiconductor Boston, MA
  • Ayo is a venture-backed early-stage startup that will radically re-define how humanity performs compute for AI. Our photonic processors will provide orders... more
  • 1 Day Ago


Not the job you're looking for? Here are some other Machine Learning Architect jobs in the Boston, MA area that may be a better fit.

  • CD PROJEKT RED Boston, MA
  • Company Description To create revolutionary, story-driven RPGs which go straight to the hearts of gamers — this is our mission. Want to dive deeper into ou... more
  • 2 Months Ago

  • Eka Robotics Cambridge, MA
  • Eka Robotics Eka Robotics is on a mission to build intelligence for the physical world - robots that are fast, general, and reliable. Our approach, grounde... more
  • 9 Days Ago

AI Assistant is available now!

Feel free to start your new journey!