Demo

Senior Machine Learning Systems Engineer

Jobs via Dice
Toronto, OH Full Time
POSTED ON 4/4/2026
AVAILABLE BEFORE 5/2/2026
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Openmind Technologies, is seeking the following. Apply via Dice today!

Our client is seeking a Senior ML Systems Engineer contractor to bridge the gap between model development and production. Kindly find the detailed job description below, if interested apply with your updated resume and contact info.

  • Note: This is an Engineering role, not a Data Science role. Our Data Science team provides the validated models and LLM prompts.

Your mission is to build the high-throughput, agentic pipelines required to process millions of historical documents. You will focus on transforming ML prototypes into scalable, cost-optimized, and resilient production systems on AWS infrastructure.

Title: Senior ML Systems Engineer

Location: Remote (Near shore to US)

Duration : 12 months

Key Responsibilities:

  • Production Pipeline Engineering: Build and maintain scalable data pipelines that execute agentic workflows for entity extraction.
  • Model Orchestration: Deploy and manage infrastructure for both open-source LLMs (on EC2) and third-party APIs, focusing on maximum throughput and reliability.
  • Systems Optimization: Continuously optimize pipelines for **unit cost and processing speed** without compromising data integrity.
  • Engineering Partnership: Act as a primary engineering contact for the Data Science team, operationalizing their trained models and prompt logic.
  • Observability & Reliability: Implement advanced monitoring, alerting, and automated error-handling/retry logic for complex ML workflows.
  • Infrastructure as Code: Manage the AWS ecosystem (EC2, Lambda, S3, IAM) supporting the ML lifecycle.

Required Technical Skills:

  • Python (Systems Level): Advanced proficiency in building robust, multi-threaded, or asynchronous applications.
  • Infrastructure as Code (IaC): Proficiency with **Terraform** or similar tools (e.g., Pulumi, CloudFormation) for provisioning and managing modular, version-controlled AWS infrastructure.
  • AWS Infrastructure: Deep expertise in **EC2 Auto Scaling Groups**, **Lambda** orchestration, and **S3** data lakes.
  • Agentic Orchestration: Experience building autonomous AI workflows using **AWS Agent Core** or similar frameworks.
  • Operational Excellence: Proven track record in production monitoring (CloudWatch), logging, and troubleshooting distributed systems.
  • Security: Strong grasp of AWS IAM for secure resource management.

Required Logistics: Able to work during US business hours for collaboration and production support.

Preferred Qualifications:

  • MLOps Focus: Experience with CI/CD for ML, containerization (Docker), and automated testing of data pipelines.
  • High-Volume Processing: Experience with OCR or document digitization at scale.
  • Throughput Tuning: Experience managing rate limits and costs across multiple LLM providers.

What You''''''''ll Work On

  • The Engine: Building the core machinery that digitizes and analyzes vast historical archives.
  • Scale: Moving from proof of concept to processing thousands of documents concurrently.
  • Resiliency: Building systems that can gracefully handle API outages, model timeouts, and malformed data.

Impact:

Your work will unlock valuable insights from historical archives, making previously inaccessible information searchable and analyzable for researchers, historians, and institutions worldwide.

We are an Equal Opportunity Employer

Salary.com Estimation for Senior Machine Learning Systems Engineer in Toronto, OH
$104,231 to $134,260
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Senior Machine Learning Systems Engineer?

Sign up to receive alerts about other jobs on the Senior Machine Learning Systems Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$119,030 - $151,900
Income Estimation: 
$149,493 - $192,976
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Jobs via Dice

  • Jobs via Dice Sheridan, WY
  • Dice is the leading career destination for tech experts at every stage of their careers. Our client, Varmoda Tech LLC, is seeking the following. Apply via ... more
  • 10 Days Ago

  • Jobs via Dice Alaska, AK
  • job summary: Enterprise Healthcare client has an immediate opening for a highly motivated Project Manager III to join their dynamic and growing team. All q... more
  • 10 Days Ago

  • Jobs via Dice Burlington, VT
  • Desktop Deployment Technician (Part-Time - 20 Hours a week) (Contract Role) Overview We are seeking a Desktop Deployment Technician to support a large-scal... more
  • 10 Days Ago

  • Jobs via Dice Georgia, VT
  • Dice is the leading career destination for tech experts at every stage of their careers. Our client, AaraTechnologies Inc, is seeking the following. Apply ... more
  • 10 Days Ago


Not the job you're looking for? Here are some other Senior Machine Learning Systems Engineer jobs in the Toronto, OH area that may be a better fit.

  • Jobs via Dice Toronto, OH
  • Dice is the leading career destination for tech experts at every stage of their careers. Our client, Rivago infotech inc, is seeking the following. Apply v... more
  • 15 Days Ago

  • Ellwood Crankshaft & Machine Sharon, PA
  • Ellwood Crankshaft Group is the world's leading manufacturer of large, one-of-a-kind, multiple-throw crankshafts. ECG's products and services include c ran... more
  • 16 Days Ago

AI Assistant is available now!

Feel free to start your new journey!