Senior Software Engineer, Compute Platform

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Oscar Technology, is seeking the following. Apply via Dice today!

About The Company

A fast-growing, venture-backed startup is building a next-generation AI compute platform focused on decentralized, high-performance infrastructure. The company is rethinking how organizations access and scale compute by integrating global data centers into a unified, serverless platform.

Their mission is to democratize access to AI compute and provide an end-to-end lifecycle solution-from raw data to deployed models-through a combination of platform infrastructure and forward-deployed engineering.

With a global footprint and early traction, the team is tackling challenges across multi-cloud orchestration, GPU scheduling, and enterprise-grade infrastructure, with a strong focus on security and compliance.

The Role

This is a high-impact infrastructure role focused on designing and scaling distributed systems that power AI/ML workloads at scale.

You'll work across:

• Core platform architecture
• Multi-cloud compute orchestration
• Managed services development
• Customer-facing deployments
  
  

This role requires a strong mix of systems engineering product thinking, with exposure to both backend infrastructure and end-user experience.

What You'll Work On

< data-start="1448" data-end="1500">Compute Platform & Multi-Cloud Architecture

• Design abstraction layers across cloud providers (AWS, Google Cloud Platform, Azure, bare-metal)
• Build systems that unify compute, storage, and networking across environments
• Expand global compute capacity by integrating with cloud and data center providers
• Architect reusable, composable infrastructure components
  
  

< data-start="1807" data-end="1855">Managed Services & Platform Development

• Own services end-to-end (design deployment monitoring)
• Build orchestration systems for GPU workloads and container scheduling
• Develop APIs and control planes for provisioning, scaling, and lifecycle management
• Drive improvements in performance, reliability, and cost efficiency
  
  

< data-start="2147" data-end="2190">Infrastructure & Platform Services

• Build systems for billing, usage tracking, and cost attribution
• Develop observability tooling (metrics, logging, tracing)
• Establish engineering standards and best practices
• Mentor engineers and contribute to system design decisions
  
  

What They're Looking For

< data-start="2471" data-end="2497">Core Requirements

• 4 years building distributed systems, backend infrastructure, or cloud platforms
• Strong experience with AWS, Google Cloud Platform, or Azure
• Deep understanding of:
• Compute (VMs, instances)
• Storage (object, block, file systems)
• Networking (VPCs, load balancers, security groups)
• Experience with Kubernetes and container orchestration
• Strong programming skills (Golang preferred; Python/Rust a plus)
• Experience building APIs, control planes, or platform services
• Familiarity with databases (Postgres, Redis, etc.) and messaging systems (Kafka, RabbitMQ)
  
  

Nice to Have

• GPU orchestration or AI/ML infrastructure experience
• HPC or cluster management (Kubernetes, Slurm)
• Data engineering or large-scale ETL systems
• Systems-level programming (low-level infra, operators, daemons)
• ML platform engineering (training/inference pipelines)
• Experience deploying into enterprise or on-prem environments
  
  

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.