Demo

Senior Software Engineer - AI Infra Visibility

Clockwork Systems, Inc.
Palo Alto, CA Full Time
POSTED ON 4/17/2026
AVAILABLE BEFORE 11/19/2026

About Clockwork Systems


Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization

Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.


To learn more, visit www.clockwork.io.


About The Role

We are looking for a strong Senior Software Engineer to help design and build scalable backend systems for AI and GPU cluster observability. In this role, you will work on high-performance distributed systems that power telemetry ingestion, data processing, and APIs for monitoring large-scale GPU clusters and AI workloads.


What You’ll Do

  • Design and build scalable backend systems for metric collection, processing, and analysis.
  • Develop robust methods to detect complex infrastructure issues that impact AI workloads.
  • Build large distributed systems running in production environments.
  • Collaborate across teams to deliver reliable, performant, and maintainable systems.


What We Are Looking For

  • 7 years of industry experience building and operating production software systems.
  • Strong foundation in data structures, algorithms, and software design.
  • Fluency in one or more programming languages: C, C , Go, Java, or Python.
  • Experience designing, building, and scaling large distributed systems.
  • Hands-on experience with service-oriented architectures and cloud platforms (AWS, GCP, Azure).
  • Solid understanding of operating systems fundamentals (threads, scheduling, synchronization; kernel programming is a plus).
  • Experience with databases, including design, development, or scaling.
  • Excellent debugging, problem-solving, and communication skills.


Nice to Have

  • Knowledge of networking protocols; familiarity with NIC architecture and operation.
  • Understanding of GPU or AI infrastructure (e.g., DCGM, PyTorch).
  • Familiarity with observability systems (metrics, logs, traces); experience with OpenTelemetry, Prometheus, or distributed tracing.


Enjoy

  • Challenging projects.
  • A friendly and inclusive workplace culture.
  • Competitive compensation.
  • A great benefits package.
  • Catered lunch.


Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $230,000. The offered compensation package may also include stock options or other equity awards, subject to Clockwork’s equity program and applicable approvals.


Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.

Salary : $150,000 - $230,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Senior Software Engineer - AI Infra Visibility jobs in the Palo Alto, CA area that may be a better fit.

  • roboforce Milpitas, CA
  • Why RoboForce RoboForce is an AI robotics company developing Physical AI–powered Robo-Labor for dull, dirty, and dangerous work. The company’s robots are e... more
  • 11 Days Ago

  • Hippocratic AI Palo Alto, CA
  • About Us Hippocratic AI is the leading generative AI company in healthcare. We have the only system that can have safe, autonomous, clinical conversations ... more
  • 11 Days Ago

AI Assistant is available now!

Feel free to start your new journey!