What are the responsibilities and job description for the Site Reliability Engineer, AI/ML Infrastructure position at Boson AI?
About The RoleWe're looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale.ResponsibilitiesManage and optimize HPC cluster operationsDeploy and maintain infrastructure-as-code solutionsSupport ML/research teams with cluster usage optimizationOperate, troubleshoot and optimize Ceph storage clusters.Develop automation and toolingMinimum Qualifications5 years of experience in SRE or HPC operations.Proficiency in Linux systems administration (Ubuntu/Debian).Experience with Kubernetes and container orchestrationExperience with Ceph >1PB deployments and maintenanceKnowledge of security best practices in multi-tenant environments.Understanding of L2/L3 networking fundamentalsSkilled in Python and Bash scripting.Preferred QualificationsExperience with infrastructure-as-code tools (Ansible/Terraform).Experience with GitOps (Helm, ArgoCD).Strong grasp of RDMA, InfiniBand, and GPUDirect technologiesFamiliarity with deep learning frameworks such as PyTorch and TensorFlow.Familiarity in at least one cloud platform: AWS, Azure or GCP.If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.