What are the responsibilities and job description for the GPU Systems Engineer, Mid-Level position at Jobright.ai?
Jobright is an AI-powered career platform that helps job seekers discover the top opportunities in the US. We are NOT a staffing agency. Jobright does not hire directly for these positions. We connect you with verified openings from employers you can trust.
Job Summary:
Hudson River Trading (HRT) is looking for GPU Systems Engineers to enhance their sophisticated HPC/AI research environment. The role involves designing and optimizing GPU compute clusters, troubleshooting performance issues, and automating system processes to support global trading operations.
Responsibilities:
• Design, build, and optimize large-scale distributed GPU compute clusters
• Identify and resolve GPU workloads’ performance bottlenecks across compute, storage, and networking layers
• Collaborate with research and development teams to profile, benchmark, and fine-tune GPU-based workloads
• Automate system deployment, monitoring, and troubleshooting across thousands of nodes
• Collaborate with research, and engineering teams to support evolving workloads
• Own critical infrastructure projects — from concept to implementation and support
• Test and deploy new hardware and software, and partner with vendors to resolve complex issues
Qualifications:
Required:
• 5 years of experience in large-scale Linux systems engineering in HPC, AI or distributed infrastructure roles.
• Extensive experience in Linux system installation, performance tuning, and troubleshooting
• Expertise in troubleshooting distributed GPU workloads
• Deep knowledge around GPU optimization and performance
• Proficiency in Python scripting and automation frameworks
• Comfortable diagnosing complex system issues at the hardware, OS, and network levels
• Strong communication and organizational skills; able to collaborate across diverse technical teams
• Thrive in fast-paced environments and excited by high-impact work
Preferred:
• CUDA or C/C experience is a plus
• Experience with NVIDIA technologies beyond CUDA, such as NCCL, GPUDirect RDMA, and NVLink
• Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef)
Company:
Hudson River Trading opertes as a multi-asset class quantitative trading firm. Founded in 2002, the company is headquartered in New York, New York, USA, with a team of 501-1000 employees. The company is currently Late Stage. Hudson River Trading has a track record of offering H1B sponsorships.
