What are the responsibilities and job description for the Manager, Engineering - Inference Engine (CUDA), Mid-Level position at Jobright.ai?
Jobright is an AI-powered career platform that helps job seekers discover the top opportunities in the US. We are NOT a staffing agency. Jobright does not hire directly for these positions. We connect you with verified openings from employers you can trust.
Job Summary:
Torc provides L4 end-to-end self-driving software for mobility, trucking, mining, and defense markets through strategic partnerships. They are looking for a technically strong and people-focused leader to guide the Inference Engine team, ensuring the development of GPU-based inference middleware for autonomous driving systems and fostering a high-performing, collaborative environment.
Responsibilities:
• Lead a team of engineers developing GPU-based inference middleware for autonomous driving systems.
• Drive technical execution across key focus areas: model conversion pipelines (PyTorch, ONNX, TensorRT), GPU resource management, memory optimization, PCIe data transport, real-time data recording, and signal processing.
• Ensure reliable, deterministic, and scalable inference performance across multi-sensor systems in production environments.
• Partner cross-functionally with engineering teams across Perception, Planning, Systems, Validation, Hardware, and Safety.
• Build, coach, and mentor a growing team of highly skilled engineers.
• Manage team execution, career development, and professional growth while balancing short-term delivery with long-term roadmap goals.
• Establish scalable processes that enable safe, validated, and efficient software development in a safety-critical environment.
Qualifications:
Required:
• Bachelor’s or Master’s degree in Electrical Engineering, Computer Engineering, Robotics, or a related technical field.
• 3 years of full-cycle people management experience.
• Extensive experience with PyTorch, ONNX, TensorRT, CUDA, and GPU-based neural network inference.
• Strong proficiency in C with a deep understanding of real-time systems and parallel processing.
• Experience with NVIDIA DriveOS and Linux-based development.
• Demonstrated leadership managing software development teams in technically complex environments.
• Strong understanding of system-level software integration, safety-critical design, and cross-functional collaboration.
• Experience with safety standards and certification processes for automotive or regulated industries.
• Comfortable working in a fast-paced Agile development environment.
Preferred:
• Hands-on leadership style — willing to engage directly in technical discussions and design reviews.
• Experience building real-time inference platforms for production autonomous vehicle systems.
• Familiarity with ISO 26262, ASPICE, or other automotive safety standards.
• Experience with large-scale data recording pipelines and multi-sensor fusion processing.
Company:
Torc provides L4 end-to-end self-driving software for mobility, trucking, mining, and defense markets through strategic partnerships Founded in 2005, the company is headquartered in Blacksburg, Virginia, USA, with a team of 501-1000 employees. The company is currently Late Stage. Torc Robotics has a track record of offering H1B sponsorships.
