Machine Learning Engineer - Perception, Associate

Job Summary:

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. The role involves building sensor fusion models for detecting agents around the robot and enhancing the vision backbone of the detector to improve navigation in complex environments.

Responsibilities:

• Train and upgrade current image backbone by performing various studies into incorporating SOTA approaches to be multi-frame, even higher resolution and using large foundational, language-aligned feature encoder

• Deploy temporal image backbone into on-vehicle inference architecture and optimize runtime compute resource;

• Incorporate temporal information into the existing Zoox’s multi-sensor (Vision, Lidar and Radar) early fusion system to predict object velocity and scene flow

• Develop effective metrics and evaluating algorithm performance with these metrics to demonstrate improvement.

• Collaborate with teams such as ML Optimization, Data Labeling, V&V/Metrics and Planner/Prediction to ensure project is successful for Zoox releases

Qualifications:

Required:

• Master's degree or PhD in computer science or related field

• Experience with Vision Language Model or multi-modal 3D foundation model.

• Experience with Python and/or C

• Experience with model deployment with TensorRT

• Proficient in PyTorch model design, implementation, training and evaluation.

Preferred:

• GPU/CUDA programming experience

• Experience with customized TRT plugin development

• Experience working with LiDAR, Camera and Radar data

Company:

Zoox is an AI robotics company that provides mobility-as-a-service and self-driving car services. It is a sub-organization of Amazon. Founded in 2014, the company is headquartered in Foster City, California, USA, with a team of 1001-5000 employees. The company is currently Late Stage. Zoox has a track record of offering H1B sponsorships.