Demo

Senior Staff Infrastructure AI/ML RDMA RoCEv2 Engineer

Tara Technical Solutions (TTS)
San Jose, CA Full Time
POSTED ON 3/29/2026
AVAILABLE BEFORE 5/25/2026

Company Description

Tara Technical Solutions (TTS)


Is the Authorized Venfor for our Fortune 500 Client.


We are represting full-time-direct hires only.




Role Description

This is a full-time, on-site role located in San Jose, CA, for a Senior Staff Infrastructure AI/ML RDMA RoCEv2 Engineer. The responsibilities include designing, implementing, and optimizing RDMA (Remote Direct Memory Access) and RoCEv2 (RDMA over Converged Ethernet version 2) solutions for AI/ML infrastructure. The engineer will analyze system performance, troubleshoot issues, and collaborate with cross-functional teams to enhance scalability and efficiency. Additional responsibilities involve developing and deploying high-performance networking solutions to meet complex AI/ML workload demands.


Qualifications

  • Extensive experience with RDMA technologies and protocols, such as RoCEv2 and InfiniBand
  • Proficiency in programming languages including C, C , and Python
  • Strong expertise in AI/ML workflows and scalable distributed systems
  • Familiarity with HPC (High Performance Computing), GPUDirect technologies, or networking frameworks is a plus
  • Experience designing and debugging low-latency, high-bandwidth data communication frameworks
  • Excellent problem-solving skills and the ability to work collaboratively in cross-functional teams
  • Master's or Ph.D. in Computer Science, Electrical Engineering, or related field, or equivalent work experience

Salary.com Estimation for Senior Staff Infrastructure AI/ML RDMA RoCEv2 Engineer in San Jose, CA
$129,014 to $158,143
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Not the job you're looking for? Here are some other Senior Staff Infrastructure AI/ML RDMA RoCEv2 Engineer jobs in the San Jose, CA area that may be a better fit.

  • Latitude AI Palo Alto, CA
  • Latitude AI (lat.ai) develops automated driving technologies, including L3, for Ford vehicles at scale. We’re driven by the opportunity to reimagine what i... more
  • 13 Days Ago

  • Coupang Mountain View, CA
  • (This position is open to both Mountain View and Seattle Location) We exist to wow our customers. We know we’re doing the right thing when we hear our cust... more
  • 24 Days Ago

AI Assistant is available now!

Feel free to start your new journey!