What are the responsibilities and job description for the Senior Staff Software Engineer position at Xcede?
Senior Staff Engineer – AI ADC
A Leading Provider of Secure Application Delivery and Cloud Networking Solutions are building the next generation of AI-driven network infrastructure. We’re looking for a Senior Staff Engineer to help define and lead it. You would be operating at the intersection of high-performance networking and AI/ML systems, this is an opportunity to shape how intelligent traffic flows at global scale.
You'll architect AI-aware traffic systems by designing intelligent routing for LLM workloads, including inference-aware load balancing and adaptive request steering. Working at Layer 8, you'll drive context-aware decisioning using tokens, latency signals, and behavioral telemetry to enable smarter, more responsive infrastructure.
A core part of the role involves advancing next-generation ADC and GSLB platforms, building capabilities optimized for AI workloads across distributed, globally scaled environments. You'll also integrate ML systems directly into the network fabric — connecting vector databases, model registries, and observability pipelines into real-time decision loops.
What You Bring
- Deep expertise in L4–L7 networking (TCP, TLS, HTTP/2 & 3, QUIC) and modern load balancing architectures
- Strong programming skills in:
- C/C (high-performance data plane)
- Go and/or Python (control plane, ML integration)
- Hands-on experience with LLMs and inference pipelines, including token dynamics and multi-model orchestration
- Applied ML experience (e.g., anomaly detection, time-series analysis, or predictive systems) using frameworks like PyTorch or TensorFlow
- Advanced degree (MS or PhD) in Computer Science, Networking, or a related field (or equivalent experience)
Salary : $190,000 - $210,000