What are the responsibilities and job description for the Forward Deployed Engineer (FDE) position at ConglomerateIT?
Job Title: Forward Deployed Engineer (AI Systems)
Location: Remote
About the Role
We're looking for an engineer who lives in the code - someone who can architect, ship, and operate AI-first systems inside large enterprise environments. You'll be building agent-driven workflows from the ground up, wiring together modern AI platforms, and standing up cloud-native solutions built to scale in production.
What You Bring
Must-Have
- 8 10 years building software professionally
- Deep background in cloud-native engineering - APIs, microservices, containerized workloads, serverless
- Proven track record shipping AI/LLM systems to production, including agents, RAG pipelines, and orchestration layers
- Strong command of Python, Java, or a comparable backend language
- Working fluency with CI/CD pipelines, infrastructure as code, and observability/monitoring stacks
Nice-to-Have
- Hands-on time with agent frameworks such as LangGraph, AutoGen, or CrewAI
- Experience designing multi-agent or distributed AI architectures
- Background integrating systems at enterprise scale
- Track record tuning AI workloads for cost efficiency and speed
- Direct experience with platforms like OpenAI, Claude, or Vertex AI
What You'll Do
Platform & Model Integration
- Connect applications to AI providers including OpenAI, Anthropic, Google Vertex, and open-source models
- Architect abstraction layers that support multi-model, multi-provider setups
- Tune model consumption to balance latency, cost, and output quality
Application Engineering
- Ship AI-powered applications mapped directly to real business workflows
- Embed AI capabilities into existing enterprise platforms and API ecosystems
- Stand up backend services and APIs that power agent-driven processes
Agent Development
- Build and deploy AI agents covering retrieval (RAG), orchestration workflows, tool/function invocation, and policy-based routing
- Create evaluation frameworks measuring accuracy, latency, and reliability
- Instrument observability and monitoring across the full agent lifecycle
Cloud-Native Engineering
- Develop scalable services on microservices architecture, containers (Docker, Kubernetes), and serverless/event-driven patterns
- Own CI/CD pipelines and infrastructure as code using Terraform and Helm
- Harden systems for production - logging, monitoring, fault tolerance
Performance & Optimization
- Benchmark systems across latency, throughput, accuracy, and cost
- Diagnose and resolve issues in live production environments
Role Expectations
This is a 100% individual-contributor engineering position - no people management. You'll deliver production-quality code, operate within established architecture and engineering standards, partner with client-side and internal engineering teams, and contribute to implementation-focused technical design conversations.
Founded in 2014, is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.
ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.