Senior AI Software Engineer

Title: Senior AI Software Engineer (Generative AI / AWS Bedrock)

Location: Reston, VA (3 days a week onsite)

Description

• We are seeking a Senior AI Software Engineer to design and build production-grade AI applications powered by large language models and foundation models. In this role, you will develop scalable commercial solutions using AWS Bedrock and other AI model providers, integrating advanced AI capabilities into real-world products and platforms.
• You will work at the intersection of AI engineering, cloud architecture, and product development, building intelligent systems that leverage multiple foundation models for reasoning, automation, and data-driven insights.
• This is a hands-on role for engineers passionate about transforming cutting-edge AI capabilities into robust, scalable commercial applications.
  
  

What You'll Do

Technology Stack and AI/LLM Programming Expertise

Hands-on experience with LLM APIs or foundation models

Experience Building

• RAG systems
• AI copilots
• conversational agents
• automated workflows
• AI-driven analytics
• document AI solutions
  
  

Python

Java / TypeScript / Go (any backend language)

Design and develop production AI applications using models available via AWS Bedrock and external providers

• AWS Bedrock
  
  

Anthropic Claude

Amazon Titan

Meta Llama

Cohere

OpenAI

• OpenAI
• Open-source LLMs
• S3, API Gateway, Step Functions, Lambda / ECS / EKS, Docker / Kubernetes
• FastAPI
• Terraform
  
  

Create Pipelines For

• embeddings
• document ingestion
• knowledge indexing
• model evaluation
  
  

Vector databases (pg-vector, S3-vector, OpenSearch, FAISS)

Embeddings and semantic search

Prompt engineering

Tracing, hallucination detection, cost monitoring, prompt performance, drift detection

Model evaluation frameworks

Experience with LangChain, LangGraph, LlamaIndex, or AI orchestration frameworks

LLM Monitoring and Observability

Experience with multi-model routing systems

Experience building AI agents or tool-using LLMs

Knowledge of AI safety, guardrails, and prompt management

Experience deploying models with Docker and Kubernetes

MCP, FastMCP

Reinforcement Learning

AWS SageMaker with MLOPs

Experience with Bedrock API [Like from Lambda or Other services]

Design high-performance AI APIs and microservices

Optimize latency, reliability, and cost of model inference

Implement evaluation pipelines and monitoring for AI systems

What We're Looking For

The Ideal Candidate

Thinks like a systems architect and builder

Has shipped real AI products to production

Understands tradeoffs between models

Can design robust AI pipelines

Is comfortable working with rapidly evolving AI technologies

Example Problems You'll Work On

Build an enterprise knowledge assistant using Bedrock

Create AI agents that automate complex workflows

Develop document intelligence pipelines for financial or operational data

Design multi-model orchestration frameworks

Optimize LLM cost, latency, and reliability

Experience

Required Qualifications

6 years software engineering experience

3 years building AI/ML-powered applications

Experience deploying AI systems into production

if interested please share profile to thulasiram@kmmtechnologies.com