Generative AI Systems Architect

We are seeking a skilled Generative AI Platforms Architect to lead and define the architecture for our enterprise GenAI platform.

The role involves creating reference architectures, guardrails, and roadmaps to deliver scalable and secure AI solutions—including LLMs, agentic applications, and tool integrations—across multiple clouds. By collaborating with engineering, security, data governance, and product teams, the Architect will translate business goals into platform designs and actionable delivery plans, while mentoring engineers and advocating for best practices in LLMOps/ModelOps.

This position offers remote setup with the flexibility to work from any location in Georgia, whether it's your home, well-equipped offices in Tbilisi and Batumi or a coworking space in Kutaisi.

Responsibilities

• Design enterprise generative AI reference architectures, blueprints, and reusable patterns
• Define multi-cloud platform foundations addressing networking, identity, and secrets management
• Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies
• Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP)
• Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied
• Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques
• Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques
• Collaborate with cross-functional teams to align system requirements with strategic objectives

Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience
• 1 years in architecture roles involving cloud, data, or production Generative AI/LLM systems
• Knowledge of cloud platforms (Azure, AWS, GCP) and IaC tools (Terraform, Bicep, CDK, CloudFormation)
• Competency in containerization and orchestration technologies (Docker, Kubernetes), as well as API gateways/service meshes
• Proficiency in CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps)
• Understanding of Large Language Model (LLM) platforms like Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI
• Familiarity with security-by-design principles and compliance frameworks tailored to GenAI systems
• Advanced proficiency in English (B2 /C1)

We offer

• We connect like-minded people
  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55 countries
  • Corporate and social events
• We invest in your growth
  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning and Get Abstract
  • Free English classes with certified teachers
• We cover it all
  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Five trust days per year (sick leave without a medical certificate)
  • Benefits package (sports activities, a variety of stores and services)

EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow.