What are the responsibilities and job description for the AI Cloud Engineer position at Haystack?
AI Cloud Engineer | Raleigh, North Carolina | Hybrid
We're working with a leading Nasdaq-listed fintech powerhouse dedicated to revolutionizing the American dream of homeownership through intelligent mortgage solutions. We are looking for an AWS expert to bridge the gap between Data Science and Production, building robust GenAI platforms that scale.
As an AI Cloud Engineer, you will design, build, and operate enterprise-grade AI solutions on AWS, leveraging cutting-edge tools like Bedrock and Claude to operationalize GenAI at scale. You’ll thrive in an environment that prioritizes automation via Terraform and CI/CD, working alongside elite data teams to deliver high-impact, secure infrastructure.
The Role
We're working with a leading Nasdaq-listed fintech powerhouse dedicated to revolutionizing the American dream of homeownership through intelligent mortgage solutions. We are looking for an AWS expert to bridge the gap between Data Science and Production, building robust GenAI platforms that scale.
As an AI Cloud Engineer, you will design, build, and operate enterprise-grade AI solutions on AWS, leveraging cutting-edge tools like Bedrock and Claude to operationalize GenAI at scale. You’ll thrive in an environment that prioritizes automation via Terraform and CI/CD, working alongside elite data teams to deliver high-impact, secure infrastructure.
The Role
- Lead GenAI Platform Enablement by building scalable, enterprise-grade environments using AWS Bedrock and advanced LLMs like Anthropic Claude.
- Engineer secure, governed GenAI patterns across the business, leveraging AWS foundations including ECR, ECS, Lambda, and API Gateway.
- Implement end-to-end Observability and Quality metrics, establishing SLO/SLAs and robust monitoring via CloudWatch for model performance and costs.
- Automate everything using Infrastructure as Code (Terraform) and advanced CI/CD pipelines (CodeBuild, GitHub Actions) for blue/green and canary model deployments.
- Drive governance and risk mitigation by enforcing model lineage, reproducibility, and RBAC to ensure compliance in a highly regulated financial environment.
- 5 years of deep AWS expertise: Hands-on experience with ECS, Lambda, S3, Glue, Athena, RDS, and Bedrock infrastructure.
- 5 years of CI/CD mastery: Proven track record with CodePipeline or GitLab/GitHub Actions for automating deployments of models and services.
- 3 years of IaC & Scripting: Professional experience with Terraform (parameterized modules), Python, Docker, and Bash for cloud orchestration.
- Proven background in an "Operational Mindset": Experience with incident response, runbooks, and debugging across data and infrastructure layers.
- Strong focus on security: Familiarity with WAF, IAM, encryption, and implementing governance in regulated industries (SOC2/HIPAA).
- Modern Hybrid Flexibility: 3 days in-office (Tues-Thurs) at a premier Raleigh HQ with an onsite gym.
- High-Impact Rewards: Competitive 401k with 5% employer match, generous PTO, and 40 hours of paid volunteer time.
- Total Wellbeing: Fitness and emotional wellness reimbursements, plus paid family leave and flexible spending accounts.
- Career Growth: Comprehensive tuition reimbursement and student loan repayment programs to fuel your professional journey.