What are the responsibilities and job description for the Lead Data Engineer (AI & Data Platforms) position at Eleven Recruiting?
About Eleven Recruiting
We are a specialized technology staffing agency supporting professional and financial services companies. Why do we stand out in technology staffing? We listen and act as advisors for our candidates on how they can best add value, find interesting projects, and pave a path for career advancement. We advocate for the best pay, diversity in tech, and the best job fit for every candidate we place.
Our client, a leading investment firm, is seeking a Lead Data Engineer to join their team in El Segundo, CA!
The ideal candidate will design, build, and optimize scalable data platforms that support enterprise analytics, AI/ML initiatives, and data-driven decision making. This role partners with AI Engineers, Application Development teams, and business stakeholders to build secure, scalable, and governed data platforms that enable predictive analytics, intelligent automation, and AI-powered business solutions.
Responsibilities
- Design and build scalable enterprise data platforms using Snowflake, Azure, SQL, and Python.
- Lead architecture and implementation of cloud-based data warehouses and data lakes.
- Build and optimize ETL/ELT pipelines supporting analytics and AI workloads.
- Design data platforms that support Machine Learning, Artificial Intelligence, and Generative AI initiatives.
- Develop pipelines for structured and unstructured data used in AI model training, inference, and Retrieval-Augmented Generation (RAG).
- Collaborate with AI Engineers and Data Scientists to build feature stores, vector-ready datasets, and AI data pipelines.
- Implement secure, governed data architectures supporting responsible AI.
- Optimize Snowflake performance, scalability, and cost.
- Mentor engineers and establish best practices for data engineering and DevOps.
Qualifications
- 8 years of Data Engineering experience.
- 2 years leading technical teams or projects.
- Financial Services, Banking, Insurance, Asset Management, or FinTech experience.
- Expertise with Snowflake, SQL, Python, and Microsoft Azure.
- Experience building enterprise ETL/ELT pipelines.
- Experience supporting AI/ML data platforms and advanced analytics.
- Strong understanding of structured and unstructured data.
- Experience integrating APIs and cloud AI services.
- Excellent communication and leadership skills.
Salary: $150,000 - $180,000
Salary : $150,000 - $180,000