What are the responsibilities and job description for the Senior Data Engineer (Agentic AI / RAG Platform) - Onsite - FORD- Locals Only position at MeganSoft?
Senior Data Engineer (Agentic AI / RAG Platform) - Onsite
Experience: 10-15 Years
Location: Onsite
Job Summary
We are looking for a Senior Data Engineer to build advanced AI-ready data platforms, integrating new data sources into VESSEL, enabling vectorization, and creating data foundations for Agentic AI, Retrieval-Augmented Generation (RAG), and intelligent agents.
Key Responsibilities
- Integrate structured and unstructured data sources into VESSEL.
- Design and implement data ingestion pipelines.
- Create vectorized data repositories for AI applications.
- Develop semantic search and knowledge retrieval frameworks.
- Build data services supporting AI agents and prompt engineering.
- Design scalable cloud-native data platforms.
- Optimize data quality, governance, and performance.
Required Skills
- 10 years of experience in Data Engineering.
- Strong expertise in Python, Spark, SQL, and data processing frameworks.
- Experience building cloud-native data pipelines.
- Deep understanding of vector databases and embeddings.
- Experience with Retrieval-Augmented Generation (RAG).
- Knowledge of Agentic AI architectures.
- Experience designing metadata-driven data solutions.
Preferred Skills
- Experience with Azure OpenAI, Vertex AI, LangChain, or similar frameworks.
- Knowledge of MCP (Model Context Protocol).
- Automotive, engineering, or manufacturing data experience