What are the responsibilities and job description for the AI Data Engineer position at Pebal Bright Technologies LLC?
Senior AI Data Engineer
Location: Princeton, NJ / NYC, NY – Hybrid
Type: Full-Time
We are looking for a Senior AI Data Engineer with strong expertise in Python, Databricks, Spark, AI/ML data pipelines, and ML lifecycle management.
Must Have:
10 years of experience in Data Engineering, with strong AI/ML exposure.
Advanced Python, SQL, Databricks & Apache Spark experience.
Experience building ML/AI data pipelines, feature engineering, and data preprocessing.
Hands-on experience with MLflow, model tracking, versioning, and model registry.
Experience with AI model monitoring, data lineage, and data quality.
Experience with MCP servers / Model Context Protocol and AI data distribution.
Knowledge of vector databases, embeddings, and similarity search.
Strong understanding of AI/ML lifecycle, governance, and security.
GenAI experience with RAG, LangChain, or Hugging Face is a plus.