Lead Data Architect

Hi Folks,

Hope you are doing well!

Please find the below job description and share the updated resumes to

Title: Lead Data Architect (Migration & Pipeline Architecture) 

Work Location: Charlotte NC, Chandler AZ, Dallas TX (Locals)

Experience: 14 Years

Detailed Job Description:

Role Summary 

The Lead Data Engineer will be responsible for end‑to‑end data pipeline architecture, overseeing ingestion, transformation, validation, and migration of cybersecurity baseline data into MongoDB. 

Key Responsibilities 

·         Architect ingestion and migration pipelines using Python and/or Spark 

·         Design scalable pipelines for Excel, Word, JSON baseline sources 

·         Lead the implementation of data standardization and canonical alignment logic 

·         Define pipeline‑level quality checks, reconciliation mechanisms, and error handling 

·         Ensure performance‑optimized ingestion into MongoDB 

·         Implement lineage capture, auditability, and traceability 

·         Guide engineering team and enforce coding and deployment standards 

Skills 

·         Python, PySpark, Spark SQL 

·         MongoDB ingestion and performance tuning 

·         Data pipeline architecture & batch processing 

·         Data validation and reconciliation techniques 

·         Cloud‑scale data engineering patterns 

Experience 

·         10–14 years in data engineering 

·         Proven experience leading large‑scale data migrations and transformations