What are the responsibilities and job description for the Data Solution Architect position at TECHNEPTUNE CONSULTING INC?
Primary (Must Have) Skills
- 10 years of experience in Data Engineering, Data Integration, or Data Platform delivery.
- Strong hands-on experience with Databricks on AWS.
- Expertise in Apache Spark, PySpark, Delta Lake, and Lakehouse architecture.
- Experience designing and implementing enterprise-scale data pipelines.
- Strong understanding of AWS services such as S3, Glue, Lambda, Redshift, IAM, and CloudWatch.
- Hands-on experience with MDM implementations and integrations.
- Experience with data quality, data governance, lineage, and master data management processes.
- Strong experience integrating enterprise systems using middleware platforms such as MuleSoft, Boomi, Kafka, or API-based integrations.
- Experience working with structured, semi-structured, and unstructured datasets.
- Strong SQL and Python development skills.
- Experience with Agile delivery methodologies and DevOps practices.
- Experience leading distributed teams and managing stakeholder communications.