What are the responsibilities and job description for the DATA ENGINEER - Overland Park, KS(Onsite) position at TechniPros, LLC?
Role: Data Engineer
Location: Overland Park, KS(Onsite)
Can do Only W2, No C2C
Job Description:
Experience Required: 10 Years
- We are looking for a skilled Data Engineer with strong experience in Azure, Databricks, and Snowflake.
- The candidate will be responsible for building and maintaining scalable data pipelines, optimizing data processing, and ensuring data quality and governance across enterprise platforms.
Key Responsibilities:
- Design, develop, and maintain large-scale data pipelines using Azure and Databricks.
- Work with Snowflake for data warehousing and data modeling.
- Develop and optimize PySpark and Spark-based data processing solutions.
- Ensure pipeline reliability through validation, deduplication, backfills, and idempotency handling.
- Implement data governance, PII handling, data lineage, and Unity Catalog standards.
- Perform performance tuning, troubleshooting, and optimization for Spark workloads.
- Collaborate with cross-functional teams to support scalable and secure data solutions.
- Monitor and improve data quality, compliance, and operational efficiency.
Required Skills:
- Strong experience with Azure services such as ADF and ADLS.
- Hands-on experience with Databricks, PySpark, and Spark optimization.
- Strong Snowflake experience including data modeling and warehousing.
- Excellent SQL coding and query optimization skills.
- Experience building scalable and governed enterprise data pipelines.
- Knowledge of data governance and pipeline monitoring.
Best Regards:
Peerbhi SK
Phone: 1
Email: