What are the responsibilities and job description for the Data Engineer - Local to Plano, TX ( ONLY W2) position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Maven Companies, is seeking the following. Apply via Dice today!
Job Title: Data Engineer
Key Skills: Power BI, Azure Data Bricks, Python
Plano, TX- In person only no remote
Job Summary: We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion, transformation and management.
Responsibilities:
Job Title: Data Engineer
Key Skills: Power BI, Azure Data Bricks, Python
Plano, TX- In person only no remote
Job Summary: We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion, transformation and management.
Responsibilities:
- Design, develop, and maintain end-to-end data pipelines using data ingestion tools and Azure Databricks
- Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs, databases, files, cloud storage)
- Build and optimize data transformation logic using Spark (Databricks), SQL, and Python
- Develop and maintain data models supporting analytics, reporting, and machine learning use cases
- Collaborate with analytics teams to enable Power BI datasets and reporting solutions
- Ensure data quality, reliability, and consistency through validation frameworks and monitoring
- Optimize performance of pipelines, storage, and compute resources in Azure
- Implement data governance practices, including lineage, cataloging, and documentation
- Support CI/CD deployment pipelines for data engineering workflows
- 5 years of experience in Data Engineering roles
- Strong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modelling
- Proficient in using Azure Databricks (PySpark/Spark SQL) and medallion architecture
- Experience with other SQL databases, relational databases and NoSQL databases
- Understanding of data lake and data warehouse architectures (e.g., Azure Data Lake, One Lake, Delta Tables) Experience working with large-scale structured and semi-structured datasets
- Ability to work with cross-functional teams and translate business requirements into technical solutions