What are the responsibilities and job description for the Data Engineer position at TekVivid?
Job Title: Data Engineer
Key Skills: Power BI, Azure Data Bricks, Python
Plano, TX- In person only
Job Summary: We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion, transformation and management.
Responsibilities:
- Design, develop, and maintain end-to-end data pipelines using data ingestion tools and Azure Databricks
- Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs, databases, files, cloud storage)
- Build and optimize data transformation logic using Spark (Databricks), SQL, and Python
- Develop and maintain data models supporting analytics, reporting, and machine learning use cases
- Collaborate with analytics teams to enable Power BI datasets and reporting solutions
- Ensure data quality, reliability, and consistency through validation frameworks and monitoring
- Optimize performance of pipelines, storage, and compute resources in Azure
- Implement data governance practices, including lineage, cataloging, and documentation
- Support CI/CD deployment pipelines for data engineering workflows
Minimum Qualifications
- 5 years of experience in Data Engineering roles
- Strong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modelling
- Proficient in using Azure Databricks (PySpark/Spark SQL) and medallion architecture
- Experience with other SQL databases, relational databases and NoSQL databases
- Understanding of data lake and data warehouse architectures (e.g., Azure Data Lake, One Lake, Delta Tables) Experience working with large-scale structured and semi-structured datasets
- Ability to work with cross-functional teams and translate business requirements into technical solutions
Salary : $45 - $48