What are the responsibilities and job description for the Data Engineer position at DATASYS CONSULTING & SOFTWARE INC?
Job Details
Title: Data Engineer
Location: Dallas , TX (Hybrid)
Employment Type : W2 Only
We are seeking an experienced Data Engineer to design and maintain scalable data pipelines in Databricks. The role involves end-to-end ownership of data workflows, from ingestion to production, ensuring performance, quality, and reliability.
Responsibilities:
-Build and optimize pipelines in Databricks (PySpark, SQL, Delta Lake).
-Ingest data from databases, APIs, PDFs, Excel, flat files, and web scraping.
-Implement data quality checks, validation, and testing frameworks.
-Deploy, monitor, and optimize pipelines in Databricks/AWS.
-Collaborate with data science/analytics teams and document data processes.
Qualifications:
-8 years of Data Engineering experience.
-Hands-on expertise in Databricks (PySpark, SQL, Delta Lake).
-Strong experience with structured & unstructured data.
-Knowledge of data quality/testing tools (Great Expectations, Deequ, dbt tests).
-Proven ability to optimize large-scale Spark/Databricks workloads.
Email :
Salary : $80,000 - $100,000