What are the responsibilities and job description for the Data Engineer - Only local to TX position at XFORIA Inc?
Job Details
Data Engineer
Long Term Contract
Plano, TX
Job Summary
We are looking for a Data Engineer to build and maintain data pipelines that collect, process, and store data from different sources. The ideal candidate should have strong SQL and Python skills and experience working with cloud platforms and big data technologies.
Responsibilities
Design and develop ETL/ELT data pipelines.
Collect data from databases, APIs, and external sources.
Clean, transform, and load data into data warehouses.
Ensure data quality, reliability, and performance.
Work with Data Scientists and Analysts to provide required datasets.
Monitor and troubleshoot data pipelines.
Maintain documentation and follow data governance standards.
Required Skills: ETL, Python, Data Warehousing concepts, ETL/ELT processes, Git version control
Preferred Skills: Apache Spark, Apache Airflow, Apache Kafka, AWS/Azure/Google Cloud Platform/Snowflake, Redshift, or BigQuery