What are the responsibilities and job description for the AWS Data Engineer position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, ComTec Information Systems, is seeking the following. Apply via Dice today!
Role: AWS Data Engineer
Location: Houston, TX (3 days/week onsite)
We are seeking a skilled AWS Data Engineer who has experience working with Python, SQL, Glue, and Airflow.
Responsibilities:
Role: AWS Data Engineer
Location: Houston, TX (3 days/week onsite)
We are seeking a skilled AWS Data Engineer who has experience working with Python, SQL, Glue, and Airflow.
Responsibilities:
- Design, build, and optimize ETLs using Python, SQL, Glue, Airflow, and other AWS services.
- Develop and maintain ETL workflows using Python, SQL, and AWS-native tools.
- Create SQL queries to segment, manipulate, and formatdata.
- Provide Run/DevOps support for data services, ensuring high availability and performance.
- Implement batch job scheduling and manage data dependencies using tools like Airflow or Step Functions.
- Maintain documentation for data flows, incident resolution, and operational procedures.
- Participate in on-call rotations and incident response for production systems.
- Build automations to ingest, transfer, move, upload, and manipulatedata.
- Build or maintain data ingestion pipelines that move data from source systems into Data Lake.
- Create and manage data models to ensure data integrity and facilitate efficient data analysis.
- Implement and maintain data security and compliance measures, including access controls, encryption, and data masking.
- Ensure data quality, accuracy, and consistency through data validation, cleansing, and monitoring.
- 5 years of experience in data engineering.
- Strong proficiency in AWS services: S3, Glue, DMS.
- Solid programming skills in Python and SQL.
- Must have experience with Airflow.
- Advanced SQL query development proficiency
- Understanding of data modelling principles and techniques.
- Knowledge of data security best practices and compliance requirements.