ETL Developer

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Avanciers LLC, is seeking the following. Apply via Dice today!

Avanciers are seeking an experienced ETL Developer with deep expertise in AWS Glue, PySpark, and Lambda, and proven hands-on experience in the banking or financial services domain. The ideal candidate will design, develop, and maintain scalable ETL pipelines within a secure AWS environment to ensure high-quality, performant, and cost-efficient data flows.

Key Responsibilities

• Design and develop scalable ETL pipelines using AWS Glue and Lambda for data integration and transformation.
• Integrate data from APIs, databases, and flat files into AWS-based platforms.
• Implement complex transformation logic using PySpark, Python, or SQL within AWS Glue or Lambda.
• Orchestrate and monitor workflows using AWS Step Functions, Glue Workflows, or Apache Airflow (Amazon MWAA).
• Ensure data quality, consistency, and lineage via AWS Glue Data Catalog and Lake Formation.
• Optimize performance and cost through partitioning, parallelism, and resource tuning.
• Document data flows and ETL architecture using tools like Confluence or AWS Architecture Diagrams.
  
  

Required Skills

• ETL Development – 5 years
• AWS Glue & AWS Lambda – Expert level
• PySpark & Python – Strong proficiency
• AWS Step Functions / Airflow (MWAA) – Workflow orchestration experience
• Banking/Fintech Domain Knowledge – Mandatory
  
  

Good to Have

• Experience with AWS Lake Formation, Glue Data Catalog, or Athena
• Familiarity with data governance and metadata management
• Strong communication and documentation skills