What are the responsibilities and job description for the ETL Lead position at Soho Square Solutions?
Description:
Job Title: Lead ETL Developer
Location: Des Moines, IA (Remote)
Duration: 9 months of contract only
Summary & full address - Must, Interviews will be conducted on [September 30, October 1, 2] Only submit candidates available for interviews on the date(s) provided. Proven experience as a Technical Lead guiding teams of 4 or more developers
Job Description:
Overview
Client Conversion Initiative requires the extraction of data from the Google Cloud Platform (GCP) Big Query environment and the delivery of that data into enterprise SQL data warehouses. This effort is critical to ensuring continuity and modernization for all applications that currently depend on FACS.
A dedicated ETL development team is being formed from the existing resource pool, and we are seeking a highly skilled Lead ETL Developer to provide leadership, training, architecture guidance, and technical oversight throughout this conversion effort.
Position Summary
The Lead ETL Developer will design, build, test, and deploy data ingestion and migration pipelines that source historical and real-time data from a variety of disparate systems, including flat files and relational databases. The developer will transform and standardize incoming data into enterprise data models and ensure efficient, accurate loading into data warehouses, data lakes, and analytical databases.
This role is responsible for ensuring that transactional and analytical data models include required data elements and meet quality, reliability, and performance expectations. The Lead ETL Developer will mentor and guide a team of ETL developers, establishing best practices and consistent development patterns throughout the project lifecycle.
Responsibilities
- Lead development of ETL and data ingestion processes supporting the migration from GCP BigQuery to SQL-based data warehouse environments.
- Architect and implement pipelines using modern ETL tools and cloud-native data processing frameworks.
- Train and mentor a team of 4 ETL developers on best practices, coding standards, and data model design.
- Collaborate with business and technical stakeholders to validate data requirements and ensure alignment with reporting and analytical needs.
- Develop robust testing strategies to ensure data integrity, completeness, and accuracy throughout the migration process.
- Optimize pipelines for scalability, performance, and maintainability.
- Validate transactional and analytical data models to ensure they contain the necessary elements for downstream applications and BI solutions.
- Prepare and deliver clear communication, presentations, and technical documentation suitable for both technical and non-technical audiences.
Required Skills and Experience
- Minimum 7 years of hands-on ETL development experience.
- Expertise with modern ETL and reporting/BI tools.
- Strong understanding of enterprise data models and best practices in ETL pipeline design.
- Proven experience as a Technical Lead guiding teams of 4 or more developers.
- Demonstrated experience with:
- Google Cloud Dataform
- BigQuery
- Medallion Architecture
- Exceptional communication and presentation skills, capable of engaging diverse audiences.