What are the responsibilities and job description for the Lead ETL Developer - Google Cloud Platform / BigQuery - Des Moines, IA - Remote position at Brandon Consulting?
Overview
The VISION – CWIS FACS Conversion Initiative requires the extraction of data from the Google Cloud Platform (Google Cloud Platform) BigQuery environment and the delivery of that data into enterprise SQL data warehouses. This effort is critical to ensuring continuity and modernization for all applications that currently depend on FACS.
A dedicated ETL development team is being formed from the existing resource pool , and is seeking a highly skilled Lead ETL Developer to provide leadership, training, architecture guidance, and technical oversight throughout this conversion effort.
Position Summary
The Lead ETL Developer will design, build, test, and deploy data ingestion and migration pipelines that source historical and real-time data from a variety of disparate systems, including flat files and relational databases. The developer will transform and standardize incoming data into enterprise data models and ensure efficient, accurate loading into data warehouses, data lakes, and analytical databases.
This role is responsible for ensuring that transactional and analytical data models include required data elements and meet quality, reliability, and performance expectations. The Lead ETL Developer will mentor and guide a team of ETL developers, establishing best practices and consistent development patterns throughout the project lifecycle.
- Lead development of ETL and data ingestion processes supporting the migration from Google Cloud Platform BigQuery to SQL-based data warehouse environments.
- Architect and implement pipelines using modern ETL tools and cloud-native data processing frameworks.
- Train and mentor a team of 4 ETL developers on best practices, coding standards, and data model design.
- Collaborate with business and technical stakeholders to validate data requirements and ensure alignment with reporting and analytical needs.
- Develop robust testing strategies to ensure data integrity, completeness, and accuracy throughout the migration process.
- Optimize pipelines for scalability, performance, and maintainability.
- Validate transactional and analytical data models to ensure they contain the necessary elements for downstream applications and BI solutions.
- Prepare and deliver clear communication, presentations, and technical documentation suitable for both technical and non-technical audiences.
Required/Desired Skills
| Skill | Required /Desired | Amount | Experience you have in years |
|---|---|---|---|
| • Hands-on ETL development experience | Required | 7 | |
| • Expertise with modern ETL and reporting/BI tools | Required | 7 | |
| • Strong understanding of enterprise data models and best practices in ETL pipeline design. | Required | 7 | |
| • Proven experience as a Technical Lead guiding teams of 4 or more developers | Required | 7 | |
| • Demonstrated experience with Google Cloud Dataform | Required | 7 | |
| • Demonstrated experience with BigQuery | Required | 7 | |
| • Demonstrated experience with Medallion Architecture | Required | 7 | |
| • Exceptional communication and presentation skills, capable of engaging diverse audiences | Required | 0 |