What are the responsibilities and job description for the IA-DOM-DOIT-TS4 VISION ETL Lead position at Edify Technologies India Pvt Ltd?
The VISION - CWIS FACS Conversion Initiative requires the extraction of data from the Google Cloud Platform (GCP) BigQuery environment and the delivery of that data into enterprise SQL data warehouses.
Overview
The VISION - CWIS FACS Conversion Initiative requires the extraction of data from the Google Cloud Platform (GCP) BigQuery environment and the delivery of that data into enterprise SQL data warehouses. This effort is critical to ensuring continuity and modernization for all applications that currently depend on FACS.
A dedicated ETL development team is being formed from the existing resource pool, and we are seeking a highly skilled Lead ETL Developer to provide leadership, training, architecture guidance, and technical oversight throughout this conversion effort.
Position Summary
The Lead ETL Developer will design, build, test, and deploy data ingestion and migration pipelines that source historical and real-time data from a variety of disparate systems, including flat files and relational databases. The developer will transform and standardize incoming data into enterprise data models and ensure efficient, accurate loading into data warehouses, data lakes, and analytical databases.
This role is responsible for ensuring that transactional and analytical data models include required data elements and meet quality, reliability, and performance expectations. The Lead ETL Developer will mentor and guide a team of ETL developers, establishing best practices and consistent development patterns throughout the project lifecycle.
Responsibilities
Required Skills and Experience
Required/Desired Skills
SkillRequired /DesiredAmountof Experience• Hands-on ETL development experienceRequired7Years• Expertise with modern ETL and reporting/BI toolsRequired7Years• Strong understanding of enterprise data models and best practices in ETL pipeline design.Required7Years• Proven experience as a Technical Lead guiding teams of 4 or more developersRequired7Years• Demonstrated experience with Google Cloud DataformRequired7Years• Demonstrated experience with BigQueryRequired7Years• Demonstrated experience with Medallion ArchitectureRequired7Years• Exceptional communication and presentation skills, capable of engaging diverse audiencesRequired0
Questions
No.QuestionQuestion1Absences greater than two weeks MUST be approved by CAI Management in advance, and contact information must be provided to CAI so that a resource can be reached during his or her absence. The Client has the right to dismiss the resource if she or he does not return to work by the agreed upon date. Do you agree to this requirement?Question2The Contractor must report any disciplinary action, misdemeanor, or felony convictions to the State for any temporary IT staff provided. Do you agree to this requirement?Question3What is your candidate's email address?Question4Have you completed and submitted the Right to Represent form, making sure to do so exactly as instructed? The form is located at https://www.cai.io/media/documents/msp/ia/ia_e-rtr_template.doc.Question5The hourly Vendor Rate for this position is $94.71. Do you agree to this requirement?Question6PROVIDE CANDIDIDATES CURRENT LOCATION (CITY/STATE) HERE: Question7SHOW YOUR WORK - In the summary of qualifications field under the details tab of the candidate's profile, you should explain why your candidate is the best fit for this position. Please confirm that you have thoroughly validated and attested to the accuracy of the credentials listed throughout this candidate's VectorVMS profile and resume according to Section 5.2.5 of ITS-009440. Do you confirm? Candidates will get rejected if an agency cuts and pastes the candidates' resumes into this field [REQUIRED] Question8Use of AI is Strictly Prohibited: Please be advised that the use of AI-generated responses during screenings and interviews is strictly prohibited. Confirm that your candidate has been informed of this policy and agrees to adhere to it. Non-compliance will result in disqualification from the interview process. Question9Background Check Requirements: DOM contractor personnel are required to undergo additional background check investigations (run by DOM) before starting, requiring the completion of several waiver forms & fingerprint processes. The selected candidate will be responsible for completing all the necessary waiver forms, scheduling and completing the fingerprinting process, and returning all completed items to DOM for processing. This is in addition to the National Criminal and Sex Offender check that the vendor Question10Provide candidates with the complete physical address where the DOM DoIT Background Check form and fingerprint cards must be mailed. [REQUIRED] - Failure to provide accurate information will result in disqualification. Question11INTERVIEW DATES: Interviews will be conducted on [September 30, October 1, 2] Only submit candidates available for interviews on the date(s) provided.
Overview
The VISION - CWIS FACS Conversion Initiative requires the extraction of data from the Google Cloud Platform (GCP) BigQuery environment and the delivery of that data into enterprise SQL data warehouses. This effort is critical to ensuring continuity and modernization for all applications that currently depend on FACS.
A dedicated ETL development team is being formed from the existing resource pool, and we are seeking a highly skilled Lead ETL Developer to provide leadership, training, architecture guidance, and technical oversight throughout this conversion effort.
Position Summary
The Lead ETL Developer will design, build, test, and deploy data ingestion and migration pipelines that source historical and real-time data from a variety of disparate systems, including flat files and relational databases. The developer will transform and standardize incoming data into enterprise data models and ensure efficient, accurate loading into data warehouses, data lakes, and analytical databases.
This role is responsible for ensuring that transactional and analytical data models include required data elements and meet quality, reliability, and performance expectations. The Lead ETL Developer will mentor and guide a team of ETL developers, establishing best practices and consistent development patterns throughout the project lifecycle.
Responsibilities
- Lead development of ETL and data ingestion processes supporting the migration from GCP BigQuery to SQL-based data warehouse environments.
- Architect and implement pipelines using modern ETL tools and cloud-native data processing frameworks.
- Train and mentor a team of 4 ETL developers on best practices, coding standards, and data model design.
- Collaborate with business and technical stakeholders to validate data requirements and ensure alignment with reporting and analytical needs.
- Develop robust testing strategies to ensure data integrity, completeness, and accuracy throughout the migration process.
- Optimize pipelines for scalability, performance, and maintainability.
- Validate transactional and analytical data models to ensure they contain the necessary elements for downstream applications and BI solutions.
- Prepare and deliver clear communication, presentations, and technical documentation suitable for both technical and non-technical audiences.
Required Skills and Experience
- Minimum 7 years of hands-on ETL development experience.
- Expertise with modern ETL and reporting/BI tools.
- Strong understanding of enterprise data models and best practices in ETL pipeline design.
- Proven experience as a Technical Lead guiding teams of 4 or more developers.
- Demonstrated experience with:
- Google Cloud Dataform
- BigQuery
- Medallion Architecture
- Exceptional communication and presentation skills, capable of engaging diverse audiences.
Required/Desired Skills
SkillRequired /DesiredAmountof Experience• Hands-on ETL development experienceRequired7Years• Expertise with modern ETL and reporting/BI toolsRequired7Years• Strong understanding of enterprise data models and best practices in ETL pipeline design.Required7Years• Proven experience as a Technical Lead guiding teams of 4 or more developersRequired7Years• Demonstrated experience with Google Cloud DataformRequired7Years• Demonstrated experience with BigQueryRequired7Years• Demonstrated experience with Medallion ArchitectureRequired7Years• Exceptional communication and presentation skills, capable of engaging diverse audiencesRequired0
Questions
No.QuestionQuestion1Absences greater than two weeks MUST be approved by CAI Management in advance, and contact information must be provided to CAI so that a resource can be reached during his or her absence. The Client has the right to dismiss the resource if she or he does not return to work by the agreed upon date. Do you agree to this requirement?Question2The Contractor must report any disciplinary action, misdemeanor, or felony convictions to the State for any temporary IT staff provided. Do you agree to this requirement?Question3What is your candidate's email address?Question4Have you completed and submitted the Right to Represent form, making sure to do so exactly as instructed? The form is located at https://www.cai.io/media/documents/msp/ia/ia_e-rtr_template.doc.Question5The hourly Vendor Rate for this position is $94.71. Do you agree to this requirement?Question6PROVIDE CANDIDIDATES CURRENT LOCATION (CITY/STATE) HERE: Question7SHOW YOUR WORK - In the summary of qualifications field under the details tab of the candidate's profile, you should explain why your candidate is the best fit for this position. Please confirm that you have thoroughly validated and attested to the accuracy of the credentials listed throughout this candidate's VectorVMS profile and resume according to Section 5.2.5 of ITS-009440. Do you confirm? Candidates will get rejected if an agency cuts and pastes the candidates' resumes into this field [REQUIRED] Question8Use of AI is Strictly Prohibited: Please be advised that the use of AI-generated responses during screenings and interviews is strictly prohibited. Confirm that your candidate has been informed of this policy and agrees to adhere to it. Non-compliance will result in disqualification from the interview process. Question9Background Check Requirements: DOM contractor personnel are required to undergo additional background check investigations (run by DOM) before starting, requiring the completion of several waiver forms & fingerprint processes. The selected candidate will be responsible for completing all the necessary waiver forms, scheduling and completing the fingerprinting process, and returning all completed items to DOM for processing. This is in addition to the National Criminal and Sex Offender check that the vendor Question10Provide candidates with the complete physical address where the DOM DoIT Background Check form and fingerprint cards must be mailed. [REQUIRED] - Failure to provide accurate information will result in disqualification. Question11INTERVIEW DATES: Interviews will be conducted on [September 30, October 1, 2] Only submit candidates available for interviews on the date(s) provided.
Salary : $95