What are the responsibilities and job description for the Ab Initio Developer position at VeriiPro?
Roles and Responsibilities
- Design, develop, and optimize Ab Initio ETL (Extract, Transform, Load) jobs for large-scale data processing.
- Integrate data from multiple sources into Google Cloud Platform (GCP), focusing on BigQuery for efficient data warehousing and analytics.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Leverage Unix/Linux scripting for job automation, performance tuning, and system monitoring.
- Ensure data quality, integrity, and compliance throughout the ETL process.
- Troubleshoot and resolve performance issues in Ab Initio jobs, BigQuery queries, and Unix-based systems.
- Monitor and optimize BigQuery workloads to ensure cost-effective performance.
- Support cloud data migration initiatives, including the transition of legacy data pipelines to the GCP ecosystem.
