What are the responsibilities and job description for the Senior ETL Developer position at Altak Group Inc.?
We are seeking a Senior Ab Initio Infrastructure Lead to spearhead the administration, configuration, and migration of our Ab Initio environment. The primary focus of this role is transitioning our legacy Linux-based Ab Initio instances to AWS EKS containerization. You will be responsible for the health, scalability, and reliability of the ETL infrastructure, serving as the subject matter expert for environment builds and cloud integration.
Key ResponsibilitiesInfrastructure & Cloud Migration
- AWS Modernization: Lead the migration of Ab Initio infrastructure from on-premises Linux environments to AWS EKS (Elastic Kubernetes Service).
- Environment Build: Install, configure, and maintain Ab Initio software across various environments (Dev, Test, Prod).
- Containerization: Design and implement containerized Ab Initio solutions using AWS EKS and related cloud services.
- Pipeline Engineering: Create and manage Big Data ETL pipelines moving data from on-premises systems to AWS S3, EBS, and Data Lakes.
Ab Initio Administration
- Suite Management: Provide expert administration for the Ab Initio Graphical Development Environment (GDE), Metadata Hub (MDH), and Operational Console.
- Performance Tuning: Monitor system health and troubleshoot complex environmental issues affecting the Metadata Hub and Ops Console.
- Governance: Perform technical code reviews for development teams to ensure ETL code adheres to infrastructure standards and performance best practices.
- Automation: Develop scripts (Unix/Linux) to automate ETL processes, system health checks, and unit testing architectures.
Collaboration & DevOps
- CI/CD Integration: Manage and optimize deployment pipelines using Jenkins and other DevOps tools.
- Cross-Team Leadership: Facilitate technical requirement gathering sessions and collaborate with architects and developers to interpret business needs into technical infrastructure.
- Security: Integrate Identity Access Management (EIAM) and LDAP for secure environment access.
Technical RequirementsCore Ab Initio & ETL
- 5 years of dedicated Ab Initio Administration (not development).
- Advanced knowledge of Ab Initio GDE, Metadata Hub, and Operational Console.
- Deep experience in building, installing, and configuring the Ab Initio toolset from scratch.
Cloud & Containerization
- 2 years of hands-on experience with AWS Cloud.
- Proven experience with AWS EKS (Kubernetes) containerization for ETL tools.
- Familiarity with AWS ecosystem: S3, RDS, DynamoDB, PostgreSQL, and EBS.
Systems & Software
- Expert Linux/Unix Skills: Advanced shell scripting and system-level troubleshooting.
- Database Proficiency: Strong SQL skills and experience with DB2 or RDS.
- DevOps: Experience with Jenkins and CI/CD methodologies.
- Architecture: Knowledge of Service Oriented Architecture (SOA) and Enterprise-level data auditing.
Professional & Soft Skills
- Independence: Ability to manage infrastructure builds and migrations with minimal supervision.
- Communication: Critical Skill. Must possess excellent verbal and written communication skills for technical documentation and stakeholder facilitation.
- Analytical Thinking: Strong problem-solving skills for "break-fix" scenarios in production-critical environments.
- Agile Mindset: Comfortable working in an Agile/Scrum environment.
Preferred Qualifications
- AWS Certified Solutions Architect or SysOps Administrator.
- Experience with Infrastructure as Code (IaaS).
- Knowledge of LDAP and EIAM security protocols.