What are the responsibilities and job description for the Data Integration Developer-- SOMDC5697373 position at Compunnel Inc.?
Job Summary
We are seeking an experienced Data Integration Developer with strong expertise in ETL development, cloud-based data workflows, and DataStage.
The ideal candidate will have hands-on experience building large-scale data pipelines, working with cloud infrastructure, and optimizing data integration processes for enterprise-wide systems.
Key Responsibilities
- Design and implement ETL processes to extract, transform, and load data from multiple sources into optimized data models for analytics and reporting.
- Build and maintain ETL interfaces using DataStage 11.7, ensuring data quality, scalability, and performance.
- Deploy and maintain cloud-based infrastructure for data workflows using platforms such as AWS, GCP, or Azure.
- Collaborate with teams to recommend best practices for ETL optimization and data integration.
- Facilitate knowledge transfer through training and mentoring plans.
- Support full lifecycle management of DataStage ETL metadata, including data mapping and migration across environments.
- Work with scripting languages (Shell, Perl, Python) for automation and job scheduling.
- Ensure compliance with security, reliability, and availability standards for ETL platforms.
- Provide technical documentation and participate in project planning and governance.
Required Qualifications
- Minimum 7 years of experience in data integration and ETL development.
- 4 years of hands-on experience with DataStage 11.7 for building ETL interfaces across Big Data and Data Warehousing systems.
- Strong knowledge of cloud ETL tools (e.g., AWS Glue) and data warehousing solutions (e.g., Redshift).
- Expertise in Databricks data lakehouse platform and cloud applications.
- Advanced SQL and stored procedure experience across DB2, SQL Server, and Oracle.
- Proficiency in Unix/Linux environments and scripting languages (Shell, AWK, sed).
- Familiarity with data modeling (normalized and dimensional), CDC techniques, and SOA/ESB patterns.
- Experience with job scheduling and automation tools.
Preferred Qualifications
- Knowledge of predictive analytics architecture and deployment of predictive models.
- Strong analytical and problem-solving skills with ability to work independently and collaboratively.
- Excellent communication skills for interacting with technical and non-technical stakeholders.