What are the responsibilities and job description for the Data Integration Engineer position at Red Arch Solutions?
Position Summary
The Data Integration Engineer designs, develops, and maintains data integration solutions and pipelines that support enterprise analytics, data sharing, and operational reporting.
The candidate shall have experience performing data mapping, transformation, normalization, and data quality validation activities to support enterprise analytics, reporting, operational, and mission requirements. The candidate should possess strong knowledge of data integration patterns, data lifecycle management, and modern cloud-based data architecture.
The candidate shall demonstrate experience supporting data onboarding initiatives, including source system analysis, requirements collection, interface design, integration development, testing, and operational deployment. Experience working closely with Data Governance, Data Stewardship, Metadata, and Security teams to ensure compliance with data standards and governance requirements is required.
The candidate shall possess experience implementing metadata capture, lineage tracking, tagging, and classification capabilities within data ingestion and processing workflows. Experience supporting enterprise data catalogs and metadata management initiatives is highly desired.
Key Responsibilities
The Data Integration Engineer designs, develops, and maintains data integration solutions and pipelines that support enterprise analytics, data sharing, and operational reporting.
The candidate shall have experience performing data mapping, transformation, normalization, and data quality validation activities to support enterprise analytics, reporting, operational, and mission requirements. The candidate should possess strong knowledge of data integration patterns, data lifecycle management, and modern cloud-based data architecture.
The candidate shall demonstrate experience supporting data onboarding initiatives, including source system analysis, requirements collection, interface design, integration development, testing, and operational deployment. Experience working closely with Data Governance, Data Stewardship, Metadata, and Security teams to ensure compliance with data standards and governance requirements is required.
The candidate shall possess experience implementing metadata capture, lineage tracking, tagging, and classification capabilities within data ingestion and processing workflows. Experience supporting enterprise data catalogs and metadata management initiatives is highly desired.
Key Responsibilities
- Design and build ETL/ELT data pipelines.
- Develop APIs and data integration services.
- Perform data mapping and transformation activities.
- Implement automated data ingestion processes.
- Monitor and optimize data processing performance.
- Support cloud-based data architectures.
- Document data lineage and integration workflows.
- Collaborate with governance teams to ensure compliance standards are met.
- Python
- SQL
- ETL/ELT Development
- API Development
- Azure Data Factory
- Databricks
- Data Modeling
- Cloud Data Platforms
- Data Validation and Testing
- Bachelor’s degree in computer science or related discipline.
- 12 years of data engineering experience.
- Experience with Azure, AWS, or hybrid cloud environments.
Salary : $160,000 - $185,000