What are the responsibilities and job description for the Data Integration Specialist position at Endurion?
Position Summary
The Data Integration Specialist supports mission-critical objectives under the referenced work order by managing data ingestion, transformation, and interoperability across cloud-based and on-premises environments. This role develops ETL pipelines, ensures data quality and consistency, and coordinates with AI/ML engineers to meet analytical requirements.
This future opportunity is contingent upon award.
Job Description
- The Data Integration Specialist is responsible for developing and maintaining scalable data pipelines that enable real-time and batch processing of structured and unstructured data.
- The position requires implementing Extract, Transform, Load (ETL) workflows that facilitate data interoperability across cloud and on-premises environments.
- Specialists will manage schema alignment, metadata tagging, and data governance to ensure data quality and traceability.
- The role includes coordinating with AI/ML engineers to ensure data transformations meet model training and analytical requirements.
Required Qualifications and Experience
The contractor shall provide personnel who meet one of the following requirements:
- Bachelor's degree in Data Science, Information Management, or a related field; or
- A minimum of five (5) years of professional experience in data integration.
Candidates must have demonstrated experience in the following areas:
- Developing and managing ETL workflows.
- Integrating data from multiple sources.
- Ensuring data quality and consistency.
- Working with tools such as Apache NiFi, Databricks, and SQL-based data warehouses.
- Managing schema alignment and metadata tagging.
Required Skills and Competencies
- Expertise in data integration tools, API development, and ETL pipelines.
- Working knowledge of schema management and data governance.
- Proficiency in Apache NiFi, Databricks, and SQL-based data warehouses.
- Strong understanding of data quality and interoperability requirements.
- Ability to coordinate with AI/ML teams on data transformation requirements.
Education
- Bachelor's degree in a relevant field, or an equivalent combination of education and experience.
- Certified Data Management Professional (CDMP) (Preferred, Not Required)
- Microsoft Certified: Azure Data Engineer Associate (Preferred, Not Required)
Clearance Requirement
An active TS/SCI security clearance is required for on-site duty location