What are the responsibilities and job description for the Sr. Automation Data Integration Administrator position at Apolis?
6 month contract to hire.
Senior Automation Data Integration Administrator
Location: Remote- must be local to DMV area
Onsite expectation: Must be willing to go onsite if client asks
Clearance Level: EOD PT, can hold up to a TS/SCI
Must be able to obtain and/or maintain an EOD Public Trust security clearance as a condition and continuation of employment*
This is with a large federal client. As a Senior Automation Data Integration Administrator, you will play a crucial role in enhancing the efficiency and effectiveness of cybersecurity operations. You will work in a dynamic environment, collaborating with cybersecurity professionals, data analysts, and system owners to design and implement automated solutions that reduce manual effort and improve risk visibility.
LCAT:
BS & 15yrs
AS & 18yrs
21 yrs no degree
Project Details / Mission Supported:
- Design, build, and maintain automated data integration pipelines that pull data from multiple sources, including APIs, databases, and IoT systems.
- Develop and support ETL/ELT processes to extract, transform, and load data into enterprise data warehouses and data lakes.
- Monitor data pipelines to ensure data quality, consistency, and accuracy through automated validation, testing, and anomaly detection.
- Troubleshoot and resolve data flow issues, schema changes, and pipeline failures before they impact downstream reporting and analytics.
- Schedule, manage, and optimize data workflows using orchestration tools such as Apache Airflow or Prefect.
- Build resilient, self-healing automation that can automatically recover from failures and scale based on workload demands.
- Create and maintain scripts that identify data anomalies, handle missing data, and ensure sensitive information is properly sanitized and protected.
- Implement CI/CD processes for data pipelines to support reliable deployments and ongoing enhancements.
- Collaborate with technical teams to design integrated data solutions that improve accessibility, performance, and operational efficiency.
- Document data integration processes, workflows, and best practices to support long-term maintainability.
- Ensure all data management activities comply with organizational security, privacy, and governance requirements.
- Continuously evaluate and recommend improvements to data architecture, pipeline performance, and automation capabilities.
Qualified candidates will have the following experience and skills:
- BS/BA and 15 years of applicable experience in data integration and automation
- Demonstrated expertise in Apache Airflow, Prefect, or similar orchestration tools
- Experience with ETL/ELT processes and automation tools
- Knowledge of data quality frameworks and observability systems
- Experience with APIs, databases, and data warehouse/lake technologies
- Strong programming skills in Python, SQL, or similar languages
- Experience with Infrastructure as Code (IaC) tools (Terraform, CloudFormation)
- Knowledge of data catalog and metadata management solutions
- Experience with CI/CD pipelines (Jenkins, GitLab, GitHub Actions)
- Familiarity with cloud platforms (AWS, Azure, GCP)
Salary : $85 - $90