What are the responsibilities and job description for the Data Engineer - Mid with Security Clearance position at ClearanceJobs?
Full Description The Data Engineer enables DIA's Defense Economic Analysis mission by designing, operating, and optimizing data management systems that move, normalize, and prepare structured, unstructured, and geospatial data for analysis. The role builds end-to-end pipelines and back-end data services across SQL/NoSQL environments and contributes to modernization of mission repositories and tooling to support analytic production. This position directly supports analysts and decision makers by ensuring that data is accurate, reliable, and accessible for mission use. Responsibilities Develop and optimize ETL pipelines for diverse data sources.
- Manage and tune relational and non-relational databases.
- Implement data validation and quality assurance processes.
- Enable integration of geospatial and economic datasets for analytic workflows.
- Support modernization of DIA repositories and cross-domain data access. Qualifications: Active TS/SCI clearance.
- Bachelor's degree in Computer Science, Engineering, or related field OR 9 years of relevant experience in lieu of a degree.
- 5\u20137 years of professional data engineering experience.
- Proficiency with SQL, Python, and ETL frameworks.
- Experience with geospatial data standards (OGC, ISO). Desired Qualifications Master's in Data Science or Engineering.
- Experience with Airflow, ElasticSearch, and distributed databases.
- Prior IC/DoD project experience.