What are the responsibilities and job description for the Senior Data Engineer - Active Secret Clearance with Security Clearance position at ClearanceJobs?
Description
Location: Washington, DC (Hybrid, once a week)
Clearance Required: Active Secret
Position Type: Full-Time Salary: $140,000-$160,000 We are seeking a highly skilled Senior Data Engineer to support the U.S. Coast Guard Office of Data & Analytics (ODA). The ideal candidate will bring expertise in Python, SQL, ETL pipelines, and cloud-based data frameworks to enable enterprise-scale analytics and decision-making. This role will involve designing, building, and orchestrating data pipelines, collaborating with analysts and developers, and implementing CI/CD practices to ensure scalable, reliable, and secure data solutions. Primary Responsibilities: Build, test, and orchestrate data pipelines in Python.
Design and optimize data structures, schemas, and ETL processes.
Translate business use cases into SQL queries, reports, and dashboards.
Manage database objects in development environments without impacting production.
Automate workflows using Databricks Workflows or the Jobs API.
Integrate code into GitHub/GitLab and support CI/CD practices.
Diagnose data gaps and quality issues, and design test cases for validation.
Collaborate with developers and analysts to synchronize code and ensure reliability.
Requirements
Minimum Qualifications: Active Secret clearance (required at time of application).
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
7 years of professional experience in data engineering.
Proficiency in Python (2-3 years)
Proficiency in SQL (2-3 years)
Experience with ETL tools such as Kafka, Airflow, or AWS Glue.
Proficiency with CI/CD pipelines and GitHub/GitLab version control.
Knowledge of cloud platforms (AWS, Azure, GCP).
Excellent problem-solving, debugging, and collaboration skills.
Preferred Qualifications: Experience supporting federal or mission-critical analytics programs.
Knowledge of data governance and metadata management practices.
Knowledge in Databricks and Apache Spark.
Familiarity with containerization or orchestration tools (Docker, Kubernetes).
Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future.
Active Secret clearance required for this role.
Benefits
Salary: $140,000-$160,000 Washington, DC (Hybrid, once a week) Benefits include Health, Vision, and Dental Insurance, and PTO.
Location: Washington, DC (Hybrid, once a week)
Clearance Required: Active Secret
Position Type: Full-Time Salary: $140,000-$160,000 We are seeking a highly skilled Senior Data Engineer to support the U.S. Coast Guard Office of Data & Analytics (ODA). The ideal candidate will bring expertise in Python, SQL, ETL pipelines, and cloud-based data frameworks to enable enterprise-scale analytics and decision-making. This role will involve designing, building, and orchestrating data pipelines, collaborating with analysts and developers, and implementing CI/CD practices to ensure scalable, reliable, and secure data solutions. Primary Responsibilities: Build, test, and orchestrate data pipelines in Python.
Design and optimize data structures, schemas, and ETL processes.
Translate business use cases into SQL queries, reports, and dashboards.
Manage database objects in development environments without impacting production.
Automate workflows using Databricks Workflows or the Jobs API.
Integrate code into GitHub/GitLab and support CI/CD practices.
Diagnose data gaps and quality issues, and design test cases for validation.
Collaborate with developers and analysts to synchronize code and ensure reliability.
Requirements
Minimum Qualifications: Active Secret clearance (required at time of application).
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
7 years of professional experience in data engineering.
Proficiency in Python (2-3 years)
Proficiency in SQL (2-3 years)
Experience with ETL tools such as Kafka, Airflow, or AWS Glue.
Proficiency with CI/CD pipelines and GitHub/GitLab version control.
Knowledge of cloud platforms (AWS, Azure, GCP).
Excellent problem-solving, debugging, and collaboration skills.
Preferred Qualifications: Experience supporting federal or mission-critical analytics programs.
Knowledge of data governance and metadata management practices.
Knowledge in Databricks and Apache Spark.
Familiarity with containerization or orchestration tools (Docker, Kubernetes).
Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future.
Active Secret clearance required for this role.
Benefits
Salary: $140,000-$160,000 Washington, DC (Hybrid, once a week) Benefits include Health, Vision, and Dental Insurance, and PTO.
Salary : $140,000 - $160,000