What are the responsibilities and job description for the Mid-Level Data Engineer position at Astrion?
Overview
Mid-Level Data Engineer
Location: Huntsville, Alabama
Job Status: Full Time
Clearance: Secret
Astrion is seeking a Mid-Level Data Engineer to join our analytics team in Huntsville, Alabama.
In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis. You will leverage scientific techniques to transform petabyte-scale data into insightful data products to enable data-driven decisions. You will partner with Data Scientists to refactor manual workflows to produce highly automated MLOPs based workloads. You will perform using scrumban techniques and be embedded with end users.
For this role you must have an active Secret security clearance with ability to obtain TS/SCI with CI polygraph.
Required Qualifications / Skills
Mid-Level Data Engineer
Location: Huntsville, Alabama
Job Status: Full Time
Clearance: Secret
Astrion is seeking a Mid-Level Data Engineer to join our analytics team in Huntsville, Alabama.
In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis. You will leverage scientific techniques to transform petabyte-scale data into insightful data products to enable data-driven decisions. You will partner with Data Scientists to refactor manual workflows to produce highly automated MLOPs based workloads. You will perform using scrumban techniques and be embedded with end users.
For this role you must have an active Secret security clearance with ability to obtain TS/SCI with CI polygraph.
Required Qualifications / Skills
- Significant experience as a Data Engineer or advanced analytical role
- Experience in data engineering and/or software development
- Expertise with Python, GIT, YAML, Docker, and SQL
- Knowledge of CI/CD, DevSecOps, and Agile methodologies
- Experience developing back-end systems and services
- Understanding of software design and system integration
- Experience as a Site Reliability Engineer (SRE)
- Experience with AIOps and FinOps
- Experience with Petabyte scale data sets
- Experience with large-scale, multi-INT analytics
- BS or MS in Computer Science, Statistics, Mathematics, Physics or a quantitative field
- Build and maintain data pipelines, ETL processes, and storage systems
- Develop services and extend infrastructure to enable machine learning workflows
- Integrate software components into functional data systems
- Write clean, testable, maintainable code in Python and other languages
- Implement CI/CD pipelines and DevSecOps best practices
- Create technical documentation for software systems
- Collaborate across teams to share knowledge and leading practices
- The team will work with technologies including:
- Open source, Commercial, and Government software packages such as Kafka, Beam, NumPy, Kubeflow, Nvidia Triton, PyTorch, TensorFlow, Weaviate, Neo4j, Grafana, etc.
- Cloud native techniques and containerization with Docker
- Infrastructure as Code with Terraform
- Leverage GitOps patterns and CI/CD with tools like GitLab, Argo, and Harness
- Perform SAST/DAST security with tools like SonarQube
- Perform Kubernetes and K3s orchestration with tools like Rancher and Konvoy