What are the responsibilities and job description for the Data Engineer position at Shield Consulting Solutions, Inc.?
- Active TS/SCI w/Polygraph REQUIRED** Please do not apply if you do not currently possess this level of clearance.
Basic Requirements
- 5 years of experience as a software engineer
- Bachelor’s degree in a technical discipline
- 2 additional years of experience as a software engineer may be substituted for a degree
- The Software Engineer shall be responsible for identifying ways to create consistent and repeatable capabilities including transforming raw, complex, and often unstructured data into clean, reliable, and high-quality analysis-ready datasets that support advanced analytics, predictive modeling, and data-driven decision-making across the organization.
- Experience using the Linux CLI and Linux tools
- Experience developing Bash scripts to automate manual processes
- Recent software development experience using Python
- Familiar with Distributed Big Data processing engines including Apache Spark
- Experience using Jupyter Notebook
- Experience with data wrangling and preprocessing tools such as pandas and NumPy
- Experience working with structured, semi-structured, and unstructured data
- Familiarity with data quality concepts, data validation, and anomaly detection
- Experience with Git Source Control System
- Familiar with Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
- Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
- Familiar with HPC Job Scheduling tools including Slurm
- Experience using the Atlassian Tool Suite (JIRA, Confluence)
Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents – available day 1, 8% 401(k) employer match – immediate vesting.
Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure.
Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.
This is a full time position
Salary : $205,000 - $215,000