What are the responsibilities and job description for the Data Engineer (with Pipeline/Platform focus) position at Shield Consulting Solutions, Inc.?
- Active TS/SCI w/Polygraph REQUIRED** Please do not apply if you do not currently possess this level of clearance.
Basic Requirements
- 7 years of experience as a software engineer
- Bachelor’s degree in a technical discipline
- 2 additional years of experience as a software engineer may be substituted for a degree
- Responsible for creating, sustaining, and troubleshooting complex operational data flows including data storage, data transport, data management, data security, data compliance, and knowledge store management.
- Additional tasking shall include working with the mission customer to perform exploration data analysis on raw data to clean, enrich, transform and convert the raw data into the required formats.
- Responsible for devising methods to improve existing operational data flow processing, distribution, and reliability.
- Experience using the Linux CLI and suite of tools
- Experience creating, managing, and troubleshooting complex operational data flows
- Experience using Apache NiFi canvas to process and distribute data
- Experience with monitoring and observability tools such as Grafana and Prometheus
- Experience with IaC principles and automation tools including Ansible
- Experience with the Atlassian Tool Suite (JIRA, Confluence)
- General HPC technical knowledge regarding compute, network, memory, and storage components
- Experience with Corporate data flow processes and tools
- Experience with Corporate data security and compliance procedures and policies
- Experience writing scripts using Bash/Python
Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents – available day 1, 8% 401(k) employer match – immediate vesting.
Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure.
Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.
This is a full time position
Salary : $230,000 - $240,000