What are the responsibilities and job description for the Data Engineer (1446) position at Zapata Technology?
Referral Eligible
Summary:
The Data Engineer is part of a skilled IT team that will work independently and collectively with other engineers to identify and test potential enhancements and resolve technical issues with the rapid scaling of an intelligence application. This role will be at Fort Gordon in Augusta, GA.
Essential Functions:
- Perform software integration tasks, including scripting, systems analysis, requirements gathering, testing, and documentation. Provide support to technical writers and testers, manage configuration and system maintenance, utilize source code control to track and safeguard changes to the codebase, and apply software updates.
- Collaboratively design, develop, and implement custom ETL scripts while supporting software products as required. Ensure data quality, consistency, and integrity across the entire pipeline. Engage directly with customers to create ingestion feeds for unique systems, demonstrating the ability to devise solutions with minimal prior documentation or details about these systems.
- Perform infrastructure management functions, including designing, architecting, and implementing scalable infrastructure across multiple IC networks and application nodes using DevSecOps practices. Oversee containerization efforts with tools such as Docker and Podman and manage orchestration processes. Upgrade and migrate applications to containerized environments to enable scalability and transition to a microservices architecture. Document infrastructure administration, including creation, management, and decommissioning procedures.
Qualifications:
- Knowledge of DevSecOps processes including Infrastructure as Code using Puppet or Ansible.
- Knowledge of containerization and container orchestration, including networking, using Docker, Podman, or Kubernetes.
- Experience with the full DataOps lifecycle including ingestion and ETL processes into databases.
- Linux System administration knowledge: know the Linux command line, service management, software configuration concepts in lieu of virtual machine constraints.
- Ability to convert data and fix malformed data. This requires an understanding of XML, JSON, and regular expressions.
Preferred Qualifications:
- Experience with All Source Intelligence reports standards such as USMTF and lifecycle requirements management development.
- Experience in NiFi data flow, from configuration to creating new flows and making new processors.
- Ability to write in JavaScript, Groovy, and Python within NiFi and Linux.
Certifications Required:
- Must have IAT Level II certification.
Benefits:
Benefits include flexible DTO, student loan paydown and professional reimbursements, company discounts, and low-cost medical/dental/vision coverage with Anthem, to name a few.
Education/Experience include:
A bachelor’s degree with 5 years of experience in performing similar or related work is required. Four years of experience may be substituted for a bachelor’s degree.
Clearance Type:
TS//SCI clearance required.
Travel:
Travel may be required for this role up to 10%.
AAP/EEO Statement:
Equal Opportunity Employer – M/F/Disabled/Veteran
Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.
Zapata Technology, Inc. provides reasonable accommodation to applicants who are veterans or who have disabilities and are unable to fully use our company application system. If you need a reasonable accommodation for any part of the application and hiring process, please notify Christina Hall, EEO Coordinator at ChristinaHall@ZapataTechnology.com