Data Engineer

You...

As a Data Engineer, you will be joining the team that is deploying and delivering a cloud-based, multi-domain Common Data Fabric (CDF), which provides data sharing services to the entire DoD Intelligence Community (IC). The CDF connects all IC data providers and consumers. It uses fully automated policy-based access controls to create a machine-to-machine data brokerage service, which is enabling the transition away from legacy point-to-point solutions across the IC enterprise.

Us...

We were founded as a fresh alternative in the Government Consulting Community and are dedicated to the belief that results are a product of analytical thinking, agile design principles and that solutions are built in collaboration with, not for, our customers. This mantra drives us to succeed and act as true partners in advancing our client's missions.

Program Mission...

The CDF program is an evolution for the way DoD programs, services, and combat support agencies access data by providing data consumers (e.g., systems, app developers, etc.) with a "one-stop shop" for obtaining ISR data. The CDF significantly increases the DI2E's ability to meet the ISR needs of joint and combined task force commanders by providing enterprise data at scale. The CDF serves as the scalable, modular, open architecture that enables interoperability for the collection, processing, exploitation, dissemination, and archiving of all forms and formats of intelligence data. Through the CDF, programs can easily share data and access new sources using their existing architecture. The CDF is a network and end-user agnostic capability that enables enterprise intelligence data sharing from sensor tasking to product dissemination.

Responsibilities...

Primarily responsible for defining and executing a process to document and prioritize data mapping and transformation requirements for the DoD/IC enterprise. Develop detailed data mapping and transformation requirements packages to be used by CDF Common Transformation Service (CTS) engineers to implement within the CTS system. In this role, you will:

• Designing, developing, and maintaining high-performance Java-based applications.
• Writing well-designed, efficient, and testable code.
• Collaborating with cross-functional teams to define, design, and add new features.
• Debugging and resolving application issues to ensure optimal performance.
• Participating in code reviews and knowledge-sharing sessions.
• Develop, optimize, and maintain data ingest flows using Apache Nifi, Java, and Python.
• Develop within the components in the cloud platform, such as Apache Kafka, NiFi, HDFS/HBase.
• Communicate with data owners to set up and ensure CDF streaming and batching components are working (including configuration parameters).
• Document SOP related to streaming configuration, batch configuration or API management depending on role requirement.
• Document details of each data ingest activity to ensure they can be understood by the rest of the team.

What we'd like to see...

• A minimum of 5 years of experience with programming and software development including analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems.
• Proven experience as a Java and Python Developer.
• DoD 8570 IAT Level II Certification (e.g. Security ) or the ability to obtain the certification within 90 days.
• Demonstrable Linux command line knowledge.
• Working knowledge of web services environments, languages, and formats such as RESTful APIs, SOAP, HTML, JavaScript, XML, and JSON.
• Understanding of foundational ETL concepts.
• Experience implementing data ignorations with in the IC DoD Enterprise.
• Experience with data flow, management, and storage solutions (i.e. Kafka, NiFi, and AWS S3).

Desired Skills:

• Knowledge of software development best practices and design patterns.
• Java (Core and Enterprise Edition) and Python.
• Version control systems (Git).
• Build tools (Maven, Nexus).
• Experience or expertise using, managing, and/or testing API Gateway tools and Rest APIs (desired).
• 5 Experience in Java Development and Python.
• Advanced organizational skills with the ability to handle multiple assignments.
• Strong written and oral communication skills.

Years of Experience: Mid Level (5-8 years)

Education: Bachelor's degree in systems engineering, computer engineering, or a related technical field (preferred)

Location: Chantilly, VA

Clearance: Active TS/SCI w/ ability to obtain CI Poly