What are the responsibilities and job description for the Data Engineer with Security Clearance position at MBL Technologies Inc.?
Innovien Solutions is hiring an experienced Data Engineer supporting various efforts around their core data and analytics platform. You will be joining a team that securely connects more than 3 million end users at over 3,000 DoD and Federal sites around the world. In this position, you will help lead core data platform engineering – owning the full data pipeline lifecycle from ingestion to delivery, expanding the foundational Integrated Data Architecture platform, and building scalable, optimized data infrastructure in support of mission-critical DoD network operations. *Must sit onsite 2-3x weekly at one of the following locations: Ft. Meade, MD, Scott Air Force Base, IL or Hill Air Force Base, UT.* Apply today to connect with our team for more details! REQUIREMENTS:
- 7 years of hands-on end to end data engineering experience – building and optimizing ETL processes and data pipelines
- 3 years’ experience building pipelines with Elastic/ELK stack (Elasticsearch, Logstash, Kibana)
- Extensive experience utilizing data pipeline messaging or flow platforms such as Apache Kafka/Confluent or Nifi, AWS Kinesis or EventBridge, Azure Event Hubs, RabbitMQ
- Experience with OpenShift or Kubernetes for container orchestration and platform deployment
- Python, Java, and/or SQL programming experience
- Experience working in Agile development environment (SDLC) supporting sprint cycles, testing, and deployment activities
- Active SECRET Clearance or higher REQUIRED
- CompTIA Security certification required within the first 14 days of employment
- B.S. Degree PREFERRED SKILLSET:
- Certified Confluent Developer and/or Certified Elastic Engineer Certifications
- Databricks platform experience
- Experience developing and deploying software in a DoD environment
- Experience with Atlassian tools including JIRA and Confluence RESPONSIBILITIES:
- Contribute to data engineering efforts by supporting the integration and enrichment of DISN network topology data for advanced data correlation and analytics.
- Participate in technical discussions with internal and external stakeholders to support solution design and implementation.
- Develop, test, and deploy data pipelines and integration solutions across distributed systems and cloud environments, using Python, JavaScript, Java, and SQL.
- Assist in requirements gathering and collaborate with stakeholders to design and implement data enrichment pipelines, integrating diverse data sources into Confluent (Kafka) and Elastic platforms.
- Develop and maintain Kibana visualizations and dashboards to support operational insights.
- Support Kafka system integrations between Elasticsearch/Logstash and other systems.
- Collaborate within Agile scrum teams, contribute to team deliverables, and share knowledge with peers.
- Communicate and coordinate effectively with geographically distributed team members to achieve project objectives.
- Troubleshoot and help resolve installation, infrastructure, and system issues; report and help mitigate technical risks.
- Develop and maintain technical documentation, including DoD requirements, interface documents, and security compliance artifacts.
- Ensure solutions comply with DoD security standards and guidelines, and support platform sustainment and reliability by addressing operational challenges as needed