Data Engineer- ETL
Locations: Huntsville, Alabama
Clearance Requirement: Active Top-Secret Clearance (SCI Eligibility) Role & Responsibilities Technology is constantly changing, and our adversaries are digitally exceeding law enforcement’s
ability to keep pace. Those charged with protecting the United States are not always able to access the
evidence needed to prosecute crime and prevent terrorism. In response to this challenge, we are
seeking a Data Engineer with expertise in ETL. • Experience with ETL processing pipeline using Databricks or equivalent platform using Apache Spark with Scala, Python, Java. • Understanding of programming and data engineering concepts and best practice. • Experience with Python, SQL, and/or Spark. • Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis. • Ability to manage and organize data while identifying trends and inconsistencies that will impact downstream analytics. • Ability to work both independently and collaboratively. • High levels of curiosity, creativity, and problem-solving capabilities. • Strong written and verbal communication skills. • Experience with data pipelines or be willing to learn a pipeline from bottom to top. • Be able to troubleshoot files against an architecture to see where the upload process is failing. • Be able to understand unit tests and add to them to increase stability to the entire pipeline. • Be prepared to use, GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools. • Be prepared to express ideas and solutions and walk together with teammates through coding challenges. Required Qualifications: • BS Degree or equivalent and 10 years of experience with programming and software development to include analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems. • A current Top Secret security clearance with SCI eligibility Desired Qualifications: • Have experience with AWS cloud services including Glue, Kinesis and Container services. • Have knowledge of setting up REST APIs. • Have knowledge of Databricks. • Have experience SQL and its associated tables and queries. • Have worked in an Agile environment. • You have worked on teams that practice Agile methodologies.