Senior Data Engineer

Job Title

Senior Data Engineer

Location

Huntsville, AL 35808 US (Primary)

Category

Information Technology

Job Type

Full-time

Career Level

Experienced (Non-Manager)

Education

High School / GED

Travel

None

Security Clearance Required

TS

Job Description

TMC Technologies is in search of a Senior Data Engineer to support ongoing development within the FBI's Enterprise Cyber Security Section.   The candidate must be a US citizen and possess a minimum of an active Top Secret clearance to start due to federal contract requirements.  

The Senior Data Engineer will have the following responsibilities:

- Deploy and develop pipelines and platforms that organize and make disparate data meaningful
- Guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in an agile environment 
- Provide experience in analytical exploration and data examination 
- Manage the assessment, design, building, and maintenance of scalable platforms
- Responsible for carrying out engineering tasks to deliver an advanced visual analytic application to include: developing data analytics for desktop and web-developed visual analytic software; facilitating the bulk analysis of relational information utilizing advanced graphics, visualization, and high-performance computing, as well as using the specified open source, COTS, and GOTS technologies; and establishing an application that produces manageable, actionable intelligence from streams of a structured and semi-structured data 
- Design strategies for enterprise database systems and set standards for operations, programming, and security 
- Design and construct large relational databases 
- Integrate new systems with existing warehouse structure and refine system performance and functionality

Job Requirements

- US Citizenship and active Top Secret clearance required
- Bachelor’s degree and 8 years of experience designing, developing, operationalizing, and maintaining data systems, or 12 years of experience designing, developing, operationalizing, and maintaining data systems in lieu of degree
- Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance
- Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management
- Experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems
- Experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data
- Experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java

Preferred Qualifications:
- SCI eligibility
- 3 years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps
- Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery
- Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub

We are equal opportunity/affirmative action employers, committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, disability, or protected veteran status, or any other protected characteristic under state or local law.