113 Senior Data Engineer Jobs in Bethesda, MD
Sorry! This job is no longer available. Please explore similar jobs listed on the left.
Base-2 Solutions, LLC is Hiring a Senior Data Engineer Near Bethesda, MD
Do you like to design and develop big data solutions? If so we have a DevSecOps/Data Engineer position to assist with the design, development and implementation of alternative data ingestion pipelines to augment the National Media Exploitation Center (NMEC) data services. The DOMEX Data Discovery Platform (D3P) program is a next generation machine learning pipeline platform providing cutting edge data enrichment, triage, and analytics capabilities to Defense and Intelligence Community members. This engineer will collaborate as part of a cross-functional Agile team to create and enhance data ingestion pipelines and addressing big data challenges. You will work closely with the chief architect, systems engineers, software engineers, and data scientists on the following key tasks:
Fun stuff you will do on the job
- Provide Extraction, Transformation, and Load (ETL) experience coupled with enterprise search capabilities to solve Big Data challenges
- Design and implement high-volume data ingestion and streaming pipelines using Open Source frameworks like Apache Spark, Flink, Nifi, and Kafka on AWS Cloud
- Leverage strategic and analytical skills to understand and solve customer and business centric questions
- Create prototypes and proofs of concept for iterative development
- Learn new technologies and apply the knowledge in production systems
- Monitor and troubleshoot performance issues on the enterprise data pipelines and the data lake
- Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives
This is you
- BS in Computer Science, Systems Engineering, or related technical field or equivalent experience with at least 8 years in systems engineering or administration (6 years with a MS/MIS Degree). (4 years for mid-level)
- Must have an active Top Secret security clearance and able to obtain a TS/SCI with Polygraph.
- 2 years of experience with big data tools: Hadoop, Spark, Kafka, NiFi, Pulsar
- 2 years of experience with object-oriented/object function scripting languages: Python (preferred) and/or Java
- 2 years of experience with and managing data across relational SQL and NoSQL databases like MySQL, Postgres, Cassandra, HDFS, Redis, and Elasticsearch
- 2 years of experience working in a Linux environment
- Experience working with and designing REST APIs
- Experience developing data ingest workflows with stream-processing systems: Spark-Streaming, Kafka Streams and/or Flink
- Experience transforming data in various formats, including JSON, XML, CSV, and zipped files
- Experience developing flexible ontologies to fit data from multiple sources and implementing the ontology in the form of database mappings / schemas
- Good interpersonal and communication skills necessary to work effectively with customers and other team members.
You will wow us if you have these skills
- Data engineering experience in Intelligence Community or other government agencies
- Experience with Microservices architecture components, including Docker and Kubernetes.
- Experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, Athena and/or Glue
- Experience with Jira, Confluence and extensive experience with Agile methodologies.
- Knowledge about security and best practices.
- Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources
- Experience with software configuration management tools such as Git/Gitlab, Salt, Confluence, etc.
- Experience with continuous integration and deployment (CI/CD) pipelines and their enabling tools such as Jenkins, Nexus, etc.
- Detailed oriented/self-motivated with the ability to learn and deploy new technology quickly
Job Summary
Full Time
IT Outsourcing & Consulting
07/21/2022
11/10/2022
base-2solutions.com
WASHINGTON, DC
<25
2016
TYSEN LECKIE
<$5M
IT Outsourcing & Consulting
Related Companies
About Base 2 Solutions
Base-2 Solutions is a woman-owned small business based in Washington, DC, employing personnel to support our national security mission and the forward-deployed Warfighter. We are a premier provider of solutions in the areas of Software & System Engineering, Cyber Security, Cloud Computing, Big Data, DevSecOps and Data Analytics.
The job skills required for Senior Data Engineer include Communication Skills, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
Similar Jobs
Popular Articles
