What are the responsibilities and job description for the Data Engineer position at Bespoke Technologies, Inc.?
BT-154 – Data Engineer Analyst
Skill Level: Senior
Location: Chantilly/Herndon
As a Data Engineer at the Senior Analyst level, you will be a key contributor to the team responsible for building and maintaining the data pipelines for a Data Platform. This is a hands-on role where you will support the development, deployment, and operation of critical data infrastructure. You will work closely with senior engineers, applying your technical skills to execute tasks, troubleshoot issues, and learn the foundations of enterprise-scale data engineering.
Responsibilities
Skill Level: Senior
Location: Chantilly/Herndon
- MUST HAVE A TS/SCI CLEARANCE TO APPLY. Those without an active security clearance will not be considered.**
As a Data Engineer at the Senior Analyst level, you will be a key contributor to the team responsible for building and maintaining the data pipelines for a Data Platform. This is a hands-on role where you will support the development, deployment, and operation of critical data infrastructure. You will work closely with senior engineers, applying your technical skills to execute tasks, troubleshoot issues, and learn the foundations of enterprise-scale data engineering.
Responsibilities
- Assist in the development and maintenance of ETL/ELT data pipelines using established patterns and tools.
- Utilize reusable pipeline templates and Infrastructure-as-Code (IaC) scripts to deploy data flows consistently and efficiently.
- Support the O&M of existing pipelines by monitoring performance, troubleshooting failures, and responding to alerts.
- Execute data quality checks and assist in the implementation of data validation rules
- Work with senior team members to test and deploy new pipeline features and optimizations.
- Contribute to the creation and maintenance of technical documentation for data pipelines and processes.
- 2 years of experience in a data-focused role (e.g., data engineering, backend development, database administration).
- Experience with Python and SQL for data manipulation and scripting.
- Familiarity with data engineering concepts, including ETL processes and data warehousing.
- Exposure to cloud environments (e.g., AWS, Azure) and data platforms like Databricks or Snowflake.
- Basic understanding of Agile/Scrum methodologies.
- A strong desire to learn and grow in the data engineering field.
- Active Top Secret/SCI security clearance.
- Direct experience with data platforms.
- Experience with Spark/PySpark.
- Familiarity with Infrastructure-as-Code tools like Terraform.
- Exposure to data orchestration tools (e.g., Airflow) or CI/CD pipelines.
