AWS Data Engineer - W2 role

We have 2 openings for this and urgently need candidates. Must be Cap One former

Job Title

• Lead data engineer

6 month extensions

Remote

Worksite Location

• 1680 Capital One Dr, Mclean, VA, 22102, USA or REMOTE

Top Skills - Must Haves

• Python
• Sql
• Aws
• Data
• Etl
• Integration
• Big data
• Agile
• snowflake
• databricks
• EMR
• Glue
• Lambda
• cloudwatch
• S3

Top Skills' Details

Discover's historical credit card data will be in the Capital One ecosystem in OneStream's OneLake location and these Engineering teams will be responsible for picking the data up, transforming and loading into target state, which could be Snowflake or AWS S3

6 Data Engineering teams with 2 Midlevel Data Engineers each (Capital One formers required)

- Able to work independently

Tech Stack: Must Have / Nice to Have

Must Have

AWS(EMR/Glue, S3, Lambda, Cloudwatch), Python/Java, Spark, Databricks, SQL, Bash)

Python use: scripting, building new data pipelines (not app dev)

Data warehousing experience (Snowflake)

APIs

Agile engineering practices & JIRA usage

Nice to Have

- Kafka, Airflow, Open Table formats (Delta, Hudi, Iceberg), Splunk, NewRelic, Github, Jenkins, prior Capital One experience highly preferred

Can be remote or located in Capital One core locations (listed in order of preference)

- Chicago

- McLean

- Richmond

- Plano

Secondary Skills - Nice to Haves

• kafka
• airflow

Job Description

Tech Stack: Must Have / Nice to Have

Must Have

AWS(EMR/Glue, S3, Lambda, Cloudwatch), Python/Java, Spark, Databricks, SQL, Bash)

Python use: scripting, building new data pipelines (not app dev)

Data warehousing experience (Snowflake)

APIs

Agile engineering practices & JIRA usage

Nice to Have

- Kafka, Airflow, Open Table formats (Delta, Hudi, Iceberg), Splunk, NewRelic, Github, Jenkins

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.