Job Title: Data Engineer

Location: Richmond, VA/ Hybrid (3 days onsite in office and 2 days remote)

Duration: ~12 months

Basic Qualifications:

5 years of experience developing, deploying, testing in AWS public cloud

5 Pyspark , Python , Scala

5 years of knowledge of integration and acceptance testing.

5 years of experience delivering big data solutions using open-source language

5 years of data transformation ETL

5 years of experience in Kubernetes/Docker containers

Please see the job description below. Thanks!

Skills and Experience

Comfortable interpreting legacy Ab Initio logic which will be re-coded in new open source languages and cloud technologies

Solid understanding and experience in Cloud computing, preferably AWS and its services including S3, EMR/EC2 and Lambda functions

Solid understanding and experience in big data solutions using open-source languages such as Python and Scala on Apache Spark framework

Experience working on data projects and data management involving querying databases and/or transforming legacy data platforms to future data streaming platforms.

Solid understanding and experience in the following scripting languages. (e.g Unix shell scripting, perl etc)\

Solid verbal and written communication skills.