What are the responsibilities and job description for the AWS Senior Data Engineer position at Lorven Technologies, Inc.?
Hi,
Our client is looking for a AWS Senior Data Engineer in Jersey City ,NJ location, below is the detailed requirement.
Job Title: AWS Senior Data Engineer
Location: Jersey City, NJ
Job Description:
- Bachelor’s degree in related field.
- Hands on programming experience in python and PYSparkAdvanced SQL skills with query optimization techniques.
- Strong understanding of AWS and distributed computing paradigms ability to design and develop data ingestion programs to process large data sets in Batch mode using Glue Lambda S3 redshift and data bricksBasic understanding of IAM roles security and AWS infrastructure
- Hands on experience to work with large scale data platforms in development of cloud solutions in AWS data platform with proven track record in driving business success
- Understanding of Dev Ops Pipelines using Jenkins GitLab should be strong in data modelling and Data architecture concepts well versed with Project management tools and Agile Methodology
- Sound knowledge of data governance principles and tools alationglue data quality mesh Capable of suggesting solution architecture for diverse technology applications.
- Ability to develop data ingestion programs to ingest realtime data from LIVE sources using Apache Kafka Spark Streaming and related technologies
- Understanding of DBT Data Build Tool for data transformation and modeling.