What are the responsibilities and job description for the Data Engineer - Malvern, PA position at TechniPros, LLC?
Job Title: Data Engineer
Long term Contract
Location: Malvern, PA/Wilmington, DE/Cherry Hill, NJ/ New York City, NY/Norwalk, CT.
Can do Only W2, No C2C
Job Description:
We are seeking an experienced AWS Data Engineer to design, develop, and optimize scalable data solutions on AWS. The ideal candidate will have strong expertise in AWS data services, ETL/ELT development, data warehousing, and big data processing using Python and PySpark.
Required Skills:
- AWS Glue (Crawlers, Data Catalog, ETL Jobs)
- Python and PySpark
- SQL and Data Warehousing
- Amazon S3, Athena, Redshift, and Lambda
- ETL/ELT Pipeline Development
- Data Modeling and Data Integration
- Git and CI/CD Tools
- Agile/Scrum Methodologies
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines using AWS services.
- Build and optimize data processing workflows using AWS Glue, PySpark, and Python.
- Develop and manage data warehouses using Amazon Redshift and related AWS technologies.
- Integrate data from multiple sources and ensure data quality and consistency.
- Work with large datasets stored in Amazon S3 and query data using Athena.
- Implement automation and monitoring solutions using AWS Lambda and other AWS services.
- Collaborate with cross-functional teams in an Agile environment.
- Utilize Git and CI/CD pipelines for code management and deployment.
Best Regards:
Tina
Phone:
Email: