What are the responsibilities and job description for the Data Engineer|| W2 only position at Holistic Partners, Inc?
Job Opportunity: Data Engineer
Location: Wilmington, DE – Onsite
Duration: Contract to Hire
Interview Process: Zoom interview with Live Coding; onsite may be required
Open for USC/GC/GC EAD only due to legal or government contract requirement
Key Responsibility
- Create/manage ETL pipelines for the data lake and Snowflake; automate data analysis/aggregation work.
- Design, build, and manage scalable ETL pipelines for a data lake and Snowflake environment, ensuring efficient data ingestion, transformation, and loading.
- Automate data analysis and aggregation processes to support business insights and reporting.
- Collaborate with cross-functional teams to optimize data workflows and maintain data quality.
Key Skills:
Data lake, AWS, ETL, Snowflake, Control‑M, Apache Airflow, PySpark, Java Spark
Experience: 8–10 years
Project: Large-scale Financial Data Exchange & Data Security platform handling transaction processing and data movement.
Role: 60% Data Engineering, 40% Programming (Python/Java).
Must-Have Skills:
- PySpark (Strong hands-on experience)
- Apache Spark
- AWS Glue ETL
- AWS EMR
- Snowflake
- Python
- Java
- Data Structures & Algorithms
- AWS/Cloud Infrastructure
Preferred Domain: Banking, Financial Services, Payments, Transaction Processing.