What are the responsibilities and job description for the AWS Data Engineer position at Iris Software Inc.?
Our direct end client which is one of the largest mutual life insurance company is urgently looking to hire AWS Data Engineer -Bethlehem, PA / Holmdel NJ / New York, NY (Hybrid). This is a Contract opportunity.
AWS Data Engineer
Location: Bethlehem, PA / Holmdel NJ / New York, NY (Hybrid/ 3 days office & 2 days work from home)
Nature of Contract: Contract opportunity
We are seeking a hands-on-keyboard Data Engineer to build core data assets for a new third-party billing, commission, and claims application. You will design and execute data pipelines to move data into a Databricks lakehouse environment, creating reusable, reporting-ready data structures to support analytics and reporting.
Core Mission:
Move and transform data from source systems into a Databricks-based client’s Data Lake using the Medallion Architecture (Bronze → Silver layers). Build standardized, domain-aligned tables—not one-off datasets—to serve 40-50 planned reports and future analytics.
Key Responsibilities:
- Write complex, optimized SQL to interrogate Oracle databases and explore raw data in Databricks.
- Develop and deploy production Python/PySpark scripts to build and extend data transformation pipelines.
- Analyze data attributes for planned reports; identify gaps and extend schemas accordingly.
- Build reusable, generalized data assets following architectural standards for a warehouse-like layer.
- Work within AWS cloud infrastructure (Databricks on AWS) and follow existing frameworks and patterns.
- Collaborate with data architects and participate in peer code reviews.
Technical Requirements (Must-Haves):
- Expert-level SQL proficiency – This is the most critical skill.
- Hands-on development experience with Python and PySpark for building data pipelines.
- Practical experience with Databricks and the Medallion Architecture (Bronze/Silver/Gold layers).
- AWS cloud platform experience.
- Strong data analysis skills: ability to explore data and perform attribute-level analysis.
- Experience understanding object-oriented data models and working with transactional databases (e.g., Oracle).
Looking forward to hear from you...!!!
Best Regards,
Bharat Sharma
Sr. Talent Acquisition – Executive
Iris Software
200 Metroplex Drive, Suite #300
Edison, NJ 08817
Mail: bharat.sharma@irissoftware.com | www.irissoftware.com