What are the responsibilities and job description for the Data Engineer position at Hallmark Global Solutions Ltd?
π Hiring: Databricks Engineer (PySpark & Data Lake)
π Wilmington, DE ( IN Person Interview) | π’ 5 Days Onsite | β³ Long-Term Project
Weβre looking for a strong Data Engineer to drive the modernization of legacy ETL systems by migrating Ab Initio workflows into scalable PySpark pipelines on Databricks.
This is a great opportunity to work on large-scale data transformation, building cloud-native architectures while ensuring high performance, data quality, and reliability.
π― Key Responsibilities
πΉ Migrate legacy ETL workflows (Ab Initio β PySpark on Databricks)
πΉ Design & develop scalable, modular data pipelines
πΉ Build ETL/ELT pipelines integrating Snowflake & other data sources
πΉ Support batch & near real-time data processing
πΉ Create data lineage & optimize workflows
πΉ Perform testing, validation & UAT support
πΉ Drive deployment, migration & system cutover strategies
π‘ What Weβre Looking For
β Strong experience with Databricks & PySpark
β Hands-on in ETL/ELT pipeline development
β Experience with Snowflake / Data Lake architectures
β Background in legacy ETL migration (Ab Initio preferred)
β Strong understanding of data governance, optimization & performance
π© If you or someone in your network is a fit, feel free to reach out or share your resume at salomon@hgtechinc.net