What are the responsibilities and job description for the Visa Independent - Sr Data Engineer - Local to PA position at Octans Group LLC?
Visa Independent & Local to PA
Position: Sr. Data Engineer
Location: PA (Local Candidates Only)
Requirement:
We are seeking an experienced Senior Data Engineer with strong expertise in Python, PySpark, AWS Glue, and SQL to design and develop scalable ETL/ELT data pipelines and modernize enterprise data platforms. The ideal candidate will have hands-on experience with AWS data services, complex SQL performance tuning, data quality, and large-scale data processing.
Required Skills:
-
Python, PySpark, Pandas, NumPy
-
AWS Glue, S3, Lambda, Redshift, Athena
-
SQL (Oracle/Snowflake) with performance tuning
-
ETL/ELT pipeline development
-
Data validation and data quality
-
Unix scripting and automation
-
Experience with DevOps tools (Jenkins, Docker, Terraform) is a plus
-
Investment/Financial domain experience preferred