What are the responsibilities and job description for the Data Engineer-Python/PySpark position at Programmers.io?
One of our clients which is having operations globally is looking a Data Engineer - Python/PySpark- Jersey City, NJ (3 Days onsite/week). Please find the below job description and request you to share me your resume to srinath.k@programmers.ai
Position: Data Engineer-Python/PySpark
Duration: Full time
Location: Jersey City, NJ -3 Days onsite/week
Experience: 10 Years only
Need strong experience in Python, PySpark, SQL, Schema Drift and File Format
Requirements:
10 years of experience as a Data Engineer with strong Python and PySpark expertise
Experience building scalable ETL/ELT pipelines in big data environments
Strong understanding of KYC/AML and Client Onboarding domains
Hands-on experience with Spark, Hadoop, Kafka, and cloud platforms
Solid knowledge of SQL and NoSQL databases
Key Responsibilities*
Design, develop, and maintain scalable data pipelines
Process large volumes of structured and unstructured data
Implement KYC/AML data solutions supporting client lifecycle management
Optimize Spark jobs for performance and reliability
Collaborate with cross-functional agile teams and stakeholders