What are the responsibilities and job description for the Data Engineer - Python/PySpark - Full Time Only position at Programmers.io?
Role: Data Engineer - Python/PySpark
Location: Jersey City, NJ (3 Days onsite/week)
Job Description:
Job Requirements*
- 3–6 years of experience as a Data Engineer with strong Python and PySpark expertise
- Experience building scalable ETL/ELT pipelines in big data environments
- Strong understanding of KYC/AML and Client Onboarding domains
- Hands-on experience with Spark, Hadoop, Kafka, and cloud platforms
- Solid knowledge of SQL and NoSQL databases
Key Responsibilities*
Design, develop, and maintain scalable data pipelines
- Process large volumes of structured and unstructured data
- Implement KYC/AML data solutions supporting client lifecycle management
- Optimize Spark jobs for performance and reliability
- Collaborate with cross-functional agile teams and stakeholders