1 Python Pyspark developer Job in Dusseldorf, KY

SORT BY

SET JOB ALERT

OFF

Details...

Python Pyspark developer

N Consulting

Dusseldorf, KY | Contractor

$88k-111k (estimate)

2 Months Ago

Python Pyspark developer

N Consulting Dusseldorf, KY

$88k-111k (estimate)

Contractor 2 Months Ago

Save

N Consulting is Hiring a Python Pyspark developer Near Dusseldorf, KY

Required Core Skills:
- Python
- PySpark
- SQL
- Shell scripting
- Linux commands
Any of these Database (Oracle, Postgre SQL, MS SQL Server, MongoDB)
- Requirement Analysis
- Incident Managemnt
- Development and testing
Nice to have skills:
- Java 7/8
Minimum years of experience: 5 - 7 years
Areas of responsibility / Detailed Job Description:
• Talent will need to work as a lead at onsite
• Should be able to perform data integration with cross platforms,
• Should be able to setup data connections from various source,
• Should be able to build transform in SQL or PySpark/Python,
• Should be able to build data pipelines using pipeline builder or code repositories.
• Should be able to configure and setup/manage Middleware agents on Linux so need to have knowledge on Linux system and commands.
• Should be able to debug check, build failures which requires understanding in spark framework and java to optimize the failures.
• Should be able to administer platform, which involves whitelisting endpoints, ingress/egress policy setup, SAML config/management/migration, role setup, organization permission setup.
• Should be able to perform Governance operations which involves PII data identification/rectification, access approval setup.
• Should be able to perform security operations which involve vulnerability fixes, resource management on servers.
• Should be able to support ontologies and other data pipelines.