What are the responsibilities and job description for the Excellent Opportunity - PySpark Developer in Irving, TX- Fulltime. position at SR Partners LLC?
Hi,
We are currently looking for a PySpark Developer for a full-time opportunity in Irving, TX with one of our global clients.
If you are interested, please reply with your updated resume and let me know a convenient time to discuss the opportunity.
Job Title: PySpark Developer
Experience: 8- 10 Years
Location: Irving, TX- Hybrid
Duration: Fulltime
Role Overview:
- Experience with big data processing and distributed computing systems like Spark.
- Implement ETL pipelines and data transformation processes.
- Ensure data quality and integrity in all data processing workflows.
- Troubleshoot and resolve issues related to PySpark applications and workflows.
- Understand source, dependencies and data flow from converted PySpark code.
- Strong programming skills in Python and SQL.
- Experience with big data technologies like Hadoop, Hive, and Kafka.
- Understanding of data warehousing concepts and relational databases like SQL.
- Demonstrate and document code lineage.
- Integrate PySpark code with frameworks such as Ingestion Framework, DataLens, etc.,
- Ensure compliance with data security, privacy regulations, and organizational standards.
- Knowledge of CI/CD pipelines and DevOps practices.
- Strong problem-solving and analytical skills.
- Excellent communication and leadership abilities.
Qualifications:
- 4 years of experience in big data development, Hadoop , Hive & Spark framework.
- Good to have experience in SAS.
- Strong Python, PySpark Development and SQL knowledge.
- Certification in big data or cloud technologies is preferred.
PSRTEK is a reputed technology recruitment and IT staffing brand with a global footprint and an admired client base. As an ideas and innovation powerhouse with a culture of excellence, we bring remarkable expertise and deliver powerfully transformative results.