What are the responsibilities and job description for the Fulltime Role :: PySpark Developer--Pittsburgh, PA / Dallas, TX / Cleveland, OH (Onsite) position at Noblesoft Technologies?
Job Title: PySpark Developer
Locations: Pittsburgh, PA / Dallas, TX / Cleveland, OH (Onsite)
Required Skills
Strong hands-on experience with PySpark and Apache Spark
Proficiency in Python
Experience with Hadoop ecosystem (HDFS, Hive, etc.)
Knowledge of SQL and data modeling
Experience with ETL processes and data pipeline development
Familiarity with cloud platforms (AWS, Azure, or GCP)
Strong problem-solving and debugging skills
Preferred Qualifications
Experience in banking/financial services domain (especially with PNC Bank projects)
Knowledge of data warehousing concepts
Experience with tools like Airflow, Kafka, or Databricks
Understanding of CI/CD pipelines for data engineering
Locations: Pittsburgh, PA / Dallas, TX / Cleveland, OH (Onsite)
Required Skills
Strong hands-on experience with PySpark and Apache Spark
Proficiency in Python
Experience with Hadoop ecosystem (HDFS, Hive, etc.)
Knowledge of SQL and data modeling
Experience with ETL processes and data pipeline development
Familiarity with cloud platforms (AWS, Azure, or GCP)
Strong problem-solving and debugging skills
Preferred Qualifications
Experience in banking/financial services domain (especially with PNC Bank projects)
Knowledge of data warehousing concepts
Experience with tools like Airflow, Kafka, or Databricks
Understanding of CI/CD pipelines for data engineering