What are the responsibilities and job description for the Big Data Engineer PySpark, Scala 68683 position at PRIMUS Global Services Inc.?
Big Data Engineer PySpark, Scala
The ideal candidate will have strong hands-on expertise with PySpark, Scala, Spark, SQL, Unix/Linux environments, and enterprise-scale data processing frameworks.
Candidates should have experience building and optimizing batch-oriented pipelines, working with distributed big data platforms, and supporting data sourcing, ingestion, and transformation workflows.
In this role, you will lead end-to-end development of large-scale data pipelines supporting raw data ingestion, conformance, and downstream curation teams.
Location: Charlotte, North Carolina (Hybrid 3 Days Onsite)