What are the responsibilities and job description for the Cloud Data Engineer only on w2(USC or GC ) position at PRI Global?
Cloud Data Engineering (Production Support)
St Louis, MO(Hybrid)
Contract
Local consultants will be considerded
Only on w2(USC or GC)
Core Responsibilities
- Production support for Databricks notebooks, Spark streaming apps, and APIs.
- Ownership of Level 1 / Bronze batch ingestion for ~60 data sources.
- Work includes:
- Data ingestion from various relational DBs or AWS → Delta Lake.
- Adding new tables/columns, change management, GDPR/purge processes.
- Product optimization: upgrades, resiliency work, performance improvements.
- Occasional new development for shared-service tools, not business-facing projects.
Required Technical Skills
- Python (must have)
- Spark fundamentals (architecture, DataFrames, Spark SQL)
- Databricks experience
- Relational DB experience (Oracle, SQL Server, Postgres; not a DBA)
- Understanding of Delta Lake
Nice-to-Haves:
- Spark streaming
- API development experience
- Azure experience preferred; AWS acceptable
- Scala not required