What are the responsibilities and job description for the Cloud Data Engineer only on w2(USC or GC) only local to St Louis, MO position at PRI Global?
Cloud Data Engineer
Remote(Only local to St Louis, MO)
Contract
Required:
• Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future
• Must reside in St. Louis, Missouri, or immediate surrounding area
• Must be able to work a schedule within U.S. Central Standard Time core business hours.
• Must have 3 or more years’ experience in full lifecycle development and end-to-end testing and data validation
• Apache Spark Fundamentals: Understanding Spark architecture, distributed computing, Data Frames, and Spark SQL
• Experience with relational databases such as Oracle, SQL Server, Postgres, or Teradata.
• Hands-on experience supporting applications deployed on Azure services such as Spark, Azure Functions, and Azure SQL.
• Experience writing scalable data pipelines and transformations. (e.g., Python, Scala, or Java)
• Must be committed to incorporating security into all decisions and daily job responsibilities
Preferred:
• Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, or related field preferred
• Experience with Big Data Solutions and no SQL DBMSs
• Experience working with ADLSg2 or other Blob Storage solutions
• Experience with change data capture (CDC) and identifying data deltas for incremental data processing. (e.g. SCD type 1 / SCD type 2)
• Experience with API development and support of Azure functions
• Experience with Azure, AWS, or other Public Cloud environments
• Experience with Microsoft Azure platform technologies like Event Hubs, Data Factory, Delta Lake, Cosmos DB, or DevOps
• Prior experience with Enterprise IT Rental or Vehicle domain knowledge
• Prior experience leading large-scale projects