What are the responsibilities and job description for the Senior Data Engineer position at wellsfargo?
Description
Title: Senior Data Engineer
Location: Phoenix, AZ
Duration: 12 months
Work Engagement: W2
Work Schedule: Hybrid 3 days in office/2 days remote
Benefits on offer for this contract position: Health Insurance, Life insurance, 401K and Voluntary Benefits
Summary:
In this contingent resource assignment, you may: Participate in low to moderately complex initiatives and identify opportunity for process improvements within Software Engineering. Review and analyze basic or tactical Software Engineering assignments or challenges that require research, evaluation, and selection of alternatives, related to low-to-medium risk deliverables. Present recommendations for resolving low to moderately complex situations and exercise some independent judgment while developing understanding of function, policies, procedures, and compliance requirements. Provide information to client personnel in Software Engineering. Required Qualifications: Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.
Key Requirements:
· Applicants must be authorized to work for ANY employer in the U.S. This position is not eligible for visa sponsorship.
Experience in data engineering including hands-on experience working with Hadoop and Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, in a highly collaborative team
hands-on experience developing data flows using Kafka, Flink, and Spark streaming
Experience with Data lakehouse architecture and design, including hands-on experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GPC Cloud Storage, BigQuery, Data Proc, Cloud Composer
Working with NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats
Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics
Desired Qualifications:
Proven skills with data migration from on-prem to a cloud native environment
Proven experience working with the Hadoop ecosystem capabilities such as Hive, HDFS, Parquet, Iceberg, and Delta Tables
Deep understanding of data warehouse, data cloud architecture, building data pipelines, and orchestration
Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance
Familiarity of GenAI frameworks such as Langchain and Langraph to develop agent-based data capabilities
Dev Ops and CI/CD deployments including Git, Jenkins, Docker, and Kubernetes
Web based UI development using React and Node JS is a plus