What are the responsibilities and job description for the Data Engineer position at Horizontal Talent?
Join a dynamic team in Irvine, California as a Data Engineer, where you will leverage your skills in data engineering and cloud technologies. This role offers a collaborative environment and room for professional growth.
Responsibilities
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Responsibilities
- Develop and maintain data pipelines using PySpark, Hive, and SQL.
- Collaborate with teams to implement cloud solutions on AWS.
- Utilize Airflow for orchestrating workflows and managing tasks efficiently.
- Engage with clients and coordinate with offshore teams for project success.
- Explore and apply data warehousing concepts and tools like Databricks and Redshift.
- Proficient in PySpark, Hive, SQL, and Python for data manipulation and analysis.
- Hands-on experience with AWS cloud services.
- Strong communication skills with a track record of client engagement.
- Experience in managing and collaborating with distributed teams.
- Familiarity with enterprise data modeling in the finance domain.
- Previous experience with DevOps practices.
- Knowledge of data quality measures and tools like AWS DQ.
- Experience with performance optimization in Databricks and Kafka.
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.