What are the responsibilities and job description for the Data Movement Engineer (Snowflake & Talend) position at Talent Groups?
Duration:�6 months to start (with potential for conversion)
Job Description
Job Description
- The client is embarking on the modernization of its core data platforms.
- We are currently seeking a Data Movement Engineer who can provide production support to our existing and future ETL environments.
- This role will also lead the design, optimization, and support framework of Snowflake-based data solutions.
- The ideal candidate will possess strong technical expertise in Snowflake, data warehousing methodologies like Data Vault 2.0, and be comfortable leading complex projects and mentoring team members.
- Manage the full lifecycle of Snowflake data operations, including monitoring, troubleshooting, and optimizing data pipelines.
- Proactively identify and resolve issues related to data integrity, latency, and pipeline failures to maintain smooth operations.
- Translate stakeholder requirements into Snowflake-specific solutions for data movement.
- Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability.
- Design, develop, and optimize Snowflake data pipelines and models.
- Recommend and implement best practices for data ingestion, transformation, storage, security and data modeling.
- Support advanced features like Change Data Capture (CDC)and Slowly Changing Dimensions (SCD Type 2).
- Support frameworks like Data Vault and dimensional modeling in Snowflake.
- Monitor and troubleshoot data pipeline failures and performance issues in ETL and Snowflake environments.
- Thoroughly test all production solutions prior to implementation.
- Perform root cause analysis of data discrepancies, latency, and integrity issues.
- Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP).
- Collaborate with other teams to implement fixes and preventive measures.
- Perform data quality analysis, report issues, and propose solutions.
- Ensure data accuracy, completeness, and consistency across systems.
- Implement validation and reconciliation checks within pipelines.
- Support data governance initiatives including metadata management and lineage tracking.
- Lead the design, development, and maintenance of Snowflake processes.
- Provide technical leadership, code reviews, and mentorship to junior developers.
- Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions.
- Communicate issue status, impact, and resolution timelines effectively.
- Maintain comprehensive documentation for all Snowflake-related issues, fixes, and scripts, ensuring they are version-controlled and aligned with data architecture and security standards.
- Develop and maintain production support playbooks and detailed ticket resolution procedures to enable consistent and efficient incident handling.
- Prepare effort estimations and contribute to architectural decisions.
- Provide regular updates and reports on issue trends and improvement initiatives.
- On-call and/or after-hours work required.
- Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis.
- Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, Oracle, SQL Server, DB2).
- Strong expertise in Snowflake (development, data modeling, security). Snowflake certification preferred.
- Strong proficiency in SQL and scripting languages (e.g., Python, Shell).
- Experience with cloud database technologies.
- Familiarity with orchestration tools (ESP, Airflow) and version control systems (Git).
- Experience with incident management tools (e.g.,ServiceNow,Jira) and CI/CD practices.
- Expertise inCDCandSCD Type 2implementations using SQL.
- Solid understanding of data architecture, dimensional modeling, and frameworks likeData Vault.
- Ability to solve problems using analytical thinking skills.
- Must work well independently and be inquisitive.
- Strong organizational and time management skills.
- Bachelors degree in computer science, Information Systems, or related field.
- 5 years of experience in Snowflake development and data warehousing.
- Must be able to remain in a stationary position for a majority of the workday.