What are the responsibilities and job description for the Snowflake Data Engineer (Python, AWS, Big Data) position at Photon?
Job Title: Data Science - Senior Engineer in Production Management (Big Data - Snowflake)
Job type: Full time Employee (FTE). Job Id: 25779
Location: Irving, TX (Onsite Mon to Fri)
Must Need Experience
Snowflake (Or any other Big Data solution)
Python (Data Engineering)
Data Warehousing Concepts
Data Modelling (Dimensional/Relational)
Cloud Platforms (AWS)
SQL, High Availability Systems (Data)
Short Description:
Responsibilities:
- Demonstrates an in-depth understanding of the Software Development Lifecycle and its integration within the overall data technology landscape to deliver scalable, reliable, and performant Big Data solutions, particularly within Snowflake.
- Conduct in-depth data analysis, troubleshoot complex data issues, and ensure the accuracy, reliability, and integrity of data.
- Optimize Big Data workflows, including Snowflake query optimization, leveraging partitioning strategies and indexing techniques in distributed storage systems.
- Perform rigorous unit testing and validation of data pipelines and transformations.
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver robust data solutions.
Description: Senior Engineer in Production Management (Big Data - Snowflake Focused)
The Senior Engineer in Production Management, specializing in Big Data with a focus on Snowflake, will be responsible for the design development, and overall implementation of robust and scalable data solutions in a complex, critical, and large cross-departmental and multi-disciplinary area. This role is crucial for building robust pipelines, ensuring data quality, and driving performance improvements across our Big Data initiatives..
The role requires a comprehensive understanding of various facets of Big Data technologies and how they interact to achieve strategic data objectives. The candidate will apply in-depth understanding of the business impact of data-driven insights and be accountable for the delivery of a full range of end-to-end data engineering projects.
Responsibilities:
- Demonstrates an in-depth understanding of the Software Development Lifecycle and its integration within the overall data technology landscape to deliver scalable, reliable, and performant Big Data solutions, particularly within Snowflake.
- Conduct in-depth data analysis, troubleshoot complex data issues, and ensure the accuracy, reliability, and integrity of data.
- Optimize Big Data workflows, including Snowflake query optimization, leveraging partitioning strategies and indexing techniques in distributed storage systems.
- Perform rigorous unit testing and validation of data pipelines and transformations.
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver robust data solutions.
Qualifications:
- Relevant experience in a critical Big Data engineering role with high business impact, and a strong ability to understand how data solutions deliver business value.
- Excellent engineering skills with expertise in Snowflake data warehousing.
- Excellent working knowledge of key computer science concepts, especially as they apply to distributed systems, data structures, and algorithms for large-scale data processing.
- Excellent understanding of data engineering concepts like Data Modeling, Data Lakes, Data Warehouses, and Data Marts.
- Strong debugging and analytical skills: ability to isolate root causes across data pipelines, Snowflake, cloud infrastructure, and data processing layers.
Salary : $60,000 - $120,000