What are the responsibilities and job description for the Lead Data Engineer position at Atinfo Technology Inc?
Please submit only local to NJ/NY candidates. Only for Permanent Residents.
We are looking for an experienced Data Management Specialist responsible for developing, organizing, storing, and analyzing data systems. The candidate will be involved in all phases of the software development lifecycle for Snowflake solutions, including planning, development, testing, and deployment.
Key Responsibilities:
- Develop and maintain scalable data solutions on Snowflake
- Collaborate with engineering teams to design optimal data architectures
- Ensure performance, scalability, and reliability of data platforms
- Troubleshoot issues, identify root causes, and implement preventive measures
- Manage deliverables in a fast-paced environment
Required Skills & Experience:
- 8 10 years of experience in enterprise data solution design and development
- 5 years of hands-on experience with Snowflake
- Strong SQL and Python skills
- Experience building data warehouses in Snowflake
- Hands-on experience with Spark and Scala for data pipelines
- Experience with orchestration tools such as Airflow, Informatica, or Automic
- Knowledge of metadata, data lineage, and SQL analytical functions
- Experience with Shell scripting and JavaScript
- Familiarity with CI/CD, automated testing, and performance engineering
- Experience with Git, Jira, and Confluence
- Strong problem-solving and communication skills