What are the responsibilities and job description for the Data Engineer position at Zillion Technologies, Inc.?
- The candidate must have experience with the following:
- PySpark, Python, SQL
- Snowflake or any large data warehouse
- Any RDBMS and NoSQL databases
- Experience with IICS or other ETL tools, Collibra, and understanding of data modeling are preferred. Additionally, experience with working with ServiceNow databases are also preferred.
- Experience with Selenium is nice to have.
Must Have Qualifications: Python, PySpark, SQL Agile practices
Preferred: Snowflake and Informatica
Qualifications:
- Bachelor’s degree in computer science, information technology or related field; advanced studies/degree preferred.
- 5 years of extensive knowledge and experience in the Data technologies for Data Analytics, Data Lake/Mart/Warehouse, Databases SQL/NoSQL (DB2, Mongo, Postgres).
- Big Data Technologies (Spark or PySpark), ETL (Informatica, Talend), REST API, Integration/EAI technologies like Informatica.
- 3 years of experience with Technologies including Web Service API, XML, JSON, JDBC, Java, Python.
- 3 years working with SaaS platforms such as Snowflake, Collibra, Mongo/MongoDB Atlas.
- Knowledge of enterprise data models, information classification, meta-data models, taxonomies and ontologies.
- Exposure to Full stack enterprise application development (Angular, Spring Boot, Automation testing using Selenium).
- 5 – 7 years of experience in a logical/physical data modeling, data architecture, data analysis, and data management role.
- Experience with different query languages such as PL/SQL, T-SQL, and ANSI SQL.
- Experience with database technologies such as DB2, PostgreSQL, Snowflake.
- Knowledge of data warehousing and business intelligence concepts including data mesh, data fabric, data lake, data warehouse, and data marts.