What are the responsibilities and job description for the Data Engineer position at Digipulse Technologies Inc.?
Role: Data Engineer
W2 role - **NO C2C**
Job Description:
- Required Technical Expertise (Must Have)Strong hands-on experience building and maintaining ELT/ETL pipelines to move and transform data across heterogeneous data platforms, including Snowflake, Oracle, and PostgreSQL.
- Deep understanding of data structures, relational databases, and cloud-native storage technologies across Snowflake, Oracle, Postgres, and other cloud-based RDBMS platforms.
- Proficiency in Python and SQL, with practical experience using scripting languages such as Shell and Groovy for automation and data processing.
- Proven experience designing, implementing, and orchestrating complex data pipelines using Apache Airflow and/or Control?M, with a focus on scalability, reliability, and operational efficiency.
- Hands-on expertise with Docker, including container image creation, multi-stage builds, container registries, and secure, scalable container-based deployments.
- Strong experience implementing CI/CD pipelines using GitHub and Jenkins, including automated builds, testing, deployments, and adherence to security and quality procedures.
Must have skills: Python, Ctrol M or Apache Airflow, Oracle and Snowflake, strong SQL, CI/CD experience, Docker, Jenkins, Github
Nice to have skills: AWS, Postgres, UI technologies for building dashboards (Angular, React, Nod.js, Typescript)
Interview Process: 2 rounds total 45 mins – technical panel 45 mins - with squad leader