What are the responsibilities and job description for the Apptio TBM Bigdata ETL Engineer position at Digital Dhara LLC?
Apptio Platform Experience Mandatory.
- Individual contributor to an SDLC life cycle based agile team
Data Engineering Export - Concept, Strategy and end to end data as a product/service philosophy
Expert in Python
Capable of devising ETL pipelines using Python from scratch
Expert Airflow and understands how to develop DAGs
Expert in Spark and Pyspark
Willing to learn new cloud based business apps and tools
Hands on proficiency and expert-level knowledge in at least one object oriented programming language in C, C Or Java
Deep knowledge in RDBMS concepts and data engineering as a concept and service (data warehousing, data lakes and master data management)
Expert at analyzing and developing queries in SQL in various dialects (SQL Server, DB2, Oracle)
Hands on experience in manipulating databases via DML code packages, stored procedures, triggers and materialized views
Hands on experience in developing reports and dashboards using tools such as Qlik, Tableau or Power BI
Hands on experience in integrating two systems to process data through various channels (SOAP, Rest, ETL and SSIS)
Hands on experience with Node Js and JSON
Ability to independently write efficient and reusable code for ETL pipelines
Expert in data modeling concepts such as schemas and entity relationships