What are the responsibilities and job description for the Engineer II – Big Data / Apptio / ETL position at DS Technologies Inc?
Job Title: Engineer II – Big Data / Apptio / ETL
Location: New York, NY (Onsite)
Position Type: Contract
Only W2
Location: New York, NY (Onsite)
Position Type: Contract
Only W2
Job Description:
We are seeking a highly motivated Engineer II (Big Data Engineer) with strong technical expertise in Apptio, Big Data, MS SQL, Oracle PL/SQL, Python, PySpark, and ETL/Data Warehousing. The ideal candidate will support data engineering, analytics, reporting, and financial/IT cost transparency initiatives leveraging Apptio and enterprise data platforms.
Key Responsibilities:
- Develop and maintain Big Data pipelines using PySpark, Python, and other data engineering tools.
- Work with Apptio for IT financial management, cost modeling, and reporting.
- Perform ETL development for large-scale Data Warehousing and analytics systems.
- Develop and optimize MS SQL Server objects (queries, stored procedures, SSIS packages, SSRS reports).
- Write efficient Oracle PL/SQL code for RDBMS-based applications.
- Analyze, transform, and process structured/unstructured data for reporting and insights.
- Collaborate with business teams to gather requirements and deliver analytical solutions.
- Troubleshoot data issues, improve data quality, and ensure system performance.
- Document data flows, technical specs, and operational processes.
Required Skills:
- Hands-on experience with Apptio (cost transparency, reporting, ITFM tools).
- Strong knowledge of Big Data technologies (Hadoop, Spark, PySpark).
- Proficiency in MS SQL Server, including SSIS and SSRS.
- Strong SQL coding with RDBMS (MS SQL, Oracle).
- Experience with Oracle PL/SQL programming.
- Good command of Python for scripting and automation.
- Strong understanding of ETL processes and Data Warehousing concepts.
- Experience working in Data Analytics environments.
Preferred Skills:
- Experience with cloud platforms (AWS, Azure, GCP).
- Knowledge of visualization tools (Tableau, Power BI).
- Familiarity with IT cost modeling and financial analytics.
- Understanding of Agile methodologies and CI/CD workflows.
Salary : $50