What are the responsibilities and job description for the ETL Developer position at Jobs via Dice?
Rangam INC / State of NY
Job Code: 03026Y0023
Client: City of NY - NYC Department of City Planning
Duration: 18 Months, extension possible based on needs and performance
Job Title: ETL Developer
Location: New York, NY 10271-onsite
Job Summary:
9 AM to 5 PM, Monday ? Friday
PROJECT SCOPE:
Client seeks an experienced consultant that can:
DESIRABLE SKILLS/EXPERIENCE:
Job Code: 03026Y0023
Client: City of NY - NYC Department of City Planning
Duration: 18 Months, extension possible based on needs and performance
Job Title: ETL Developer
Location: New York, NY 10271-onsite
Job Summary:
9 AM to 5 PM, Monday ? Friday
PROJECT SCOPE:
Client seeks an experienced consultant that can:
- Extract geographic and non-geographic data from Oracle and SQL Server databases, ensuring the integrity and quality of the data.
- Transform raw data into structured formats suitable for analysis, reporting, and system integration.
- Design and implement data pipelines for efficient handling of large datasets.
- Automate ETL integrations using SQL Server Integration Services (SSIS).
- Perform data analysis to drive key business objectives.
- Document ETL processes, data models, and API specifications for transparency and knowledge sharing.
- Develop, test, and maintain ETL workflows and scripts to automate data processing.
- Monitor ETL processes to ensure reliability, scalability, and performance.
- Perform data modeling and database design for application development and product implementation initiatives under the guidance of Database Administrator and Architect.
- Create reporting solutions using SQL Server Reporting Services (SSRS) by analyzing user needs and information availability.
- Troubleshoot and resolve data-related issues promptly.
- Create APIs to enable data access and integration with various applications and systems.
- Ensure APIs are secure, performant, and adhere to industry standards.
- Collaborate with developers and analysts to design API endpoints that meet business requirements.
- Work with GIS analysts, developers, and stakeholders to understand data requirements.
- Participate in requirements definition, analysis and design.
- Work closely with business analysts, subject matter experts and development teams in design, development, testing, implementation, and support of application projects.
- Facilitate creation, migration and maintenance of database objects across development/ QA/ production environments.
- Follow best practices in data modeling including use of standard naming conventions, processes and templates to ensure consistency of data models.
- Monitor and optimize database performance and capacity utilization to provide high availability and redundancy.
- Take ownership of database performance, scalability and security.
- Define and implement data testing strategies with business stakeholders, application development teams and QA groups.
- Participate in the software testing process, including identification and resolution of defects.
- Contribute to and support roll-out strategies.
- Participate in and contribute to formal/informal technical reviews and presentations.
- Accurately estimate time required to complete development tasks.
- Demonstrate the ability to cooperate with a variety of people and achieve results.
- Mentor and guide development team members on database-related tasks.
- Provide technical support and knowledge transition to team members and end users as needed.
- Communicate effectively with team members, stakeholders, and project managers to gather requirements, provide updates, and manage expectations.
- Create and maintain technical documentation, including system designs, workflows, and user guides.
- Ensure solutions comply with industry best practices, standards, and security protocols.
- Prepare documentation and conduct knowledge transition to support adoption across the organization and other city agencies.
- Stay current with industry trends and emerging technologies to propose innovative solutions and improve development processes.
- Bachelor's degree in Computer Science, Software Engineering, Information Systems, Geographic Information Systems (GIS), or a related field. Master's degree is a plus.
- Minimum of 4 years as ETL Developer, Data Engineer, or similar role, with a focus on geographic data.
- Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server, Oracle, and PostgreSQL databases.
- Familiarity with SSRS, SSAS, SSIS and data warehousing concepts like ETL, Dimensions, Facts, Cubes.
- Demonstrated knowledge of designing, developing and integrating databases, data warehouses and multidimensional databases in MS-SQL Server.
- Knowledge of data integration patterns, database design, and data modeling principles.
- Strong programming skills in Python, C#, or other relevant languages for ETL and API development.
- Experience with API frameworks (e.g., Flask, FastAPI, or Django REST Framework).
- Experience with geographic data formats (e.g., shapefiles, GeoJSON) and geospatial tools (e.g., ArcGIS, QGIS).
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud Platform) and related data services.
- Familiarity with ETL tools like Talend, Apache Nifi, or Informatica.
- Ability to write and optimize complex SQL queries, stored procedures, triggers, and functions.
- Experience in code migration, database change management and data management through the various stages of the development life cycle.
- Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub.
- Experience with version control and release management practices.
- Excellent problem-solving, collaboration, and communication skills.
- Experience with MS-SQL Server, PostgreSQL, Oracle, and/or other geospatial databases.
- Ability to collaborate effectively within a team environment.
- Strong knowledge of software architecture principles, design patterns, and best practices.
- Familiarity with DevOps practices and tools for continuous integration and delivery.
- Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions.
- Experience with version control using Git and GitHub and release management practices.
- Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
- Strong communication skills, both written and verbal.
- ETL certifications on Microsoft SQL Server or Oracle will be a plus.
- Demonstrated experience working with technical and non-technical staff.
DESIRABLE SKILLS/EXPERIENCE:
- The selected candidate must have excellent verbal and written communication skills and have the ability to interact professionally with a diverse group including executives, managers, and subject matter experts.
- The candidate should be a team player.
ETL Developer
Princeton IT Services -
New York, NY
ETL Developer
Spruce Technology Inc. -
York, NY
ETL Developer
Trinity Technology Solutions -
York, NY