What are the responsibilities and job description for the Senior Data Engineer position at ComTec Information Systems?
Title: Senior Data Engineer
Location: Newark, NJ (Hybrid - 3 days per week in the office)
Duration: Full-time with ComTec
Job Description:
We are seeking an experienced Senior Data Engineer / Data Modeler to help drive data use cases from requirements through production delivery and to strengthen monitoring for existing data pipelines. This person will work with business and technical stakeholders to understand data needs, develop fit-for-purpose data models and pipelines, validate results, and establish monitoring and operational practices that support reliable use-case delivery.
Responsibilities
- Drive assigned data use cases from discovery and requirements gathering through design, development, testing, validation, and production handoff.
- Translate business and technical requirements into data models, source-to-target mappings, data flows, and implementation plans.
- Create and maintain conceptual, logical, and physical data models, including dimensional models such as Star and Snowflake schemas where appropriate.
- Build, maintain, and optimize ETL/ELT pipelines using AWS services, Python, SQL, and shell scripting.
- Develop and support AWS-based data ingestion and data lake solutions using relevant services such as S3, Glue, Redshift, Athena, Lambda, EMR, and RDS.
- Assess existing use cases and pipelines to identify data-quality, performance, reliability, and scalability gaps; recommend and implement improvements.
- Design and implement pipeline monitoring and observability for existing and new use cases, including appropriate checks for failures, freshness, completeness, volume, and schema changes.
- Configure alerts, monitoring dashboards, and operational documentation, including runbooks and escalation procedures.
- Monitor and troubleshoot production pipelines; investigate root causes and implement corrective and preventative fixes.
- Work with business analysts, data scientists, architects, SAP functional teams, and other stakeholders to clarify requirements, resolve data issues, and confirm use-case outcomes.
- Validate data outputs against business rules and acceptance criteria, and support release and production-readiness activities.
- Follow security, data-quality, compliance, change-management, and version-control standards.
- Document data models, technical designs, data flows, pipeline dependencies, monitoring rules, and operational procedures.
Skills & Experience
- 4 years of experience developing data solutions on AWS including hands-on with services such as S3, Glue, Redshift, Athena, Lambda, EMR, or RDS.
- 4 years of experience in ETL/ELT development using Python, SQL, and shell scripting.
- Demonstrated experience delivering data use cases from requirements through implementation and validation.
- Strong understanding of data modeling principles and experience creating and maintaining data models, including dimensional modeling (Star and Snowflake schemas).
- Experience monitoring and supporting production data pipelines; familiarity with alerting, dashboards, data-quality checks, and operational runbooks.
- Experience with data lake architecture and integration with Redshift (e.g., S3, Lake Formation).
- Experience integrating data with reporting tools such as Power BI.
- Knowledge of data security best practices and compliance requirements.
- Strong analytical, problem-solving, documentation, and communication skills.
- AWS certification preferred.
Salary : $120,000 - $140,000