What are the responsibilities and job description for the Senior Data Engineer position at Covenant HR?
Company - Our client is an established healthcare technology and marketing organization focused on connecting patients and healthcare professionals with trusted educational content at the point of care. The organization has operated for more than 40 years and has earned repeated recognition for both its healthcare content and workplace culture.
Job Title - Senior Data Engineer
Location - Hybrid in Montvale, NJ — 3 days per week onsite
Role Type - 6–12 month contract
Must Have Skills:
- Strong BigQuery and Google Cloud Platform (GCP) expertise with hands-on experience working extensively in BigQuery.
- Advanced SQL expertise, including writing and optimizing complex queries.
- Strong ETL/ELT pipeline development and management experience, including building and operating scalable, reliable data pipelines.
- Strong Python experience for data transformation, automation, and pipeline development.
- API-based data integration experience, including incorporating API-sourced data into ETL/ELT workflows and handling pagination, rate limits, retries, schema drift, and partial failures.
Responsibilities and Job Details:
- Design, build, and maintain scalable data pipelines that move data from source systems through transformation into analytics-ready datasets.
- Own and improve data orchestration workflows to ensure reliable and timely data availability for reporting and business decision-making.
- Build and support API-driven data ingestion patterns across internal and external systems, including handling real-world API reliability challenges.
- Develop and maintain data models, warehouse entity relationships, datasets, and views optimized for downstream analytics and reporting.
- Implement data quality and governance practices, including validation, completeness testing, reconciliation, lineage, and documentation.
- Build monitoring and alerting capabilities to track pipeline health, data freshness, failures, and SLA adherence.
- Optimize pipeline performance, BigQuery query efficiency, and data warehouse costs.
- Support reverse ETL and outbound data delivery, including delivering curated datasets into operational systems through APIs.
- Integrate and model business-critical data from CRM and ERP platforms, including Salesforce and NetSuite.
- Collaborate cross-functionally with analytics, product, engineering, and business stakeholders to deliver reliable data solutions.
- Use modern AI/LLM tools to accelerate data and analytics workflows, with Claude experience considered a plus.
- Work within a modern technology stack that includes SQL, Python, GCP, BigQuery, Salesforce, NetSuite, GitHub, GitHub Copilot, and Jira.