What are the responsibilities and job description for the Senior Data Engineer, Data and Insights position at UJA Federation of New York?
The Data Engineering and Architecture team at UJA-Federation of New York is seeking an experienced Senior Data Engineer. The ideal candidate will bring strong expertise in Python development for data-intensive applications, coupled with familiarity in Azure DevOps practices and some familiarity with Infrastructure as Code (IaC) approach. This role involves building scalable data pipelines, improving data quality and reliability, and collaborating with cross-functional teams to support analytics, reporting, and machine learning initiatives.
Key Responsibilities
- Design, build, and maintain robust ETL/ELT pipelines and data workflows using Python.
- Implement best practices for data architecture, modeling, and processing at scale.
- Collaborate with team members to leverage Azure DevOps for CI/CD, release management, and automated testing.
- Ensure compliance with data governance, quality, and security standards.
- Mentor junior engineers and contribute to the growth of engineering best practices.
- Partner with stakeholders (data scientists, analysts, business teams) to deliver reliable data solutions.
Qualifications
- 5 years of professional experience in data engineering or related roles.
- Strong proficiency in Python, with proven experience in data-focused frameworks (e.g., Pandas, PySpark, Dask, SQLAlchemy).
- Hands-on experience designing and consuming RESTful APIs or GraphQL endpoints.
- Solid understanding of cloud environments (Azure preferred).
- Hands-on experience with Azure DevOps tools: pipelines, repositories, boards, and artifacts.
- Proficiency in SQL and relational databases (e.g., SQL Server, PostgreSQL, MySQL).
- Solid experience with data lakes and warehouses (Fabric Data Lakes and warehouses preferred).
- Strong knowledge of CI/CD pipelines and version control (Git)
- Excellent problem-solving, communication, and collaboration skills.
Preferred Skills
- Exposure to machine learning workflows and MLOps practices.
- Experience using donor management systems (Salesforce NPSP in particular)
- Knowledge of containerization a plus (Docker/Kubernetes).
- Some familiarity with Infrastructure as Code (IaC) tools such as Terraform, Bicep, or ARM templates is a bonus.
Reports To: Director, Technical Architect
Salary Range: $90,000 - $100,000, commensurate with experience and qualifications listed above.
Salary : $90,000 - $100,000
