Senior Data Engineer & BI Developer, SEO - 27149

Position Summary: The Reporting and Analytics team within the Special Education Office (SEO) of the Division of Inclusive and Accessible Learning (DIAL) is seeking a highly skilled, multi-talented, experienced individual to manage end to end data integration, warehousing, and reporting workflows in tracking referrals, evaluations, Individualized Education Programs (IEPs, IESPs), mandated student services, and complex compliance metrics for all preschool and school age students referred for special education services in public, charter, and private school settings.

Under general supervision, with broad scope for the exercise of independent initiative and judgement, the selected candidate is responsible for the analysis, design, development, implementation, enhancement, maintenance, security and data governance of data warehouses, data marts, business intelligence systems and operational, management, regulatory reporting systems. Performs related work.

Reports to: Senior Director of MIS/Analytics, SEO

Direct Reports: There are no immediate direct reports assigned to this position. However, the candidate must be capable of adapting to future needs, including supervising developers, directing project teams, or overseeing external consultants.

Key Relationships: The candidate will work closely with other offices within the division, several external constituencies, and partner with other New York City Public Schools (NYCPS) divisions/offices, including the Division of Instructional and Information Technology (DIIT), the Office of the General Counsel (OGC), Research and Policy Support Group (RPSG), and the Office of Student Enrollment (OSE).

Responsibilities

Data Procurement & ETL Pipelines

• Engage with business stakeholders to gather and document requirements.
• Create conceptual, logical and physical data models, data dictionaries and capture data lineage
• Design, implement, test, deploy, debug, and document large scale Microsoft based on premise and cloud data warehouses and data marts.
• Own the end to end design, extraction, transformation, and loading (ETL) process, testing and deployment for complex large scale datasets ensuring accuracy and security.
• Ensure seamless integration of disperse enterprise NYCPSE systems, including school age and pre-school special education applications (SESIS, ATLAS, Encounter Attendance, Provider Assignment), enrollment, attendance, course scheduling, teacher certification, ensuring seamless integration of special education, enrollment, and personnel metrics.
  
  

Compliance & Legal Reporting

• Design and create complex data models and queries from scratch.
• Improve the performance and speed of existing data structures and queries.
• Construct reliable data pipelines and reporting frameworks.
• Keep data systems updated, accurate, and functional over time.
• Run data jobs and deliver reports for federal, state, and city regulations, FOIL requests, audits, and legal stipulations.
  
  

Specialized Automation

• Architect automation engines, designing scalable Python and T-SQL systems from the ground up to generate and distribute reports.
• Maintain automation engines, ensuring ongoing performance and reliability for critical data workflows.
• Distribute data insights, delivering information efficiently to key decision makers.
• Drive algorithmic assignment, programmatically managing the placement of preschool students with disabilities for reevaluation.
  
  

Enterprise BI and Analytics Delivery

• Design and deploy robust and reliable systems for data analysis.
• Design, build and deploy fast, high-performance PowerBI dashboards.
• Tailor all tools and reports for different internal and external groups.
  
  

Cloud Modernization

• Lead technical readiness for moving legacy on-premise data systems.
• Plan data migration from local SQL Server data marts to the cloud.
• Implement modern cloud environments using Microsoft Fabric.
• Define future state data schemas to support new cloud setups.
  
  

Strategic Planning and Project management

• Assist in defining roadmaps, align data systems with business goals, and data governance standards.
• Test and choose new tools, software, and AI features to keep the data stack modern and efficient.
• Coordinate and direct data management activities.
• Assist in performing project planning, feasibility studies, cost benefit analyses, impact analyses, and task prioritization.
  
  

Qualification Requirements

Minimum

• A baccalaureate degree from an accredited college, including or supplemented by 24 semester credits in computer science or a related computer field and two (2) years of satisfactory full-time computer software experience in computer systems development and analysis, applications programming, database administration, systems programming, data communications, including one (1) year in a project leader capacity or as a major contributor on a complex project; or
• A four-year high school diploma or its educational equivalent and six (6) years of satisfactory full-time computer software experience as described in "1" above, including one (1) year in a project leader capacity or as a major contributor on a complex project; or
• Education and/or experience equivalent to "1" or "2" above. College education may be substituted for up to two (2) years of the required experience in "2" above on the basis that 60 semester credits from an accredited college is equated to one (1) year of experience. A masters degree in computer science or a related computer field may be substituted for one (1) year of the required experience in "1" or "2" above. However, all candidates must have at least a four-year high school diploma or its educational equivalent and at least one (1) year of satisfactory full-time experience in a project leader capacity or as a major contributor on a complex project.
  
  

Plus

• Familiarity with Microsoft Fabric, Azure Data Factory, or cloud data warehousing pipelines is a major plus.
• Familiarity with New York State Special Education laws, policies and practices.
• Knowledge of NYCPS processes and systems (including data systems).
  
  

In addition to meeting the minimum requirements, individuals must have two additional years of relevant work experience.

Preferred

• High proficiency in T-SQL and relational database management systems (Microsoft SQL Server on-premises).
• Strong programming experience in Python for data manipulation, scripting, and automated PDF reporting pipelines.
• Demonstrated hands on experience on both sides of the pipeline: data procurement/ingestion and reporting delivery.
• Ability to troubleshoot, problem solve and anticipate issues needing resolution.
• Strong analytical skills combined with the ability to develop thoughtful and creative approaches for addressing a wide range of analytic questions.
• Excellent written and spoken communication skills and interpersonal skills.
  
  

Salary: $123,208 - $138,997

(Internal candidates who are selected for this position and who currently hold comparable or less senior positions within the DOE will not earn less than their current salary.)

Please include a resume and cover letter with your application.

NOTE: The filling of all positions is subject to budget availability and/or grant funding.

• New York City Residency is NOT Required *
  
  

We encourage all applicants from the New York City tri-state area to apply.

AN EQUAL OPPORTUNITY EMPLOYER

DOE Non- Discrimination Policy

The Department of Education of the City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment upon any legally protected status or protected characteristic, including but not limited to an individual's actual or perceived sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, or pregnancy. For more information, please refer to the DOE Non-Discrimination Policy.

REQUESTING AN ACCOMMODATION - APPLICANTS

Any prospective employee (applicant) who is a qualified individual with a disability may request a reasonable accommodation to assist in the application process. If an applicant for employment believes that they have a qualifying disability and are in need of a reasonable accommodation in order to participate in the application process on an equal basis as applicants who do not have a disability, they should request an accommodation with their interview team or contact ODA by emailing ODA@schools.nyc.gov. The determination of the accommodation request will be communicated to the applicant in writing.

https://infohub.nyced.org/docs/default-source/doe-employees-only/personnel-memorandum-6-2024-2025---accommodations.pdf

Public Service Loan Forgiveness As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at https://studentaid.gov/pslf/.