Demo

Data & AI Architect / Lead Data Engineer

Gen II
York, NY Full Time
POSTED ON 3/11/2026
AVAILABLE BEFORE 5/11/2026

                                  

 

Data & AI Architect / Lead Data Engineer

 

Who is Gen II?

Gen II is a leading fund administration provider focused entirely on serving private capital asset managers and investors with a best-in-class combination of people, process, and technology. Gen II has more than $1 trillion in private fund capital assets under administration.

With offices in the US and Europe, we’re looking for do-ers, problem-solvers, and entrepreneurs like you who want to make an impact in our industry, grow with us, and create a community where everyone thrives.

Careers mean more at Gen II – more opportunity, more innovation, and more ideas! You’ll have the opportunity to grow in ways that are meaningful to you and work alongside some of the best people in their field. You’ll also receive training which will advance your skill set, both technically and personally allowing you to achieve your career aspirations with us. Be part of our community that recognizes achievements, promotes from within, and receive meaningful benefits which focus on your physical, mental and financial well-being.

www.gen2fund.com 

 

What’s the role?

Lead in-house/ partner technical teams to design and build the technical foundation that transforms fragmented fund data into a coherent, scalable, and secure data platform. This hybrid role combines architectural vision with hands-on technical leadership, integrating AI/ML capabilities to deliver the data proposition and associated roadmap.

Key Responsibilities

Data Architecture & Platform Design & Build

  • Design and build enterprise data model for fund data across all sources to support the data proposition, leveraging existing solutions where appropriate
  • Define integration architecture connecting source systems necessary for the data proposition
  • Create technical roadmap aligned with proposition roadmap & strategy
  • Evaluate and select technology stack (data warehouse, ETL tools, API gateway, analytics platforms)
  • Design cloud architecture (Azure preferred) optimized for performance, cost, and scalability
  • Establish architectural standards, design patterns, and technical documentation

AI/ML Integration & Innovation

  • Design and build AI/ML integration points leveraging Gen II's existing AI capabilities and solutions
  • Architect solutions for unstructured data extraction from PDFs, LPA documents, and fund agreements
  • Develop intelligent data enrichment and validation capabilities using AI/ML models
  • Explore advanced analytics use cases: predictive modelling, anomaly detection, natural language processing
  • Partner with Virtusa and other technology vendors on multi-agent AI architecture development

Data Engineering & Pipeline Development

  • Lead design and development of production data pipelines
  • Build and maintain data APIs for product consumption with proper versioning and documentation
  • Implement data transformation layer with business rules engine for calculation and enrichment logic
  • Optimize pipeline performance and cost efficiency
  • Establish monitoring, logging, and alerting infrastructure for proactive issue detection
  • Implement CI/CD practices for automated testing and deployment of data pipelines

Data Governance & Security

  • Establish data governance framework including lineage, metadata management, and quality standards
  • Design security and access control framework ensuring data privacy and compliance (GDPR, SOC 2)
  • Define data retention, archival, and disaster recovery policies
  • Ensure compliance with regulatory requirements and industry best practices
  • Collaborate with Data Quality Lead on monitoring and validation frameworks

Team Leadership & Collaboration

  • Lead in house / partner team of data engineers on technical excellence and best practices
  • Collaborate with Data Product Manager on feature requirements and technical feasibility
  • Partner with Gen II's existing technology team and external vendors (Virtusa) on implementation
  • Participate in agile ceremonies and provide technical guidance to cross-functional teams
  • Foster engineering culture emphasizing code quality, automation, and continuous learning

 

 

 

Required Qualifications

Experience

  • 8 years data architecture and engineering experience in financial services
  • Bachelor’s Degree in Computer Science, Software Engineering or related filed.
  • Proven experience designing and implementing enterprise data platforms from scratch
  • Strong background in fund administration, asset management, or alternative investments data
  • Hands-on experience with modern data platforms (Snowflake, Databricks, Azure Synapse)
  • Experience leading technical teams and working with partners

Technical Skills

  • Expert-level SQL and strong programming skills in Python (required), with knowledge of Scala/Java (preferred)
  • Deep expertise in data modelling: dimensional modelling, data vault, graph databases
  • Hands-on with data orchestration tools and transformation frameworks
  • Strong API design experience and microservices architecture
  • Cloud platform expertise, particularly Azure
  • Experience with AI/ML frameworks and integration (LLMs, document processing, predictive models)
  • DevOps practices

Domain Knowledge

  • Deep understanding of fund administration data flows: NAV, capital calls, distributions, waterfall calculations
  • Familiarity with fund accounting systems and their data structures
  • Knowledge of regulatory reporting requirements and data governance in financial services
  • Understanding of private equity fund structures, investment strategies, and performance metrics

Success Metrics (12-Month Targets)

  • Data proposition launched and active with clients
  • Production data platform operational with documented architecture and design patterns
  • AI/ML capabilities integrated: document processing, predictive analytics for 2 use cases
  • Data governance framework implemented with automated quality monitoring
  • Team in place and operating successfully

 

The salary range for this position is $220,000 - $260,000, in addition to a discretionary bonus and comprehensive benefits package. Please note that the actual salary offered within that range will depend on the candidate’s experience level.


Work Arrangement

All applicants applying to Gen II Fund Services, LLC must be legally authorized to work in the United States. Please note that all US employees are required to work a hybrid schedule, comprised of three (3) days a week in our office and two (2) days remotely.


https://gen2fund.com/candidate-privacy-statement/

 

 

Salary.com Estimation for Data & AI Architect / Lead Data Engineer in York, NY
$168,174 to $200,587
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Data & AI Architect / Lead Data Engineer?

Sign up to receive alerts about other jobs on the Data & AI Architect / Lead Data Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$80,267 - $99,326
Income Estimation: 
$92,357 - $117,598
Income Estimation: 
$147,901 - $186,323
Income Estimation: 
$170,841 - $219,163
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Gen II

  • Gen II York, NY
  • Gen II is seeking an Accountant to join its Management Company services department. This role requires a detailed and organized individual with the ability... more
  • 9 Days Ago

  • Gen II York, NY
  • Senior Systems Analyst Who is Gen II? Gen II is a leading fund administration provider focused entirely on serving private capital asset managers and inves... more
  • 12 Days Ago

  • Gen II Denver, CO
  • Gen II is seeking Tax Directors to join our growing team of professionals. These individuals will be actively involved in the tax compliance services noted... more
  • 13 Days Ago

  • Gen II York, NY
  • Digital Marketing Manager Who is Gen II? Gen II is a leading fund administration provider focused entirely on serving private capital asset managers and in... more
  • 13 Days Ago


Not the job you're looking for? Here are some other Data & AI Architect / Lead Data Engineer jobs in the York, NY area that may be a better fit.

  • Data Intellect York, NY
  • Company Description At Data Intellect it has never been just about data or technology, they are our tools. It’s about human intellect, collaboration and pr... more
  • 1 Month Ago

  • Future Secure AI York, NY
  • About The Company At Future Secure AI, we're building something genuinely new — and we're looking for people bold enough to build it with us. We work at th... more
  • 4 Days Ago

AI Assistant is available now!

Feel free to start your new journey!