Data Engineer

Job#: 3026075

Job Description:

SENIOR CONSULTANT (DATA ENGINEER – LAKEFLOW CONNECT SME)

WHO WE ARE

Apex Systems is a leading global technology services firm that incorporates industry insights and experience to deliver solutions that fulfill our clients’ digital visions. We provide a continuum of services, including strategy and enablement, innovation and productivity, and technology foundations to drive better results and bring more value to our clients. Apex transforms our customers with modern enterprise solutions tailored to the industries we serve. Apex has a presence in over 70 markets across North America, Europe, and India. Apex is a part of the Commercial Segment of ASGN Incorporated (NYSE: ASGN). To learn more, visit www.apexsystems.com.

At Apex Systems, we prioritize professional development, work-life balance, and fostering a collaborative culture. We value our team's well-being and recognize the importance of building strong relationships. That's why we organize regular team-building events and philanthropic days to give back to the community - fostering a sense of purpose and fulfillment among our team.

Join us for career advancement, innovative solutions, and a supportive environment focused on your success.

JOB DESCRIPTION

Apex Systems is seeking a Senior Consultant – Data Engineer to join our Solutions Delivery Organization. This individual will play a critical role in modernizing enterprise data ingestion platforms by leading migrations from Airbyte to Lakeflow Connect. As a Senior Consultant, you will combine deep technical expertise in data ingestion and pipeline architecture with strong consulting and client-facing skills, helping organizations transition ingestion frameworks while maintaining reliability, performance, and data parity.

The ideal candidate has practical Lakeflow Connect experience, with a proven track record migrating ingestion platforms, defining target-state architectures, validating pipelines in parallel, and delivering production-ready cutovers supported by clear operational standards and documentation. Employees who are not actively deployed on a client project and reside within a one-hour commute of an Apex branch office are expected to work onsite at least once per week.

RESPONSIBLITIES

• Lead and execute ingestion platform migrations from Airbyte to Lakeflow Connect for enterprise clients.
• Inventory existing Airbyte connectors, configurations, schedules, and upstream/downstream dependencies.
• Define target-state Lakeflow Connect architecture and pipeline design equivalents aligned to approved replication patterns.
• Configure Lakeflow ingestion pipelines to meet data freshness, reliability, and scalability requirements.
• Execute pilot migrations for a prioritized subset of pipelines to validate migration patterns and assumptions.
• Perform parallel validation to ensure data parity, pipeline reliability, and performance equivalence.
• Identify and remediate ingestion gaps, failure modes, or behavioral differences between Airbyte and Lakeflow.
• Develop and maintain migration documentation, configuration standards, and operational runbooks.
• Partner with data engineering, platform, and operations teams to ensure cutover readiness.
• Deliver client workshops, documentation, and migration reviews as part of consulting engagements.
• Ensure high-quality deliverables, project timeliness, and client satisfaction.
• Build and foster strong working relationships with clients, team members, and technical stakeholders.
• Proactively identify opportunities to improve ingestion performance, observability, and operational efficiency.
• Collaborate with internal and external stakeholders to ensure alignment with business goals and technical requirements.

JOB REQUIREMENTS

• 5 years of experience in data engineering, platform engineering, or data integration roles.
• Practical experience with Lakeflow Connect, including pipeline configuration, replication patterns, and operational management.
• Direct experience migrating ingestion pipelines from Airbyte to Lakeflow Connect (or equivalent ingestion modernization initiatives).
• Hands-on experience orchestrating and monitoring data pipelines using Apache Airflow.
• Strong proficiency in SQL and Python for data transformation, validation, automation, and troubleshooting across ingestion and analytics workflows.
• Strong understanding of connector configuration, scheduling, incremental replication, and failure handling.
• Proven experience designing and validating ingestion pipelines with a focus on reliability, scalability, and data parity.
• Experience working with cloud-based data platforms and lakehouse architectures.
• Strong troubleshooting, analytical, and problem-solving skills.
• Experience using modern code assistance and developer productivity tools (i.e. AI-assisted coding, linters, and IDE extensions) to improve code quality, consistency, and delivery efficiency.
• Consulting or client-facing delivery experience.
• Excellent communication and technical documentation skills.
• Experience working in Agile delivery environments.
• BA/BS required, preferably in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience).
• Experience developing operational runbooks, observability standards, and on-call readiness for ingestion platforms preferred.
• Experience supporting production cutovers and post-migration stabilization efforts preferred.
• Familiarity with Databricks-based analytics or downstream lakehouse consumption patterns preferred.

OUR COMPREHENSIVE BENEFITS

• Competitive Salary
• Health, Dental and Vision Insurance
• Health Savings Accounts (HSA) with Employer Contribution
• Flexible Spending Accounts
• Long and Short-Term Disability
• Life Insurance
• Voluntary Benefits
• Employee Assistance Program
• Paid Parental Leave
• Wellness Incentives
• Vacation and Holiday Pay
• 401(k) Retirement Plan with Employer Match
• Employee Stock Purchase
• Training and Advancement Opportunities
• Tuition Reimbursement
• Birthdays Off
• Philanthropic Opportunities
• Referral Program
• Partial Gym Membership Paid
• Team Building Events
• Discount Programs

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact [email protected].

VEVRAA Federal Contractor.

We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state.

PDN-a1639dc4-8b9c-4cf3-bb87-260a04009c72