What are the responsibilities and job description for the Manager - Databricks Engineer position at Kubrick Group?
Location - New York - Hybrid 2/3 days office based
Kubrick is where ambitious individuals accelerate their careers while shaping the future of data and AI.
About Kubrick
Kubrick is a data and AI consultancy that specializes in helping organizations unlock the full value of their data. We combine business and technology expertise to design and deliver solutions that drive real, lasting impact. Our clients span industries including financial services, healthcare, retail, and more, and we partner with leading technology providers such as AWS, Microsoft, Snowflake, Databricks, and Collibra.
What sets us apart is how we build capability and careers. From early on, you’ll have the opportunity to make an impact, take ownership, and work on initiatives that shape how the business evolves. You’ll be encouraged to think differently, experiment, and develop quickly in a collaborative, high-performing environment.
The Role:
We’re looking for an experienced Data Engineer with expertise in Databricks, Apache Spark, Delta Lake, Python and SQL to lead technical delivery in our innovative client projects. You’ll design, build, and optimise scalable cloud-based data pipelines on platforms like AWS, Azure, or GCP, while providing technical leadership within Kubrick’s delivery squads.
In this role, you’ll collaborate with clients and internal teams, translate business requirements into robust data solutions, and help grow Kubrick’s Databricks capabilities. Strong problem-solving, communication skills, and a client-focused mindset are essential.
What we offer:
- Leadership opportunities on high-impact data projects
- Continuous learning and Kubrick-funded certifications
- Collaboration with a top-tier Databricks developer community
Requirements:
- Must be able to demonstrate Data Engineering with cloud experience
- Expertise in Databricks (a must!), Spark and Delta Lake
- Advanced Python & SQL skills
- Experience with CI/CD, automated testing, and data governance
What it’s like to work at Kubrick
We’re a collaborative, high-performing team that values curiosity, ownership and continuous improvement. You’ll work in an environment where ideas are encouraged, contributions are recognized, and people are supported to do their best work. With strong visibility across the business and close collaboration between teams, you’ll have the opportunity to make a real impact and grow your career.
Benefits
- 15 PTO days plus 11 public holidays (26 days in total)
- 401K program with company match up to 3%
- Healthcare insurance (80% premium employer paid)
- Dental insurance
- Vision insurance
- Long term disability insurance (100% employer paid)
- Option to purchase additional voluntary benefit
- Additional carers leave
- Employee Assistance support
- Mental health, diversity, and inclusion support
- Learning and development opportunities
- Employee discounts via LifeMart
We also offer a hybrid working environment with a requirement to be in our NY office 2-3 days a week/client meetings and home working
Diversity & inclusion
We’re committed to building a diverse and inclusive workplace where everyone can thrive. We’re proud to have above-industry representation of women and non-binary individuals in tech, supported by communities such as ELEVATE and LGBTKubrick .
If you require any accommodations during the application or interview process, please let us know - we’re here to support you.
If you require any adjustments during the application or interview process, please let us know as we’re here to support you.