What are the responsibilities and job description for the Senior Data Developer position at Madison-Davis, LLC?
Description
Our client is a global financial institution is seeking a Data Platform Engineer to design and build the core infrastructure layer of its cloud-first data platform. This role focuses on wrapping orchestration tools like Databricks and Airflow into enterprise-ready services that business users can access through a GUI, enabling them to manage workflows, dependencies, and data transformations without direct exposure to the underlying systems.
You’ll sit at the heart of the platform, partnering with UI developers, architects, and stakeholders to deliver scalable, secure, and reliable tools that normalize and transform enterprise data for consumption.
- Build core services that define jobs, pipelines, users, and dependencies on the platform
- Engineer workflow and transformation tools that abstract complexity from Databricks and Airflow
- Partner with UI developers to expose orchestration functionality through intuitive interfaces
- Develop reusable frameworks and services that enable self-service and visibility for business users
- Transform and normalize ingested cloud data into structured, consumable formats
- Ensure security, scalability, and compliance in all platform components
- Mentor and guide engineers in best practices for data platform design and delivery
- Deep expertise in Azure cloud, Databricks, and Airflow/Astronomer
- Strong proficiency in Python and workflow orchestration patterns
- Experience designing and delivering core platform tools used by diverse user groups
- Proven background in data transformations, pipelines, and orchestration frameworks
- Strong architectural skills and the ability to abstract technical detail into enterprise-ready services
- Excellent collaboration skills across engineering, UI, and business stakeholders
- Experience with Data Factory or other orchestration/ETL tools
- Familiarity with data governance, metadata, and contracts
- Exposure to financial services or regulated environments