What are the responsibilities and job description for the Senior Databricks FullStack Consultant position at Citadel Information Services Inc?
Looking for a Databrickscentric FullStack Consultant with deep expertise in Databricks app deployments, Lakehouse and Medallion architecture, and scalable data pipeline development. Required skills include advanced Python development, Databricks Jobs and Apps, Kubernetesbased deployment of Python services, UI development using Streamlit, and backend/API development with Django, including BPMN workflow orchestration. Experience supporting enterprise data, risk, or compliance platforms is a strong plus.
Key Responsibilities:
Design and implement Databricks Lakehouse / Lakebase platforms using Medallion Architecture, Unity catalog
Build and deploy Databricks Apps with Python based backends
Develop end-to-end data pipelines (batch & streaming) on Azure Databricks
Build fullstack applications using Python, Django, Flask, and Streamlit
Deploy Python services and applications using Kubernetes
Implement Streamlit based UIs for internal enterprise workflows
Design and implement Bumbazed workflows within Django applications
Integrate platforms with Collibra for governance, lineage, and certification
Ensure enterprise grade security, auditability, and regulatory compliance
Core Technical Requirements
Databricks & Data Engineering
Databricks Apps development and deployment
Delta Lake, Lakehouse / Lakebase architecture
Medallion Architecture (Bronze / Silver / Gold)
Databricks Jobs, performance tuning, and production support
Application Development
Advanced Python development
Backend frameworks: Django, Flask
UI development using Streamlit
Development of data driven enterprise applications on Databricks
DevOps & Deployment
Deploying Python applications on Kubernetes, Azure functions
Git Hub CI/CD for Databricks and application workloads
Secure integration with Azure identity and access controls
Workflow & Governance
BPMN based workflow design and execution using Django
Data governance, lineage, and certification using Collibra
Strong understanding of banking regulatory controls and audit requirements
Experience Profile
15 years of experience
Mandatory banking / financial services background
Prior work supporting Risk, Finance, Compliance, or Regulatory Reporting platforms
Experience working in highly regulated enterprise environments