What are the responsibilities and job description for the Databricks Consultant position at Zachary Piper Solutions?
Zachary Piper Solutions is seeking a Databricks Consultant to join a fast-paced data and AI initiative focused on optimizing enterprise analytics and LLM-driven business intelligence solutions. The consultant will support the setup, implementation, testing, and optimization of a Databricks Genie workspace while ensuring strong data quality, governance, and business context alignment. This is a remote role.
Responsibilities of the Databricks Consultant:
Compensation: $150,000 - $200,000 based on years of experience
Full Benefits: Cigna Medical, Dental, Vision, 401k, PTO/Holiday, Sick leave as required by state law
Additional Details:
Responsibilities of the Databricks Consultant:
- Set up and launch a Databricks Genie workspace
- Review data readiness to ensure business users can confidently answer core reporting and analytics questions
- Finalize implementation of new ingestion patterns
- Review data pipelines and finalize table definitions to ensure data quality standards are met
- Ensure aggregated gold tables are created to provide optimized context for Genie spaces
- Review and improve documentation related to Genie spaces
- Create, curate, and manage Genie spaces for business use cases
- Tune Genie space quality and optimize responses for business users
- Test and monitor Genie spaces and iterate based on feedback and evaluation results
- Curate Genie spaces with strong business context including:
- Official table descriptions
- Business definitions and column comments
- Global instructions for ambiguity handling
- Defined join relationships and usage guidance
- SQL expressions for core business metrics
- Example SQL queries and expected prompts
- Optional SQL functions for advanced logic handling
- Add benchmarks and evaluation metrics to support testing and validation efforts
- Hands-on experience with Databricks, including Genie spaces and Delta Lake architecture
- Strong SQL and data modeling experience
- Experience working with silver/gold table structures and modern data pipeline frameworks
- Familiarity with LLM-powered analytics, AI-assisted querying, or conversational BI tools
- Strong understanding of data governance, business context curation, and data quality best practices
- Experience testing and optimizing AI or analytics platforms preferred
- Ability to work independently in a fast-moving consulting environment
Compensation: $150,000 - $200,000 based on years of experience
Full Benefits: Cigna Medical, Dental, Vision, 401k, PTO/Holiday, Sick leave as required by state law
Additional Details:
- Start Date: Approximately 6/7/2026
- Duration: Approximately 80 hours per resource over 2–3 weeks
- Work Environment: Remote/Client travel
Salary : $150,000 - $200,000