Technical Consultant – Databricks

Technical Consultant

Location: Remote (U.S.-based, EST hours preferred)
Type: Full-Time (Permanent)
Salary Range: $100,000 – $125,000 10% annual bonus

Overview

We are seeking a Databricks Technical Consultant to design and develop scalable data pipelines in a cloud-native environment. This hands-on role is perfect for a data engineer with 2–5 years of experience who thrives in fast-paced, collaborative environments and has a passion for solving complex data problems using Databricks, Python, and SQL.

Key Responsibilities

• Build and maintain ETL/ELT pipelines using Databricks and PySpark
• Develop advanced SQL queries and Python scripts for data transformation and validation
• Work with structured and semi-structured data (CSV, JSON, Parquet, XML)
• Leverage Databricks notebooks, Delta Lake, and Unity Catalog to deliver robust solutions
• Collaborate with cross-functional teams to deliver data ingestion and transformation workflows
• Support workflow orchestration and cloud-based automation pipelines

Required Skills & Experience

• Minimum 2 years of experience using Databricks with Python and SQL
• Strong experience in data ingestion, pipeline development, and data validation
• Experience working with batch ingestion (streaming experience a plus)
• Solid knowledge of Delta Lake and modern data lakehouse practices
• Familiarity with data modeling (star/snowflake schemas), CTEs, window functions

Certifications (Preferred)

• Databricks Certified Data Engineer – Associate

Preferred

• Experience with dbt, Fivetran, Coalesce, or other transformation tools
• Exposure to data quality tools (e.g., Great Expectations)
• Experience working in enterprise environments (healthcare, retail, finance, etc.)