What are the responsibilities and job description for the Databricks Architect position at Q1 Technologies, Inc.?
Job Title: Databricks Architect
Duration- Fulltime Permanent
Location: Malvern PA (Onsite From Day 1/Hybrid)
Job Description:
Databricks Architect- 14 years
Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing.
Databricks Architect, Databricks Lakehouse, Apache Spark, PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, Data Modeling, ETL, ELT, AWS, S3, Redshift, Glue, Airflow, Terraform, CI/CD, Data Governance, Lakehouse Architecture, Performance Tuning
Must Have Technical/Functional Skills
• AWS Data Services – S3, Redshift, Glue, Lambda, Athena.
• Data Modeling – Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
• Data Lake Architecture – Amazon S3, Lake Formation, Data Lake best practices.
• Big Data & Processing – Spark/PySpark, Amazon EMR.
• ETL/ELT Development – AWS Glue, Airflow, Data Pipeline orchestration.
• SQL Expertise – Advanced SQL, query optimization, performance tuning.
• Streaming & Real-Time Data – Kinesis and/or Kafka
• Security & Governance – IAM, KMS, Lake Formation, Encryption, Data Governance.
• Infrastructure as Code – Terraform and/or CloudFormation.
• Architecture & Stakeholder Management – Solution design, cloud migration, business requirement translation.
Roles & Responsibilities
Senior Databricks Architect with strong experience in designing and implementing enterprise-scale
Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Responsible for defining data strategy, architecture standards, governance, and scalable analytics platforms supporting AI/ML and business intelligence initiatives
Generic Managerial Skills, If any
• Strong leadership and stakeholder management skills, with experience leading cross-functional teams and driving delivery excellence.
• Proven effective communication with business and technical stakeholders.