What are the responsibilities and job description for the Databricks Architect position at Delta System & Software, Inc.?
Title - Databricks Architect
Minneapolis, MN Hybrid/ Onsite
Long Term
• Provide guidance and support to teams and analysts.
• Expert on Databricks and AWS, with minimum 10 years of experience
• Databrick certification is a must
• Collaborate on data strategy with business and IT partners.
• Identify and address data issues.
• Lead architecture, design, and implementation of scalable and efficient data pipelines and analytics solutions on Databricks.
• Work closely with data engineering, platform, and analytics teams to integrate Databricks with AWS S3 Data Lake, Redshift, Talend, SAP BW/HANA, Oracle, and other tools.
• Architect solutions supporting batch and real-time data processing using Delta Lake, Spark, and ML Flow.
• Collaborate with business stakeholders to understand data requirements, assess current state, and provide strategic direction for future-state architecture.
• Ensure best practices for data quality, governance, and security are implemented.
• Own design, development, and delivery of pipelines and models as per the project plan.
• Ensure best practices are followed in performance, security, and governance.
• Provide project documentation and conduct KT sessions
• Ensure following acceptance criteria is met, by working along with current development and pool partners
o Successful ingestion and transformation of in-scope objects.
o Validated and reconciled transformed data within defined thresholds.
o Fully operational Snowflake warehouse with business-validated datasets.
o Documented operational playbooks and KT completed.
o No critical issues post go-live during hyper-care window
Email: Sachin.joshi@deltassi.com
About Delta System & Software Inc.:
Delta is emerging as one of the fastest growing IT Staffing and professional services company specializing in SAP, Guidewire, Cloud, AI, ML, SRE, data and applications development. Headquartered in Texas, we are a global company with offices in USA, Canada, India, Europe, Middle East, Australia. We help clients transform through business and technology consulting, digital solutions, applications development, maintenance and support services. Visit www.deltassi.com to learn more.
Delta is an equal opportunity employer and considers all applicants without regarding to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees.