What are the responsibilities and job description for the AWS Databricks Platform Support Architect position at SmartIT Frame?
Role - AWS Databricks Platform Support Architect
Location - Raritan NJ Onsite
Role Summary
Lead the administration, support, governance, and optimization of enterprise Databricks platforms on AWS. Responsible for platform reliability, security, automation, performance, and production support.
• Architect and support AWS Databricks environments across Dev, QA, UAT, and Prod.
• Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog, and access controls.
• Provide L2/L3 production support, incident management, and root cause analysis.
• Implement governance, security, IAM, RBAC, monitoring, and compliance controls.
• Optimize platform performance, scalability, and cloud costs.
• Automate deployments using Terraform, CI/CD, and Infrastructure as Code.
• Collaborate with Data Engineering, Cloud, and Security teams on platform enhancements.
• Databricks: Workspace Administration, Unity Catalog, Delta Lake, Cluster Management, Jobs & Workflows.
• AWS: S3, IAM, EC2, Lambda, Glue, CloudWatch, VPC, Secrets Manager.
• Data Technologies: Spark, PySpark, SQL, Data Lake/Lakehouse Architecture.
• DevOps: Terraform, GitHub, Jenkins, Azure DevOps, CI/CD.
• Programming: Python, PySpark, Shell Scripting.
• 10 years in IT with 4 years of Databricks administration/support.
• Hands-on experience with AWS cloud platforms and enterprise production support.
• Strong troubleshooting, stakeholder management, and leadership skills.Preferred Certifications
• AWS Solutions Architect Professional
• AWS Data Engineer Associate
• Databricks Certified Professional/Admin
• Terraform Associate