Staff Engineer I - Azure Databricks Engineer

Software Resources has an immediate, direct hire job opportunity for a Staff Engineer I - Azure Databricks Engineer with a major corporation in Dallas, TX.

4 days per week on-site, Friday Remote.

What you'll do:

As a Staff Engineer I embedded in the Enterprise Data & Analytics function, you will be responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data.

You'll work in a mid-level role with proficiency needed in building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc. As a Staff Engineer I, you will partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform.

• Take assignments that can be worked on individually without supervision and manage work effort from concept to completion.

• Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance.

• Implement and manage Azure Databricks workspaces, clusters, jobs, access management.

• Implement and manage policies, monitoring and observability for the Azure Databricks platform.

• Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements.

• Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics.

• Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services.

• Stay current on emerging data analytics technologies, recommending enhancements to improve efficiency and governance.

What you'll need:

• 5 years of related experience in data analytics administration and development.

• 2 years of Databricks related experience.

• Bachelor's degree in related field required.

• Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs).

• Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking.

• Experience with CI/CD pipelines (Azure DevOps preferred).

• Strong programming skills in SQL, Python, and/or PySpark.

• Intermediate to advanced knowledge of general Financial Services or Banking preferred.

• Proven experience in leading cross-functional teams and managing multiple projects simultaneously.

• Intermediate to advanced ability to see the big picture and align projects with organizational goals. Capable of leading and motivating cross-functional teams. Expertise in resolving conflicts and addressing challenges as well as skilled at identifying and mitigating risks at the project level.

• Good communication skills, excellent teamwork experience.

• Occasional travel might be required.

Benefits you'll love:
We offer all the important things you'd want like competitive salaries, an ownership stake in the company, medical and dental insurance, time off, a great 401k matching program, tuition assistance program, an employee volunteer program, and a wellness program. In addition, you'll have the opportunity to bolster your business knowledge, learning the ins and outs of how successful companies operate and manage their finances, giving you invaluable hands-on experience to help grow your career!

If this position fits interests you, we encourage you to apply.