What are the responsibilities and job description for the Staff Software Engineer - Distributed Data Systems position at Jobright.ai?
Verified Job On Employer Career Site
Job Summary:
Databricks is a leading data and AI company, focused on enabling data teams to tackle complex problems through their infrastructure platform. The Staff Software Engineer will be responsible for developing advanced distributed data systems and optimizing data storage and processing capabilities.
Responsibilities:
• Building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.
• Deliver reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store.
• Develop the de facto open source standard framework for big data.
• Build the next generation query optimizer and execution engine that's fast, tuning free, scalable, and robust.
• Make it simple and possible to orchestrate and operate tens of thousands of data pipelines.
Qualifications:
Required:
• BS in Computer Science, related technical field or equivalent practical experience.
• Comfortable working towards a multi-year vision with incremental deliverables.
• Driven by delivering customer value and impact.
• 8 years of production level experience in either Java, Scala or C .
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop).
Preferred:
• MS or PhD in databases, distributed systems
Company:
Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture. Founded in 2013, the company is headquartered in San Francisco, California, USA, with a team of 5001-10000 employees. The company is currently Late Stage. Databricks has a track record of offering H1B sponsorships.
