What are the responsibilities and job description for the Databricks Engineer position at Cyber Space Technologies LLC?
We're looking for a Data Engineer with strong experience in Databricks and Python to work on large-scale data platforms and analytics solutions. This role requires hands-on development and close collaboration with business and technology teams in a fully onsite environment.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using Databricks and Python
- Develop and optimize ETL/ELT processes for large, complex datasets
- Work with structured and semi-structured data from multiple sources
- Collaborate with data architects, analysts, and stakeholders to deliver data solutions
- Ensure data quality, performance, and reliability across pipelines
- Support production deployments, monitoring, and issue resolution
- Follow best practices for data engineering, security, and compliance standards
Required Skills & Qualifications:
- Strong experience as a Data Engineer
- Hands-on expertise with Databricks
- Strong Python development skills
- Experience with Spark and distributed data processing
- Solid understanding of data modeling and data warehousing concepts
- Experience working in enterprise environments