What are the responsibilities and job description for the Lead Data Egnineer - Onsite Charlotte, NC position at Central Business Solutions?
Position: Senior / Lead Databricks Data Engineer
Location: Charlotte, NC
Work Arrangement: Onsite
Location: Charlotte, NC
Work Arrangement: Onsite
Job Description:
We are looking for a Senior/Lead Databricks Data Engineer to support a strategic data engineering initiative. The ideal candidate should have strong hands-on experience with Databricks, PySpark, Python, and SQL.
Key Responsibilities:
- Design and develop scalable data pipelines using Databricks and PySpark.
- Develop ETL/ELT pipelines using Python and SQL.
- Work with Delta Lake and Lakehouse architecture.
- Optimize Spark/Databricks jobs for performance and scalability.
- Work with cloud data platforms such as Azure/AWS.
- Develop and maintain Databricks workflows and data pipelines.
- Collaborate with architects, developers, and business teams.
- Troubleshoot and resolve data engineering issues.
Required Skills:
- 12 years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong PySpark/Spark, Python, and SQL skills.
- Experience with Delta Lake/Lakehouse.
- Experience with Azure Databricks or other cloud platforms.
- Strong understanding of data pipelines and ETL/ELT.
- Excellent communication and problem-solving skills.
- Experience leading technical initiatives, mentoring engineers, and working with stakeholders.
Important: This is a 100% onsite position in Charlotte, NC. Candidates must be willing to work onsite.