What are the responsibilities and job description for the Lead Data Engineer - Databricks / PySpark position at The Planet Group?
Duration - 6 months Contract to Hire
Location - 3 days hybrid in Arlington, TX - looking for local candidates only
Rate - 75-85/hour W2 only
USC/GC/H4EAD and GC EAD candidates only - client will not sponsor/transfer H1B - no 3rd party candidates
Lead Software Engineer - Pyspark/Python / Databricks / Angular and Azure Must have skills
WILL DO 50/50 DEV AND ENGINEERING WORK. AZURE. NO DIRECT REPORTS...TEAM OF 5-7 TO MENTOR, PUT BEST PRACTICES IN PLACE.
WILL WORK WITH PYSPARK, DATABRICKS, PYTHYON, ANGULAR
Are you a passionate technology leader ready to shape the future of data-driven solutions? Join us as a Lead Software Engineer and spearhead the development of high-impact, scalable software platforms that deliver actionable insights and drive strategic decision-making. Located in Irving and collaborating closely with a talented team, you will play a pivotal role in architecting innovative AI-powered data solutions that elevate our business capabilities
Required Skills:
- Bachelor’s degree or equivalent experience
- 8 years of software development experience
- 2 years in a leadership or mentoring role
- Proficiency in Python/PySpark and experience with Angular
- Strong experience with Azure cloud platform
- Expertise in designing microservices, distributed systems, and scalable architectures
- Hands-on knowledge of CI/CD, testing, application security, and data engineering frameworks like Spark and Databricks
- Excellent problem-solving, analytical, and troubleshooting skills
- Effective communication skills, capable of engaging both technical and non-technical stakeholders
- Experience working in Agile, collaborative environments
Nice to Have Skills:
- Experience with streaming technologies and real-time data processing
- Familiarity with data modeling, warehousing, and lakehouse architectures
- Exposure to AI/ML workflows and data-driven applications
- Background in developing and managing large-scale data pipelines and platforms
#TECH
Salary : $75 - $85