What are the responsibilities and job description for the Databricks Data Engineer with Security Clearance position at ClearanceJobs?
Databricks Data Engineer About the Team
Here at BTI360, we’ve built a culture that’s passionate about developing software engineers. Software doesn't build itself. People do. In fact, teams of people do. That's why our primary focus is on developing better craftsmen, better teammates, and better technical leaders. By putting people first, we're not just giving our teammates more opportunities to grow, we're also raising the bar of the software we ship. BTI360 previously has been voted 10 years in a row as a TOP Place to Work by the Washington Business Journal. BTI360 is a data discovery company, using AI/ML to transform proprietary data into actionable insights that directly support our customers’ missions. We are seeking a Databricks Data Engineer to serve as a Resident Solutions Architect (RSA), a consultant, trusted advisor, and hands-on implementer with deep Spark/Databricks expertise, for our national security customers in classified environments. As part of our partnership with Databricks, you will work on short-to-medium term engagements, optimizing data pipelines and driving data management & enrichment solutions on the Databricks platform. Your contributions will directly support BTI360’s core mission of Data Discovery through improved Data Management and Data Enrichment, laying the foundation for advanced analytics and generative AI capabilities on mission data. This position is based in Northern Virginia and requires on-site support for classified projects. What you will do in this role:
Here at BTI360, we’ve built a culture that’s passionate about developing software engineers. Software doesn't build itself. People do. In fact, teams of people do. That's why our primary focus is on developing better craftsmen, better teammates, and better technical leaders. By putting people first, we're not just giving our teammates more opportunities to grow, we're also raising the bar of the software we ship. BTI360 previously has been voted 10 years in a row as a TOP Place to Work by the Washington Business Journal. BTI360 is a data discovery company, using AI/ML to transform proprietary data into actionable insights that directly support our customers’ missions. We are seeking a Databricks Data Engineer to serve as a Resident Solutions Architect (RSA), a consultant, trusted advisor, and hands-on implementer with deep Spark/Databricks expertise, for our national security customers in classified environments. As part of our partnership with Databricks, you will work on short-to-medium term engagements, optimizing data pipelines and driving data management & enrichment solutions on the Databricks platform. Your contributions will directly support BTI360’s core mission of Data Discovery through improved Data Management and Data Enrichment, laying the foundation for advanced analytics and generative AI capabilities on mission data. This position is based in Northern Virginia and requires on-site support for classified projects. What you will do in this role:
- Design & Optimize Data Pipelines: Build and refine large-scale data pipelines on the Databricks platform to enable data discovery and enrichment for mission-critical applications.
- Technical Leadership & Advisory: Serve as a Databricks subject-matter expert and trusted advisor to customer teams, providing guidance on architecture, Spark best practices, performance tuning, and innovative big data solutions.
- Customer Engagements: Deliver short to medium-term professional services engagements in classified or unclassified environments, adapting quickly to new project domains and requirements while delivering solutions on time and to specification.
- Solution Implementation: Integrate Databricks solutions with complex client systems and workflows, collaborating with BTI360 and customer engineering teams to ensure successful deployment and adoption of new data capabilities.
- Enablement & Support: Provide hands-on support and training to customer engineers and data teams, helping them maximize platform value (including creating how-to guides, reference architectures, and troubleshooting as needed). You may thrive in this role if you have the following skills:
- Active Secret clearance or above, with the ability to be cleared at the TS/SCI with Polygraph level
- Spark & Databricks Expertise: Hands-on experience with Apache Spark and the Databricks platform, including building and scaling data pipelines.
- Data Engineering Experience: 5 years of experience in data engineering or big data analytics, with strong coding skills in Python and/or Scala/Java for data processing.
- Cloud & CI/CD Proficiency: Experience developing solutions in cloud environments (AWS and/or Azure) and familiarity with CI/CD pipelines and DevOps practices for deploying data workflows.
- Consulting Skills: Client-facing communication and problem-solving skills, with the ability to translate complex data challenges into actionable solutions and effectively guide customer teams.
- Adaptability: Proven ability to thrive in a dynamic environment, capable of juggling multiple projects and quickly learning new datasets, tools, and mission domains as engagements rotate. You may excel in this role if you have the following skills:
- Active TS/SCI with Polygraph
- Experience with the Databricks platform
- Databricks Certified Data Engineer Professional BTI360 benefits for full-time teammates
- Fully paid healthcare premiums
- Competitive salaries and performance bonuses
- Career development and in-house training
- Continuing Education: $5,250.00 annually towards education
- Up to 5 weeks PTO plus 2 weeks of federal holidays
- 401K dollar for dollar matching up to 6% annually - vested immediately on day 1
- Giving Back: Serving communities locally and across the globe
- Social Events (happy hours, golf tournament, BTI360 Family Festival and more)
Salary : $5,250