What are the responsibilities and job description for the Data Engineer, Databricks position at KeyLogic, LLC?
KeyLogic is seeking Databricks Engineers to join our growing team supporting the Department of Energy (DOE).
The position requires U.S. Citizenship
Position Requirements:
- U.S. Citizenship
- 2 years of engineering experience on Databricks and large-scale big data projects (Delta Lake, DLT, Apache Spark, unity Catalog).
- Bachelor's Degree
- 4 years of experience in Python, Java, or equivalent. Comfortable with evaluation tooling, logging, monitoring, and observability
- Experience with government contracting
Position Description:
As a Data Engineer in this role, you will be responsible for designing, building, and maintaining robust data pipelines that support the organization's analytical and operational needs. You will work closely with cross-functional teams to ensure data is collected, processed, and made available in a reliable and scalable manner. Leveraging your expertise, you will optimize data workflows and implement best practices for data integration, transformation, and storage. Your contributions will directly impact the efficiency and effectiveness of data-driven decision-making across the business.
To excel in this position, you will utilize tools such as Databricks for advanced data processing and analytics, and Terraform for infrastructure automation and management. Familiarity with cloud-based environments, version control systems, and CI pipelines will further enhance your ability to deliver high-quality solutions. Experience with large-scale data architectures, real-time data streaming, and performance tuning will help you address complex challenges and drive continuous improvement. Your background in collaborating with diverse technical teams and managing end-to-end data solutions will be instrumental in achieving success in this dynamic environment.
Position Responsibilities:
- Design, build, and maintain scalable data pipelines using Databricks
- Develop and implement infrastructure as code solutions with Terraform
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions
- Optimize data workflows for performance, reliability, and scalability
- Monitor, troubleshoot, and resolve issues related to data processing and infrastructure
- Ensure data quality and integrity throughout the data lifecycle
- Automate repetitive tasks to improve efficiency and reduce manual intervention
Salary dependent upon experience: $90,000- $140,000
About KeyLogic:
Supporting critical missions at the intersection of data and science, KeyLogic provides mission management, systems analysis, data analytics, digital transformation, and cybersecurity to customers in the energy, federal civilian, and defense sectors, with a 20 year portfolio of successes supporting DOE, DOC, EPA, DOD, DHS, FBI, and other federal agencies challenged with complex missions. We help our customers solve the world's most challenging problems with unsurpassed anticipatory service.
KeyLogic employs over 400 team members, including systems designers, developers, data scientists, IT and cybersecurity specialists, engineers, mission experts, program managers, and more than 70 Ph.D. scientists. This multidisciplinary team works together solving challenging problems with anticipatory service-always staying one step ahead-benefiting our customers, and ultimately helping build a better world.
We are committed to the success of each customer's mission. We care enough to make their mission our mission and their success our success. We take technical service delivery to a level above our peers. Our anticipatory service is best-in-class.
KeyLogic is an Equal Opportunity/Equal Access Employer. KeyLogic is committed to a policy of non-discrimination against individuals on the basis of any legally protected status.
If you need a reasonable accommodation for any part of the employment process, please contact us by email at Recruiting@KeyLogic.com and let us know the nature of your request and your contact information. Request for accommodation will be considered on a case-by-case basis.
Salary : $90,000 - $140,000