What are the responsibilities and job description for the Senior Data Engineer position at 100 CRC Insurance Group, LLC?
The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. If you have a disability and need assistance with the application, you can request a reasonable accommodation. Send an email to Accessibility (accommodation requests only; other inquiries won't receive a response). Regular or Temporary: Regular Language Fluency: English (Required) Work Shift: 1st Shift (United States of America) Please review the following job description: We are seeking a highly skilled Data Engineer to design, build, and optimize enterprise-grade data solutions leveraging Databricks and modern cloud technologies. This role will lead data solutions, data engineers, ensuring scalable, secure, and efficient data pipelines that power analytics and business intelligence across the division Key Responsibilities Design and develop data pipelines using Databricks Lakehouse architecture, including ingestion, transformation, and orchestration layers. Implement Medallion architecture (Bronze, Silver, Gold layers) and manage data lineage, quality, and governance using Unity Catalog. Drive adoption of best practices for data governance, metadata management, and cost optimization. Mentor and guide junior engineers, ensuring adherence to coding standards and architectural principles. Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to translate requirements into technical solutions. Automate workflows for data ingestion and transformation using Databricks Jobs and orchestration tools. Monitor and troubleshoot performance issues across pipelines and clusters. Implement robust data security measures, including encryption, access controls, and auditing. Stay current with emerging technologies and recommend improvements to enhance scalability and efficiency. Required Qualifications Experienced Senior Data Engineer with over 3 years of Databricks expertise. Strong hands-on expertise with Databricks, including: Spark (PySpark or Spark SQL) Delta Lake Data Lakehouse architecture Unity Catalog Proficiency in Python and SQL for data engineering workflows. Databricks Certified Data Engineer Professional (or equivalent) is mandatory. Familiarity with CI/CD practices and infrastructure-as-code. Preferred Qualifications Experience with DBT for transformation and dependency management. Azure Data Engineer Associate or AWS certifications are often preferred. Knowledge of data governance frameworks and observability tools. Exposure to machine learning pipelines and MLflow is a plus. General Description of Available Benefits for Eligible Employees of CRC Group: At CRC Group, we're committed to supporting every aspect of teammates' well-being – physical, emotional, financial, social, and professional. Our best-in-class benefits program is designed to care for the whole you, offering a wide range of coverage and support. Eligible full-time teammates enjoy access to medical, dental, vision, life, disability, and AD&D insurance; tax-advantaged savings accounts; and a 401(k) plan with company match. CRC Group also offers generous paid time off programs, including company holidays, vacation and sick days, new parent leave, and more. Eligible positions may also qualify for restricted stock units and/or a deferred compensation plan. CRC Group supports a diverse workforce and is an Equal Opportunity Employer that does not discriminate against individuals on the basis of race, gender, color, religion, citizenship or national origin, age, sexual orientation, gender identity, disability, veteran status or other classification protected by law. CRC Group is a Drug Free Workplace. EEO is the Law Pay Transparency Nondiscrimination Provision E-Verify Join CRC Group, a leader in specialty wholesale insurance, and take your career to new heights. We're a dynamic team dedicated to innovation, collaboration, and excellence. Why CRC Group? • Growth: Advance your career with our learning and leadership development programs. • Innovation: Work in a forward-thinking environment that values new ideas. • Community: Be part of a supportive team that celebrates success together. • Benefits: Enjoy competitive compensation, health benefits, and retirement plans. Who We’re Looking For We seek passionate individuals who thrive in a fast-paced, collaborative environment. If you value integrity and are driven to succeed, CRC Group is the place for you.