What are the responsibilities and job description for the Data Engineering Lead position at hackajob?
hackajob is collaborating with Verisk to connect them with exceptional tech professionals for this role.
As a Data Engineer, you will be responsible for transforming raw data from our applications into structured datasets for large-scale analysis and machine learning model training. You will work closely with our development, data science, and business intelligence teams to ensure data integrity, quality, and accessibility.
Responsibilities
Data Pipeline Development: Design, develop, and maintain scalable data pipelines to process raw data from various sources.
Data Transformation: Clean, transform, and enrich data to create high-quality datasets suitable for analysis and machine learning.
Collaboration: Work closely with product teams, software developers, data scientists, and analysts to understand data needs and deliver innovative solutions.
Data Management: Ensure data accuracy, consistency, and reliability across all datasets.
Optimization: Optimize data processes for performance and scalability.
Documentation: Maintain comprehensive documentation of data pipelines, processes, and schemas.
Working Conditions
40 hours per week, with occasional, but rare, overtime
Remote / Hybrid / Flexible Work Options Available
Frequent interaction with developers, test automation engineers, QA, management, and members of other Verisk subsidiaries
Some days we just leave the office and have fun team building activities!
Regular team lunches!
State of the art facility with basketball, volleyball, and gym
Ping pong, foosball, fruit bowls, snacks
Fun and energetic teams
Time for innovation, Hack-A-Thons, and learning
Qualifications
Educational Background: bachelor’s degree in computer science, Data Engineering, or a related field.
Experience: 3 years of experience as a Data Engineer or in a similar role.
Technical Proficiency
Programming Languages: Proficiency in Python, SQL, and familiarity with languages such as C# or Java.
Data Processing: Experience with ETL tools and frameworks (e.g., Apache Airflow, Luigi, DBT).
Big Data Technologies: Hands-on experience with big data technologies such as Hadoop, Spark, and Kafka.
Database Management: Strong knowledge of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
Cloud Platforms: Experience with cloud services (e.g., AWS, Google Cloud, Azure) and their data processing tools (e.g., AWS Glue, Google BigQuery).
AI: Familiarity and enthusiasm for bleeding-edge analytical enablement using tools such as Large Language Models and Prompt Engineering.
Data Warehousing: Knowledge of data warehousing concepts and solutions (e.g., Redshift, Snowflake).
Version Control: Proficient with version control systems (e.g., Git).
Machine Learning: Understanding of machine learning concepts and experience working with data for ML model training.
About Us
For over 50 years, Verisk has been the leading data analytics and technology partner to the global insurance industry by delivering value to our clients through expertise and scale. We empower communities and businesses to make better decisions on risk, faster.
At Verisk, you'll have the chance to use your voice and build a rewarding career that's as unique as you are, with work flexibility and the support, coaching, and training you need to succeed.
For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work® for outstanding workplace culture in the US, fourth consecutive year in the UK, Spain, and India, and second consecutive year in Poland. We value learning, caring and results and make inclusivity and diversity a top priority. In addition to our Great Place to Work® Certification, we’ve been recognized by The Wall Street Journal as one of the Best-Managed Companies and by Forbes as a World’s Best Employer and Best Employer for Women, testaments to the value we place on workplace culture.
We’re 7,000 people strong. We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.
Verisk Businesses
Underwriting Solutions — provides underwriting and rating solutions for auto and property, general liability, and excess and surplus to assess and price risk with speed and precision
Claims Solutions — supports end-to-end claims handling with analytic and automation tools that streamline workflow, improve claims management, and support better customer experiences
Property Estimating Solutions — offers property estimation software and tools for professionals in estimating all phases of building and repair to make day-to-day workflows the most efficient
Extreme Event Solutions — provides risk modeling solutions to help individuals, businesses, and society become more resilient to extreme events.
Specialty Business Solutions — provides an integrated suite of software for full end-to-end management of insurance and reinsurance business, helping companies manage their businesses through efficiency, flexibility, and data governance
Marketing Solutions — delivers data and insights to improve the reach, timing,relevance, and compliance of every consumer engagement
Life Insurance Solutions - offers end-to-end, data insight-driven core capabilities for carriers, distribution, and direct customers across the entire policy lifecycle of life and annuities for both individual and group.
Verisk Maplecroft — provides intelligence on sustainability, resilience, and ESG, helping people, business, and societies become stronger
Verisk Analytics is an equal opportunity employer.
Verisk invests in a benefits package for all employees that includes the following: Health Insurance, a Retirement Plan, Disability benefits, and a Paid Time Off program. We offer a competitive total rewards package that includes base salary determined based on role, experience, skill set, and location.
All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability. Verisk’s minimum hiring age is 18 except in countries with a higher age limit subject to applicable law.
Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.
As a Data Engineer, you will be responsible for transforming raw data from our applications into structured datasets for large-scale analysis and machine learning model training. You will work closely with our development, data science, and business intelligence teams to ensure data integrity, quality, and accessibility.
Responsibilities
Data Pipeline Development: Design, develop, and maintain scalable data pipelines to process raw data from various sources.
Data Transformation: Clean, transform, and enrich data to create high-quality datasets suitable for analysis and machine learning.
Collaboration: Work closely with product teams, software developers, data scientists, and analysts to understand data needs and deliver innovative solutions.
Data Management: Ensure data accuracy, consistency, and reliability across all datasets.
Optimization: Optimize data processes for performance and scalability.
Documentation: Maintain comprehensive documentation of data pipelines, processes, and schemas.
Working Conditions
40 hours per week, with occasional, but rare, overtime
Remote / Hybrid / Flexible Work Options Available
Frequent interaction with developers, test automation engineers, QA, management, and members of other Verisk subsidiaries
Some days we just leave the office and have fun team building activities!
Regular team lunches!
State of the art facility with basketball, volleyball, and gym
Ping pong, foosball, fruit bowls, snacks
Fun and energetic teams
Time for innovation, Hack-A-Thons, and learning
Qualifications
Educational Background: bachelor’s degree in computer science, Data Engineering, or a related field.
Experience: 3 years of experience as a Data Engineer or in a similar role.
Technical Proficiency
Programming Languages: Proficiency in Python, SQL, and familiarity with languages such as C# or Java.
Data Processing: Experience with ETL tools and frameworks (e.g., Apache Airflow, Luigi, DBT).
Big Data Technologies: Hands-on experience with big data technologies such as Hadoop, Spark, and Kafka.
Database Management: Strong knowledge of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
Cloud Platforms: Experience with cloud services (e.g., AWS, Google Cloud, Azure) and their data processing tools (e.g., AWS Glue, Google BigQuery).
AI: Familiarity and enthusiasm for bleeding-edge analytical enablement using tools such as Large Language Models and Prompt Engineering.
Data Warehousing: Knowledge of data warehousing concepts and solutions (e.g., Redshift, Snowflake).
Version Control: Proficient with version control systems (e.g., Git).
Machine Learning: Understanding of machine learning concepts and experience working with data for ML model training.
About Us
For over 50 years, Verisk has been the leading data analytics and technology partner to the global insurance industry by delivering value to our clients through expertise and scale. We empower communities and businesses to make better decisions on risk, faster.
At Verisk, you'll have the chance to use your voice and build a rewarding career that's as unique as you are, with work flexibility and the support, coaching, and training you need to succeed.
For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work® for outstanding workplace culture in the US, fourth consecutive year in the UK, Spain, and India, and second consecutive year in Poland. We value learning, caring and results and make inclusivity and diversity a top priority. In addition to our Great Place to Work® Certification, we’ve been recognized by The Wall Street Journal as one of the Best-Managed Companies and by Forbes as a World’s Best Employer and Best Employer for Women, testaments to the value we place on workplace culture.
We’re 7,000 people strong. We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.
Verisk Businesses
Underwriting Solutions — provides underwriting and rating solutions for auto and property, general liability, and excess and surplus to assess and price risk with speed and precision
Claims Solutions — supports end-to-end claims handling with analytic and automation tools that streamline workflow, improve claims management, and support better customer experiences
Property Estimating Solutions — offers property estimation software and tools for professionals in estimating all phases of building and repair to make day-to-day workflows the most efficient
Extreme Event Solutions — provides risk modeling solutions to help individuals, businesses, and society become more resilient to extreme events.
Specialty Business Solutions — provides an integrated suite of software for full end-to-end management of insurance and reinsurance business, helping companies manage their businesses through efficiency, flexibility, and data governance
Marketing Solutions — delivers data and insights to improve the reach, timing,relevance, and compliance of every consumer engagement
Life Insurance Solutions - offers end-to-end, data insight-driven core capabilities for carriers, distribution, and direct customers across the entire policy lifecycle of life and annuities for both individual and group.
Verisk Maplecroft — provides intelligence on sustainability, resilience, and ESG, helping people, business, and societies become stronger
Verisk Analytics is an equal opportunity employer.
Verisk invests in a benefits package for all employees that includes the following: Health Insurance, a Retirement Plan, Disability benefits, and a Paid Time Off program. We offer a competitive total rewards package that includes base salary determined based on role, experience, skill set, and location.
All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability. Verisk’s minimum hiring age is 18 except in countries with a higher age limit subject to applicable law.
Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.
Salary : $100,000 - $140,000
Lead Healthcare Claims Data Analyst
Collective Health -
Lehi, UT
Online Data Analyst - Fully Remote Position
TELUS Digital AI Data Solutions -
Lehi, UT
Senior Manager, Software Engineering | Development Team Lead
Verisk -
Lehi, UT