Data Engineer

Overview Guardian is seeking a Data Engineer to join the team responsible for establishing and maintaining an optimized, scalable data pipelines to provide access to high quality, consistent data in an easy and convenient manner to all authorized end users and applications of Guardian and its subsidiaries. As a Data Engineer, you will play a vital role in our data infrastructure and analytics ecosystem. You will work closely with data architects and data scientists to build and maintain data pipelines, transform raw data into actionable insights, and contribute to the development of cutting-edge data solutions. This is an excellent hands-on opportunity to experience the latest technologies and make a significant impact on our data-driven initiatives. The position will integrate new data sources from enterprise sources and external vendors using a variety of ingestion patterns including Structured Query Language (SQL) Ingestion, File, and Application Programming Interfaces (APIs). You will Collaborate with cross-functional teams to understand data requirements and translate them into effective data pipelines. Develop and maintain ETL processes using Python, PySpark, and SQL to extract, transform, and load data from various sources. Utilize Databricks for data processing, analysis, and optimization tasks. Work with Syncsort to enhance data integration and data quality. Assist in data modeling, schema design, and database optimization. Monitor and troubleshoot data pipelines to ensure data accuracy, reliability, and performance. Participate in code reviews, testing, and documentation efforts to maintain high-quality code and data documentation. Stay updated on industry trends and best practices in data engineering. Establish and maintain the quality, supportability, and performance of all processes. Continue to look for innovative and next generation solutions for solving data challenges. Establish real time data pipelines using AWS services like SQS / SNS and OpenSearch. You are: A self-starter, self-motivated team player and have excellent communication skills, enabling you to engage with all levels of stakeholders who is fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. An individual who works closely with IT and business leaders across the enterprise to drive and embed the Enterprise Data Strategy into transformational roadmaps ensuring key principles of Data Governance, Data Management, Data Analytics and Architecture are implemented. You have: 10 Years of IT experience, with 5 years of experience as a Data Architect, data engineer or other data professional Expert Relational database concepts and experience across multiple database technologies (e.g., SQL, NoSQL, Oracle, Hadoop, Postgres) environments. Expert Proficiency in data modelling tools -- preferably Erwin and strong Logical and Physical Data Modelling experience Hands on experience in data engineering desired with extensive knowledge of SQL and PySpark, on Databricks Platform. Hands on experience designing, building, and optimizing data pipelines, architecture for large scale data warehousing projects. Experience with cloud data services such as Redshift, Relational database services (RDS), Snowflake and Databricks. Knowledge of AWS Data services is a big plus Demonstrated expertise with data sourcing, profiling, data mapping and data analysis. Strong SQL, PL/SQL experience and skilled in creating and optimizing queries and data structures. Knowledge of ETL concepts, preferably Informatica or Syncsort Experience with one or more SQL-on-Hadoop technology (HIVE, Presto, Spark SQL) and Hadoop ecosystem. Ability to design cloud and on Prem data solutions and provide guidance across storage, big data platform services, Hadoop ecosystem, vendor SaaS integrations, RDBMS and NoSQL databases is a plus. Excellent written and verbal communication skills and creative problem-solving skills. Ability to adapt to changing business priorities and experience with effectively communicating change across different levels in the organization. Communication Skills: Articulate the vision and goals, both to the team members and other stakeholders. Emotional Intelligence & Empathy: Motivate, inspire, and resolve conflicts with others while building a positive rapport with team members and partners. Collaboration: Collaborate effectively with the Product Manager and your leadership and keep appraised with key updates and planning. Encourage partnership between team members to create a more dynamic and effective work environment. Strong listeners and able to provide constructive feedback. SAFE experience and the ability to work on a cross functional, self-organizing development teams is a plus. Significant experience interfacing with both customers and management across business and IT Work Authorization Requirement: Guardian Life is unable to sponsor employment visas for this position, now or in the future. Applicants must be legally authorized to work in the United States without the need for employer sponsorship. Only U.S. citizens and lawful permanent residents (green card holders) will be considered for employment Location Hybrid- Three Days a week at a Guardian Office in New York NY, Holmdel NJ or Bethlehem PA ONLY local candidates will be considered Up to 10% travel within the NY/NJ/PA location Salary Range: $95,170.00 - $156,355.00 The salary range reflected above is a good faith estimate of base pay for the primary location of the position. The salary for this position ultimately will be determined based on the education, experience, knowledge, and abilities of the successful candidate. In addition to salary, this role may also be eligible for annual, sales, or other incentive compensation. Our Promise At Guardian, you’ll have the support and flexibility to achieve your professional and personal goals. Through skill-building, leadership development and philanthropic opportunities, we provide opportunities to build communities and grow your career, surrounded by diverse colleagues with high ethical standards. Inspire Well-Being As part of Guardian’s Purpose – to inspire well-being – we are committed to offering contemporary, supportive, flexible, and inclusive benefits and resources to our colleagues. Explore our company benefits at www.guardianlife.com/careers/corporate/benefits. Benefits apply to full-time eligible employees. Interns are not eligible for most Company benefits. Equal Employment Opportunity Guardian is an equal opportunity employer. All qualified applicants will be considered for employment without regard to age, race, color, creed, religion, sex, affectional or sexual orientation, national origin, ancestry, marital status, disability, military or veteran status, or any other classification protected by applicable law. Accommodations Guardian is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. Guardian also provides reasonable accommodations to qualified job applicants (and employees) to accommodate the individual's known limitations related to pregnancy, childbirth, or related medical conditions, unless doing so would create an undue hardship. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact applicant_accommodation@glic.com. Current Guardian Colleagues: Please apply through the internal Jobs Hub in Workday. Every day, Guardian helps our 29 million customers realize their dreams through a range of insurance and financial products and services. Our Purpose, to inspire well-being, guides our dedication to the colleagues, consumers, and communities we serve. We know that people count, and we go above and beyond to prepare them for the life they want to live, focusing on their overall well-being — mind, body, and wallet. As one of the largest mutual insurance companies, we put our customers first. Behind every bright future is a GuardianTM. Learn more about Guardian at guardianlife.com.

Salary : $95,170 - $156,355