Software Engineer III

hackajob is collaborating with Verisk to connect them with exceptional professionals for this role.

Description

We are looking for a Software Engineer III who is excited to rethink traditional file processing through an AI-first lens. In this role, you will design and implement modern, intelligent file ingestion and processing pipelines where AI is embedded into decision-making, automation, and observability—unlocking faster, smarter, and more reliable data delivery.

Responsibilities

• Design and build a high performance, scalable and reliable control plane where AI services are first-class components of the file processing pipeline, augmenting validation, transformation, and routing logic using technology such as AWS
• Build solutions that prioritize AI observability, ensuring AI‑driven decisions are explainable, include confidence assessment, are traceable to specific models or configurations, and are supported by fallback paths and human‑in‑the‑loop audit trails
• Own end-to‑end data observability solutions that surface anomalies across freshness, volume, schema, and data distribution
• Design meaningful data profile reports that provide intuitive and business friendly insights into data quality measures to support client stewardship, issue monitoring, alerting, and troubleshooting
• Monitor data processing pipelines to ensure SLAs are met and proactively communicate risks and potential impacts
• Proactively surface and resolve underlying causes of issues to drive sustained improvement and stability of data processing pipelines
• Mentor junior team members in proper application design and security
• Define architecture & help throughout refinement process
• Collaborate across teams for developing or enhancing product features
• Design clear and concise REST service interfaces and APIs with corresponding documentation
• Ensure code quality through comprehensive automated testing and adherence to backend engineering best practices
• Effectively resolve production problems in a timely manner by rapidly organizing and deploying the appropriate resources
• Ensure that secure coding practices are followed throughout the software life cycle
• Experiment with new tools and technologies, build working POCs, conduct knowledge sharing sessions and provide recommendations for product improvement
• Effectively communicate software solution expectations to internal customers, team members and other stakeholders in a timely and clear fashion
• Participates in planning meetings, retrospectives, daily stand ups, and other meetings as part of the software development process
  
  

Qualifications

• Minimum of bachelor’s degree in Computer Science (or related field) from four-year college or university with minimum 3.0 GPA
• Minimum 3 years of experience or similar ability in software development
• Proficient in Python and SQL for backend services and data processing workflows
• Experience consuming RESTful APIs
• Experience working with AWS services including serverless services and containerized deployments
• Experience developing internal or operational user interfaces using a modern web framework (e.g., React)
• Experience with file processing in formats such as CSV, Parquet, and other delimited formats is a plus
• Experience integrating AI services into production workflows is a plus
• Familiarity with Snowflake or other cloud data warehouses is a plus.
• Understanding of schema evolution, data quality checks, and reprocessing strategies
• Working knowledge of software development tools, testing methodologies and Agile processes
• Experience with continuous integration and processes
• Strong teamwork and problem-solving skills
• Ability to effectively present information in one-on-one as well as in large group settings
• Demonstrated ability to learn and adapt to continuously changing technology
• Effectively translate complex customer requirements and recommend solutions
• Excellent written and verbal communication skills with the ability to present complex technical information in a clear and concise manner to a variety of audiences