What are the responsibilities and job description for the Data Engineer position at Horizontal Talent?
Join our dynamic team as a Data Engineer, where you'll be instrumental in transforming unstructured data and building forward-thinking solutions. This role offers a unique chance to innovate with cutting-edge technologies and make a significant impact.
Responsibilities
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $51 - $89 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.
Responsibilities
- Design and construct pipelines to ingest, parse, and convert diverse unstructured data.
- Develop scalable workflows using advanced tools and frameworks for document processing.
- Collaborate with AI engineers to optimize data corpora for AI-driven applications.
- Implement systems for querying financial data using natural language.
- Create and maintain APIs ensuring seamless data and model integration.
- Five or more years of experience in data engineering, with specialized skills in Databricks technologies.
- Expertise in handling unstructured data and creating effective embedding pipelines.
- Proficient in PySpark, Python, and SQL, particularly within Databricks environments.
- Solid knowledge of REST API development and microservices architecture.
- Understanding of data modeling principles and governance practices.
- Experience with Azure integrations enhancing Databricks capabilities.
- Exposure to orchestration frameworks and vector databases.
- Background or familiarity with data in financial or investment banking sectors.
- Certification in data engineering or related fields could be a plus.
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $51 - $89 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.
Salary : $51 - $89