What are the responsibilities and job description for the Data Integration Engineer position at XFORIA Inc?
Job Details
Title: Data Integration Engineer
Location: Sunnyvale, CA
Duration: Full Time / Long Term Contract
Job Description:
Design, build, and maintain scalable data pipelines to ingest, transform, and serve data for Generative Engine Optimization workflows
Integrate data from multiple third-party vendors and external sources to support Generative Engine Optimization initiatives
Ensure data quality, schema validation, and consistency across all data sources feeding into Generative Engine Optimization models
Build and maintain API extraction scripts to pull data from internal and external sources relevant to Generative Engine Optimization
Develop reusable API connectors with proper authentication, rate limiting, and error handling
Liaise with business teams to gather requirements, understand Generative Engine Optimization use cases, and translate them into technical solutions
Write Python scripts to automate data extraction, transformation, and loading processes in support of Generative Engine Optimization pipelines
Apply working knowledge of LLMs and prompt engineering to enhance Generative Engine Optimization outcomes
Assist in evaluating and testing LLM outputs and AI-generated responses against Generative Engine Optimization benchmarks and quality metrics
Document all data workflows, pipeline designs, and integration patterns for team knowledge sharing
Essentially data engineer with strong GEO (Generative Engine Optimization) experience