What are the responsibilities and job description for the Data Engineer / Data Architect position at Diligente Technologies?
Data Engineer / Data Architect
đź“Ť Location: Westlake, CA (Hybrid/Onsite)
đź“„ Type: Contract-to-Hire
We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
- Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
- Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
- Support AI/ML initiatives, advanced analytics, and data-driven applications.
- Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
- Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
- Optimize cloud data infrastructure performance, scalability, and cost efficiency.
Required Qualifications
- Bachelor's degree and 5 years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms.
- Strong hands-on experience with Azure Databricks, Azure Data Factory, Azure DevOps, SQL, Python, and PySpark.
- Experience building ETL/ELT pipelines and API-based data integrations.
- Exposure to AI/LLM technologies, including OpenAI APIs and modern AI platforms.
- Ability to design end-to-end data solutions and translate business requirements into scalable architectures.