What are the responsibilities and job description for the Data Engineer with LLM - Remote position at Pro Integrate?
Hi,
Hope you are doing good !!!
Senior Data Engineer with LLM
Location: Remote USA
Job Description
Support real-time streaming and batch data processing use cases
Hope you are doing good !!!
Senior Data Engineer with LLM
Location: Remote USA
Job Description
Support real-time streaming and batch data processing use cases
- Ensure data security, privacy, and compliance with enterprise standards Architect, build, and maintain large-scale data ingestion and transformation pipelines
- Develop and optimize ETL/ELT workflows to ensure reliable and high-performance data processing
- Design and manage data storage systems using cloud-based architectures (Azure preferred)
- Implement data governance, data quality frameworks, and monitoring solutions
- Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions
- Develop reusable data engineering components, tools, and processes
- Bachelor's or higher degree in engineering, computer science, or equivalent field
- 7 years data pipelines and platform development experience
- Experience of Azure technologies (Azure Data Factory, Azure Data Lake, Azure Synapse, etc) are required.
- Experience with Azure SQL, Kusto, Azure storage accounts
- Proficiency with Python is required, and with C# is highly desired
- Understand data security best practice, and able to establish development process to achieve data security.
- Ability to drive technical investigations, 3rd party solution evaluation, and prototyping in a fast-paced startup-like environment.
- Strong sense of curiosity and a willingness to learn, share, and improve.
- Team player with excellent cross-group collaboration skills