What are the responsibilities and job description for the Data Engineer position at DVI Technologies, Inc.?
Overview
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure reliable data availability, quality, and performance across the organization.
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL/ELT processes
- Build and optimize data architectures, data lakes, and data warehouses
- Ensure data quality, integrity, and governance across multiple sources
- Collaborate with cross-functional teams to understand data requirements
- Integrate data from various sources including APIs, databases, and third-party systems
- Monitor and troubleshoot data workflows and performance issues
- Implement data security and compliance best practices
- Support real-time and batch data processing systems
- Document data processes, models, and architecture
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, or related field
- 3 years of experience in data engineering or related role
- Strong proficiency in SQL and Python (or similar languages)
- Experience with ETL tools and frameworks
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud
- Knowledge of data warehousing concepts and data modeling
- Experience with big data technologies (e.g., Spark, Hadoop)
- Familiarity with version control systems (e.g., Git)