What are the responsibilities and job description for the Data Engineer position at Addison Group?
About the Role
We are seeking an experienced Azure Data Engineer with a strong foundation in data science, AI, and machine learning to join our innovative team. In this role, you will design, build, and maintain scalable data solutions on Azure, enabling advanced analytics, artificial intelligence, and machine learning initiatives across the organization. Your expertise in Python, R, data visualization, and cloud technologies will be essential to transform complex datasets into actionable insights.
Key Responsibilities
- Design, develop, and optimize Azure-based data pipelines, data lakes, and data warehouses.
- Build scalable ETL/ELT solutions using Azure Data Factory, Databricks, Synapse Analytics, and related services.
- Collaborate with AI/ML teams to prepare and optimize data for machine learning models and advanced analytics.
- Develop and maintain APIs and data integrations between systems, ensuring secure and efficient data movement.
- Create and manage Azure resources such as Azure SQL Database, Azure Storage, Azure Data Lake, and Azure Functions.
- Implement data governance, security best practices, and monitoring across all data solutions.
- Use Python and R for data manipulation, statistical analysis, and integration with machine learning models.
- Develop intuitive data visualizations and dashboards using Power BI, Azure Data Explorer, or similar tools.
- Work closely with data scientists, engineers, and business stakeholders to understand requirements and deliver robust solutions.
- Continuously evaluate and adopt new technologies to improve data processes and performance.
Qualifications
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field.
- 5 years of professional experience as a Data Science Engineer, Data Engineer, or similar role.
- Strong proficiency in Azure Data Services (e.g., Data Factory, Synapse, Databricks, Azure Storage, Azure SQL, Azure Functions).
- Hands-on experience with AI and Machine Learning technologies, workflows, and model deployment.
- Advanced programming skills in Python and R.
- Proficiency with SQL and experience designing and optimizing complex queries.
- Strong experience in data visualization using Power BI, Tableau, or similar tools.
- Knowledge of data modeling, warehousing concepts, and cloud-based data architectures.
- Familiarity with DevOps practices, CI/CD pipelines, and Infrastructure as Code (e.g., ARM templates, Terraform) is a plus.
- Excellent problem-solving skills, communication, and a collaborative working style.
Preferred Skills
- Microsoft Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect).
- Experience working with large-scale machine learning models and deploying them into production.
- Familiarity with version control systems like Git.
- Background in statistical modeling, predictive analytics, or operational research.
