What are the responsibilities and job description for the Sr Data Engineer position at Virtual Networx?
Job Role: Sr Data Engineer
Location: Houston, Tx
Skills: Azure Databricks, Azure Data Lake, Python, Power BI & SQL
Job Description
Key Responsibilities
- Design and develop data pipelines using Azure Data Factory, Databricks, and other cloud-native tools.
- Implement ETL processes to ensure efficient data ingestion, transformation, and storage.
- Collaborate with business stakeholders to understand reporting needs and deliver actionable insights.
- Develop and maintain dashboards in Power BI to support decision-making across teams.
- Optimize data workflows for performance, scalability, and reliability.
- Ensure data quality and governance standards are met across all systems.
- Troubleshoot and resolve issues related to data pipelines, integrations, and reporting.
Required Skills & Qualifications
- Hands-on experience with Microsoft Azure (Data Factory, Synapse, Storage, etc.).
- Proficiency in Databricks for big data processing and analytics.
- Strong Python programming skills for data manipulation, automation, and integration.
- Expertise in Power BI for dashboard creation and data visualization.
- Solid understanding of SQL and relational database concepts.
- Experience with data modeling and performance tuning.
- Excellent communication skills to work effectively with technical and non-technical stakeholders.
Preferred Qualifications
- Experience with CI/CD pipelines for data solutions.
- Knowledge of cloud security best practices.
- Background in data warehousing and analytics.