What are the responsibilities and job description for the Data Engineer position at Datavail?
Job Description
Title: Data Engineer
Location: USA
Exp: 5
7 years of IT experience
Databricks (data engineering, SQL, notebooks, app/backend integration patterns)Enterprise data warehouses and lakehouse platforms (Nice to have Fabric, Snowflake, Synapse, BigQuery - experience)
Deep knowledge of data modeling, data warehousing, and lakehouse patterns
Hands-on experience with at least one modern data platform:
Experience integrating data platforms with applications using APIs, services, or event-driven patterns
Solid understanding of cloud architecture concepts (security, networking, scalability, cost management)
Strong communication skills with the ability to engage both technical and business stakeholders
Experience working in client-facing or consulting environments
About Us
Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.
About the Team
Datavail's Data Management Services:
Datavail's Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. Datavail's team is comprised of not just excellent BI & analytics consultants, but great people as well. Datavail's data intelligence consultants are experienced, knowledgeable and certified in the best in breed BI and analytics software applications and technologies. We ascertain your business objectives, goals and requirements, assess your environment, and recommend the tools which best fit your unique situation. Our proven methodology can help your project succeed, regardless of stage. With the combination of a proven delivery model and top-notch experience ensures that Datavail will remain the Data Management experts on demand you desire. Datavail's flexible and client focused services always add value to your organization.
Title: Data Engineer
Location: USA
Exp: 5
7 years of IT experience
Databricks (data engineering, SQL, notebooks, app/backend integration patterns)Enterprise data warehouses and lakehouse platforms (Nice to have Fabric, Snowflake, Synapse, BigQuery - experience)
Deep knowledge of data modeling, data warehousing, and lakehouse patterns
Hands-on experience with at least one modern data platform:
Experience integrating data platforms with applications using APIs, services, or event-driven patterns
Solid understanding of cloud architecture concepts (security, networking, scalability, cost management)
Strong communication skills with the ability to engage both technical and business stakeholders
Experience working in client-facing or consulting environments
- Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, or related field
- 4 years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting. Or, equivalent experience
- Deep hands on experience with Databricks Lakehouse Platform and Apache Spark
Strong proficiency in PySpark, SQL, Delta Lake, Databricks SQL - Experience implementing Unity Catalog, data governance, and enterprise security controls
- Cloud experience with Azure Databricks, AWS Databricks, or Google Cloud Platform Databricks
- Familiarity with CI/CD, DevOps, and automation for Databricks workloads
- 8-12 years in data engineering or architecture, with 4-5 years delivering Databricks solutions
- Proven experience in client facing consulting roles, including requirements discovery, solution design, and executive communication
About Us
Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.
About the Team
Datavail's Data Management Services:
Datavail's Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. Datavail's team is comprised of not just excellent BI & analytics consultants, but great people as well. Datavail's data intelligence consultants are experienced, knowledgeable and certified in the best in breed BI and analytics software applications and technologies. We ascertain your business objectives, goals and requirements, assess your environment, and recommend the tools which best fit your unique situation. Our proven methodology can help your project succeed, regardless of stage. With the combination of a proven delivery model and top-notch experience ensures that Datavail will remain the Data Management experts on demand you desire. Datavail's flexible and client focused services always add value to your organization.