What are the responsibilities and job description for the Data Engineer position at verticalbridge?
Vertical Bridge is the nation's largest private owner and operator of communications infrastructure and locations, providing build-to-suit and colocation solutions to the wireless industry. Founded in 2014, the company is headquartered in Delray Beach, Florida. In 2020, Vertical Bridge became the first tower company in the world to achieve the CarbonNeutral® company certified status and has been recertified every year since.
Summary:
The Data Engineer works with big data technologies and has a solid understanding of Databricks, Lakehouse architecture, integrating Spark for data processing, and Power BI or Databricks One for data visualization. The ideal candidate will be responsible for developing and maintaining scalable data pipelines and contributing to the design of our enterprise data architecture to support our various applications as well as analytics and business intelligence platforms.
Job Functions:
- Work closely with a team of data engineers, business intelligence developers, and product owners to build scalable and efficient data pipelines, optimize data storage and retrieval processes, and deliver insightful analytics solutions to our stakeholders
- Collaborate with different functional teams to develop, tune, and produce ML models, enabling automated retraining, feature engineering, and monitoring within Databricks MLflow
- Develop and maintain scalable data pipelines to extract, transform, and load data from various sources into our data Lakehouse, focusing on performance optimization and efficiency
- Design and implement data models and schemas to support business intelligence and analytics
- Ensure data quality and integrity through data validation and cleansing processes
- Collaborate with data scientists, analysts, product owners, and business stakeholders to understand data requirements and translate them into technical solutions
- Explore and implement new data technologies and tools to enhance data capabilities
- Troubleshoot data-related issues and provide solutions
These job functions are representative of tasks accomplished by incumbents. The list is not exhaustive; incumbents perform other job-related tasks.
Supervisory Responsibilities:
None
Working Conditions and Physical Demands:
Position will work directly from the corporate office with minimum travel.
Education and Experience:
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field
- Background in Machine Learning, Artificial Intelligence, and Data Science is strongly preferred for this role
- Experience with Azure cloud services, particularly Azure Databricks and related components
- Knowledge of data integration and ETL processes using Apache Spark
- Proficiency in SQL and familiarity with programming languages such as Python or Scala
- Experience with Power BI or similar BI tools for creating reports and dashboards
- Strong analytical and problem-solving skills
- Excellent communication and teamwork abilities
Vertical Bridge is committed to a policy of equal employment and will not discriminate against an applicant or employee. Vertical Bridge is an Equal Employment Opportunity Employer M/F/D/V
