What are the responsibilities and job description for the Data Engineer position at Benzinga?
Job Description:
Benzinga is seeking a technical Data Engineer to join our team. In this role, you will be responsible for building out and improving the data platform that collects, stores, and processes our vast amount of web traffic, advertising, financial, and product usage data. Your expertise and collaboration with other members of our team will be crucial in ensuring the integrity, availability, and performance of our data platform, enabling analytics engineers and partners to make data-driven decisions.
Key Responsibilities:
● Build and maintain efficient and reliable ETL software processes that ingest data from various sources into our data platform.
● Ensure data integrity, quality, and security across all data systems and processes.
● Collaborate with stakeholders to understand data needs and deliver solutions that meet business requirements.
● Monitor and troubleshoot data pipeline performance, addressing any issues that arise promptly.
● Innovate and collaborate with fellow Sr Data Engineer to help design, plan out, and improve the new data platform
● Implement best practices for data governance, including metadata management, data cataloging, and data privacy compliance.
● Stay current with emerging technologies and trends in data engineering and apply them to improve our data infrastructure.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, a related field, or equivalent experience.
- 3 years of experience in data engineering, software development, or a related role
- Strong experience with cloud platforms like AWS, GCP, or Azure, and familiarity with data warehousing solutions like Snowflake, Redshift, or BigQuery.
- Knowledge of software design principles, programming best practices, proper code maintenance, and CI/CD pipelines
- Advanced Python skills
- Proficiency in SQL
- Solid understanding of database systems and experience with data modeling and schema design.
Preferred Experience:
- Experience with Distributed Computing i.e. Spark
- Experience with Containerization i.e. Docker
- Exposure to web application, marketing, or advertising data
- Experience in the financial services or media industry.