JD:

• Python API development experience
• End to end data pipeline from raw data sources > ingestion of data > ELT/ETL > consumable reporting tables with BigQuery
• Google Cloud Storage
• Cloud Composer
• Nice to have: Looker/Tableau, Cyber Security background
• Design, develop, and deploy scalable data pipelines using Google Cloud Platform tools and services like Cloud Dataflow, Cloud Storage, Pub/Sub, and Cloud Functions.
• Collaborate with stakeholders to understand business requirements and translate them into technical specifications for data pipelines.
• Develop and maintain a comprehensive data architecture that ensures data quality, efficiency, and scalability.
• Conduct thorough analysis of system data to identify trends, diagnose issues, and optimize data pipeline performance.
• Advocate for the use of BigQuery as the central data warehouse solution and champion its capabilities to internal customers.
• Perform customer-facing data analysis, generating insights and reports that inform decision-making.
• Stay up-to-date on the latest advancements in data engineering technologies and best practices.
• Collaborate with cross-functional teams (data analysts, data scientists, and developers) to ensure seamless data integration and analysis.
• Document data pipelines and processes for maintainability and knowledge transfer.
• Master s/bachelor s degree in computer science, business analytics, information technology, statistics, or a related field.
• Minimum 5 years of experience as a Data Engineer or related role.
• Proven experience in designing, building, and deploying data pipelines in the cloud (ideally Google Cloud Platform).
• Strong understanding of data architecture principles and best practices.
• Expertise in SQL and experience with BigQuery.
• Familiarity with data analysis techniques and tools.
• Excellent communication and collaboration skills.
• Ability to translate business requirements into technical specifications.
• Experience working in a customer-facing role is highly desirable.
• Experience with data warehousing concepts is highly desirable.
• Proficiency in scripting languages (Python) is a plus.
• Proficiency in BI tools such as Tableau, Power BI, or equivalent.
• Design, develop, and maintain BI reports, dashboards, and data visualizations using BI tools (e.g., Tableau, Power BI, etc.).
• Google Cloud Platform certification (Professional Data Engineer or equivalent) is a plus.