What are the responsibilities and job description for the Google Cloud Platform Data Engineer position at Purple Drive Technologies LLC?
Google Cloud Platform Data Engineer: (Direct Applicants Only) - Full-Time
The Senior Staff Data Engineer - API serves as a primary development resource for design, writing code, test, implementation, document functionality, and maintain of NextGen solutions for the Google Cloud Platform Cloud enterprise data initiatives. The role requires working closely with data teams, frequently in a matrixed environment as part of a broader project team. Due to the emerging and fast-evolving nature of Google Cloud Platform technology and practice, the position requires that one stay well-informed of technological advancements and be proficient at putting new innovations into effective practice.
As a Senior Staff Data Engineer, you will collaborate closely with all team members to create a modular, scalable solution that addresses current needs, but will also serve as a foundation for future success. The position will be critical in building the team s API engineering practices in test driven development, continuous integration, and automated deployment and is a hands-on team member who actively coaches the team to solve complex problems.
This role will provide application development for specific business environments. Focus on setting technical direction on groups of applications and similar technologies as well as taking responsibility for technically robust solutions encompassing all business, architecture, and technology constraints.
Work with data engineers, data architects, data scientists, and other internal stakeholders to understand product requirements and then design, build, and monitor data platforms and pipelines that meet today's requirements but can gracefully scale.
Implement automated workflows that lower manual/operational costs, define and uphold SLAs for timely delivery of data, and move the company closer to democratizing data.
Enable a self-service data architecture supporting query exploration, dashboards, data catalog, and rich data discovery.
Promote a collaborative team environment that prioritizes effective communication, team member growth, and success of the team over success of the individual.
Design and create APIs that accelerate the time from idea to insight.
Adheres to and supports API best practices, processes, and standards.
Produce high quality, modular, reusable code that incorporates best practices and serves as an example for less experienced engineers.
Help mentor team members on complex data projects and following the Agile process.
Responsible for building and supporting a Google Cloud Platform based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data.
Analyze requirements, design AI/ML based solutions, and integrate those solutions for customer environments.
A successful candidate will have:
Strong understanding of best practices and standards for Google Cloud Platform Data process design and implementation.
2 years hands-on experience with Google Cloud Platform platform and experience with many of the following components:
o Postman, Dynatraceo Cloud Run, GKE, Cloud Functions
o Bigtable, Cloud SQL, Cloud Spanner
o BigQuery, Cloud Function
o Cloud Run, CI/CD, Cloud Logging
o Vertex AI, NLP, GitHub
4 Years of hands-on experience with many of the following components:
o API Development
o Apigee
o Python FastAPI Framework
o Spark Streaming, Kafka
o SQL, JSON, Avro, Parquet
o Java, Python, or Scala
Certifications (a plus, but not required):
Google Cloud Platform Cloud Professional Data Engineer