What are the responsibilities and job description for the Google Cloud Platform Data Engineer position at ICS Global Soft, Inc.?
Job Title: Google Cloud Platform Data Engineer
Location: Dallas, TX or Charlotte, NC (Day 1 Onsite)
In person interview required for the final round
Job Summary:
We are looking for an experienced Google Cloud Platform Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions using Google Cloud Platform (Google Cloud Platform). The ideal candidate should have strong experience in data engineering, SQL, Python, and cloud-based data technologies.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Google Cloud Platform.
- Work with BigQuery, Cloud Dataflow, Cloud Storage, and Dataproc.
- Develop and optimize SQL queries for data processing and analytics.
- Build and maintain ETL/ELT workflows to integrate data from multiple sources.
- Use Python or PySpark for data transformation and processing.
- Ensure data quality, accuracy, security, and reliability.
- Collaborate with data analysts, data scientists, and other engineering teams.
- Monitor and troubleshoot data pipelines to ensure optimal performance.
Required Skills:
- Hands-on experience with Google Cloud Platform (Google Cloud Platform).
- Strong knowledge of BigQuery and SQL.
- Experience with Python or PySpark.
- Knowledge of ETL/ELT processes and data pipeline development.
- Experience with Cloud Storage, Dataflow, or Dataproc.
- Understanding of data warehousing and data modeling concepts.
- Strong problem-solving and communication skills.
Preferred Qualifications:
- Experience with Cloud Composer or Apache Airflow.
- Knowledge of Pub/Sub and real-time data processing.
- Experience with Git and CI/CD pipelines.
- Familiarity with data governance and cloud security best practices.
Education: Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.