What are the responsibilities and job description for the Data Engineer position at Systech Corp, Inc.?
Data Engineer
We are looking for an experienced Data Engineer with 8 years of experience in designing, developing, and maintaining scalable data solutions.
Responsibilities
- Design and develop data pipelines to process large volumes of data efficiently.
- Implement ETL/ELT processes to transform raw data into usable formats.
- Work closely with data scientists and analysts to understand their data requirements.
- Optimize data storage and retrieval processes for performance and scalability.
- Collaborate with cross-functional teams to integrate data solutions into business applications.
- Monitor data pipelines and troubleshoot issues to ensure data quality and reliability.
- Stay updated on emerging trends and technologies in the data engineering field.
Requirements
Required Skills
- 8 years of experience in Data Engineering.
- Strong experience with Python and SQL.
- Hands-on experience with ETL/ELT pipelines and data integration.
- Experience with Apache Spark, PySpark, and Hadoop.
- Strong knowledge of data warehousing and data modeling.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Experience with databases such as Snowflake, Redshift, BigQuery, or Databricks.
- Knowledge of Airflow or other workflow orchestration tools.
- Experience with Git and CI/CD.
- Strong problem-solving and communication skills.