Data Engineer

Job Description:

We are looking for a skilled Data Engineer with strong expertise in SQL and Python to join our team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and ensuring the availability, accuracy, and reliability of data across the organization.

Responsibilities:

• Design, build, and maintain scalable ETL/ELT data pipelines.
• Develop and optimize complex SQL queries for data extraction, transformation, and analysis.
• Write efficient Python scripts to automate data workflows and integrate data sources.
• Work with structured and unstructured datasets from various sources.
• Collaborate with data analysts, data scientists, and business teams to understand data needs.
• Implement best practices for data validation, quality checks, and performance tuning.
• Maintain and improve data infrastructure, including databases and data warehouses.
• Troubleshoot data issues and ensure high data accuracy and availability.
• Participate in code reviews and contribute to process improvements.

Required Skills:

• Strong proficiency in SQL (query writing, optimization, stored procedures).
• Strong hands-on experience with Python for data processing and automation.
• Experience with ETL/ELT tools or frameworks.
• Familiarity with relational databases (e.g., MySQL, PostgreSQL, SQL Server).
• Knowledge of data warehousing concepts.
• Experience working with APIs and integrating multiple data sources.
• Solid understanding of data structures, algorithms, and data modeling.

Preferred Skills (Optional):

• Experience with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Spark, PySpark, or other big data tools.
• Experience with Airflow, DBT, or other orchestration tools.
• Familiarity with version control (Git) and CI/CD pipelines.