What are the responsibilities and job description for the Data Engineer position at Rresolveexpert Solutions LLC?
Job Title: Data Engineer
Introduction
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data platforms. The ideal candidate will have strong experience with SQL, Python, cloud technologies, ETL/ELT processes, data warehousing, and distributed data processing.
Responsibilities
- Design, build, and maintain scalable ETL/ELT data pipelines.
- Develop reliable data ingestion and transformation workflows using Python and SQL.
- Build and optimize data warehouses, data lakes, and data marts.
- Work with large datasets using technologies such as Spark, PySpark, or similar distributed processing frameworks.
- Develop data pipelines using cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Implement data quality, validation, monitoring, and error-handling processes.
- Optimize SQL queries, data models, and pipeline performance.
- Integrate data from APIs, databases, SaaS applications, and other structured/unstructured sources.
- Collaborate with Data Scientists, BI Developers, Analysts, Software Engineers, and business stakeholders.
- Implement CI/CD, version control, testing, and deployment best practices for data engineering workflows.
- Ensure data security, governance, privacy, and compliance requirements are followed.
- Troubleshoot data pipeline failures and resolve production issues.
Requirements
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
- 10 years of professional experience in data engineering or a related field.
- Strong proficiency in SQL and Python.
- Experience developing ETL/ELT pipelines and working with data integration tools.
- Experience with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with data warehousing technologies such as Snowflake, BigQuery, Redshift, or Azure Synapse.
- Experience with Apache Spark/PySpark or other distributed processing technologies.
- Familiarity with Git, CI/CD, Docker, and Agile development practices.
- Strong analytical, troubleshooting, and communication skills.
Salary : $100,000 - $120,000