What are the responsibilities and job description for the Data Engineer position at ARK Solutions, Inc.?
Title: Senior Data Engineer
Location: Remote
Job Type: Contract
Experience: 8 Years
Job Summary
We are seeking a highly skilled Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions. The ideal candidate will have expertise in data integration, ETL/ELT development, cloud platforms, and big data technologies. You will work closely with Data Scientists, Analysts, and Software Engineers to deliver reliable, high-quality data that powers business intelligence and analytics.
Key Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines.
- Develop and optimize data models, data warehouses, and data lakes.
- Build robust data ingestion frameworks for structured and unstructured data.
- Integrate data from APIs, databases, SaaS platforms, and third-party systems.
- Optimize SQL queries and improve data pipeline performance.
- Implement data quality, validation, governance, and security best practices.
- Collaborate with cross-functional teams to define data requirements.
- Automate workflows using orchestration tools.
- Monitor, troubleshoot, and resolve production data issues.
- Document data architecture, workflows, and engineering standards.
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- 8 years of professional experience as a Data Engineer.
- Strong SQL development and database optimization skills.
- Proficiency in Python, Scala, or Java.
- Experience building ETL/ELT pipelines.
- Hands-on experience with Apache Spark.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Strong understanding of data warehousing and dimensional modeling.
- Experience working with Git and CI/CD pipelines.
Preferred Qualifications
- Experience with Snowflake, Databricks, Redshift, Big Query, or Azure Synapse.
- Knowledge of Apache Airflow, DBT, Kafka, or Fivetran.
- Experience with Docker and Kubernetes.
- Familiarity with Infrastructure as Code (Terraform).
- Exposure to streaming and real-time data processing.
- Experience working in Agile/Scrum environments.