What are the responsibilities and job description for the Senior Data Engineer position at Maveric Systems Limited?
Job Title - Data Engineer
Location- Irving, TX
Job Type- Full Time
Key Responsibilities
- Design and implement scalable ETL/ELT pipelines for large datasets.
- Build and maintain data lakes and data warehouses using AWS services (S3, Glue, Redshift, Athena, EMR).
- Develop and optimize Big Data processing frameworks (e.g., Apache Spark, Hadoop, Hive).
- Integrate streaming data solutions using AWS Kinesis, Kafka, or similar tools.
- Ensure data quality, security, and compliance with organizational and regulatory standards.
- Collaborate with data scientists and analysts to deliver high-quality datasets for analytics and machine learning.
- Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.
Required Skills & Qualifications
- Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.
- 7 years of experience in data engineering or big data roles.
- Strong proficiency in AWS services:
- S3, Glue, Redshift, Athena, EMR, Lambda, Kinesis.
- Hands-on experience with Big Data technologies:
- Apache Spark, Hadoop, Hive, Presto.
- Strong programming skills in Python, Scala,
- Expertise in SQL and data modeling.
- Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation).
- Knowledge of data governance, security, and compliance best practices.