What are the responsibilities and job description for the Data Engineer (AWS & Python) position at 1 point system?
Interview Process: 1st Round Video | 2nd Round Face-to-Face (F2F)
Position Overview
We are seeking a highly skilled and communicative Data Engineer to join our team on a hybrid basis in the NY/NJ area. The ideal candidate will have extensive hands-on experience building scalable data pipelines using Python and AWS cloud services. An active AWS Certification and exceptional communication skills (10/10) are required for this role as you will interact regularly with technical and non-technical stakeholders.
Key Responsibilities
- Data Pipeline Development: Design, build, and maintain robust, automated ETL/ELT pipelines using Python and AWS technologies.
- Cloud Architecture: Optimize data ingestion, storage, and processing using AWS services such as S3, Glue, Lambda, Redshift, EMR, or Athena.
- Data Modeling & Optimization: Write complex SQL queries and design scalable data models and data warehouse solutions for downstream analytics.
- Collaboration & Integration: Partner with cross-functional teams, analysts, and software engineers to ensure data accuracy, security, and availability.
- Performance Tuning: Monitor, troubleshoot, and optimize pipeline performance and database queries to handle large datasets efficiently.
Required Qualifications & Skills
- Technical Expertise:
- Proven experience as a Data Engineer building production-grade data pipelines.
- Python: Expert-level scripting and data manipulation skills (Pandas, PySpark, etc.).
- AWS Ecosystem: Hands-on experience with core AWS data services (S3, Glue, Lambda, Redshift, IAM, Athena, CloudWatch).
- SQL & Data Warehousing: Advanced proficiency in SQL and relational/non-relational databases.
- Certifications: Active AWS Certification required (e.g., AWS Certified Data Engineer, AWS Solutions Architect, or Developer Associate).