What are the responsibilities and job description for the AWS Data Engineer position at CoSourcing Partners?
AWS Data Engineer
New Carlisle, Indiana
We are seeking a skilled AWS Data Engineer to join our dynamic team in New Carlisle, Indiana. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines on AWS, ensuring efficient data integration, transformation, and storage solutions. This role requires expertise in cloud-based data engineering, data modeling, and analytics to support business intelligence and data-driven decision-making.
Key Responsibilities:
- Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Redshift, S3, EMR, and Kinesis.
- Implement ETL (Extract, Transform, Load) workflows to ingest structured and unstructured data from multiple sources.
- Optimize data storage and processing for high performance, scalability, and cost efficiency.
- Work closely with data analysts, data scientists, and software engineers to support data-driven applications and business intelligence solutions.
- Develop and maintain data models, schemas, and metadata management for analytical and operational data stores.
- Ensure data quality, security, and governance by implementing best practices in data validation, monitoring, and compliance.
- Automate infrastructure and deployment processes using Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, or CDK.
- Troubleshoot and resolve issues related to data ingestion, transformation, and analytics workflows.
Required Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
- 3 years of experience in data engineering with a focus on AWS cloud services.
- Proficiency in Python, SQL, and Spark for data processing and transformation.
- Experience working with AWS data ecosystem (e.g., Glue, Athena, Redshift, S3, DynamoDB, Kinesis, etc.).
- Hands-on experience with ETL/ELT development and pipeline orchestration tools (e.g., Apache Airflow, AWS Step Functions, or AWS Data Pipeline).
- Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
- Strong understanding of data warehousing, data lakes, and real-time data processing.
- Knowledge of DevOps practices, CI/CD, and containerization (e.g., Docker, Kubernetes).
- Excellent problem-solving skills and ability to work collaboratively in a fast-paced, agile environment.
Preferred Qualifications:
- AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect certification.
- Experience with machine learning model deployment and MLOps.
- Knowledge of NoSQL databases such as DynamoDB or MongoDB.
- Familiarity with data privacy regulations such as GDPR, CCPA, or HIPAA.
If you're passionate about cloud-based data engineering and eager to work with cutting-edge AWS technologies, we’d love to hear from you!
CoSourcing Partners is an equal opportunity employer committed to fostering an inclusive and diverse workplace. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, genetic information, or any other protected status under applicable federal, state, or local laws.
We believe in creating a work environment where all employees feel valued, respected, and empowered to contribute to our success. Accommodations are available upon request for applicants with disabilities throughout the hiring process.
Join us and be part of a team that values diversity, equity, and inclusion.
