What are the responsibilities and job description for the AWS– Spark –Python Data Engineer position at Digital Alpha Technologies, Inc.?
Digital Alpha is looking for passionate data engineers to join our team. As an experienced member we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge, attention to detail and expertise to all aspects of the software development lifecycle. We embrace a culture of experimentation and constantly strive for improvement and learning. You’ll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
Requirements
- Strong hands on experience building data pipelines using Apache Spark in AWS.
- Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
- Proficient in python programming language.
- Proficient in PySpark.
- Knowledge of application development lifecycles, & continuous integration/deployment practices
- Experience with development on AWS and cloud native applications
- Kafka and event driven architectures exposure is a plus
- Experience with Developing Data Platforms on AWS
- Proficient in Agile Software Development methodology, processes, and practices.
Qualifications:
- Bachelor’s degree in related field
- Strong, analytical, focused, self-driven with excellent problem-solving skills
- Minimum 2 years of hands on in-depth experience of AWS Data Pipelines development and implementation is required
- AWS Architect Associate or Professional level certifications is a plus