What are the responsibilities and job description for the Python Developer with React position at Government Systems Technologies Inc. (GSTi)?
Python Developer with React
Jersey City, New Jersey, United States
Contract
Primary Skill: AWS Glue,Python,PySpark
Experience : Min 8 years
Job Description :
- We are seeking a python AWS Glue developer responsible for designing, developing, and maintaining scalable data pipelines using AWS Glue and Python.
- The role involves working closely with data engineers, architects, and business stakeholders to ensure data integration, transformation and loading processes within the cloud environment.
- Design, develop and maintain scalable ETL pipelines using AWS glue and python, write PySpark scripts for extraction, transformation and loading, configure glue jobs, crawlers and workflows for automated data processing.
- Cloud Data Engineeing: Work with AWS S3 for data stoareg and management.
- Use AWS IAM for access control and security, Leverage AWS Lambda for serverless orchestration and event driven processing.
- Monitor Glue jon metrics, using AWS cloudwatch, Tune Spark configurations for Optimal performance.Document ETL processses, data flows, and technical decisionsExperience with infrastructure as code (Terraform, CloudFormartion)