What are the responsibilities and job description for the Python Developer position at S3 Connections LLC?
Job Title: Python Developer
Location: New Jersey, Columbus-OH
Experience: 10 Years
Full Time Position
Job Description:
We are seeking a highly skilled Python Developer with hands-on experience in Google Cloud Platform (GCP), ETL, and workflow orchestration using Apache Airflow. The ideal candidate will be responsible for designing, building, and maintaining data pipelines and backend services to support scalable data-driven applications in a cloud environment.
Key Responsibilities:
- Design, develop, and maintain data integration and ETL pipelines using Python, Airflow, and GCP services (BigQuery, Cloud Storage, Pub/Sub, Dataflow, etc.).
- Collaborate with data engineering and analytics teams to ensure data quality, reliability, and performance across all workflows.
- Develop modular and reusable Python applications and APIs to support analytics, automation, and backend operations.
- Implement data transformation and validation logic to ensure clean and consistent data flow across systems.
- Manage and schedule complex workflows using Apache Airflow DAGs for data ingestion, processing, and delivery.
- Optimize pipeline performance, troubleshoot production issues, and implement monitoring and alerting using GCP tools and Airflow.
- Work closely with DevOps and Cloud Engineering teams to deploy and scale applications using CI/CD pipelines.
- Write clean, maintainable, and testable code with adherence to best practices in software development and data engineering.
- Participate in code reviews, design discussions, and Agile ceremonies to ensure high-quality deliverables.
Required Skills & Experience:
- 7 years of professional experience in Python development with focus on data engineering or backend development.
- Strong proficiency with ETL processes, data modeling, and data pipeline design.
- Hands-on experience with GCP services such as BigQuery, Cloud Functions, Cloud Storage, Pub/Sub, and Dataflow.
- Proven expertise in Apache Airflow for workflow orchestration, scheduling, and dependency management.
- Solid understanding of SQL and experience integrating with relational and NoSQL databases.
- Familiarity with CI/CD tools (Git, Jenkins, Cloud Build) and containerization (Docker/Kubernetes) is a plus.
- Knowledge of data APIs, RESTful services, and integration with external systems.
- Strong problem-solving skills, debugging experience, and a focus on performance optimization.