What are the responsibilities and job description for the Junior Data Engineer position at BCforward?
Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship*
Employment TYPE: Contract W2 - NO C2C
Local or Nearby candidates only
Junior Data Engineer
Location: Wilmington, DE
Job Description
We are seeking a Junior Developer with strong experience in big data technologies, cloud platforms, and scalable data pipeline development. The ideal candidate should have hands-on expertise in PySpark, Spark, ETL/Streaming pipelines, and AWS cloud services, along with strong programming skills in Python or Java.
Key Responsibilities
- Develop and maintain ETL and streaming data pipelines using PySpark, Spark, and Java/Python.
- Build and support scalable data processing solutions on AWS cloud platforms.
- Work with Databricks and Airflow for workflow orchestration and data engineering tasks.
- Develop, test, and optimize distributed data processing applications.
- Collaborate with cross-functional teams to support data integration and analytics initiatives.
- Monitor, troubleshoot, and improve performance of existing data pipelines and applications.
- Follow software engineering best practices, CI/CD processes, and Agile methodologies.
Required Skills
- Hands-on experience with PySpark, Java/Spark, and ETL/Streaming pipelines.
- Experience with AWS services including EMR, Lambda, S3, and RDS.
- Experience working with Databricks and Apache Airflow.
- Strong programming skills in Python and/or Java.
- Understanding of distributed systems and big data processing concepts.
Nice to Have
- Experience with Shell scripting and Unix/Linux environments.
- Knowledge of Terraform for infrastructure automation and management.
- Exposure to modern LLM concepts and practical AI/LLM use case development.
Qualifications
- 3 years of software engineering or data engineering experience.
- Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or related technical field.
- Strong analytical, problem-solving, and communication skills.