What are the responsibilities and job description for the Data Engineer position at Motion Recruitment?
Job-title: Data Engineer / Data Platform Engineer
Duration: 12 months with higher possibility of extension or conversion to full time
Location: (Hybrid) ISELIN New Jersey United States - (Local W-2 candidates only)
Key Responsibilities
- Build and maintain batch and/or streaming data pipelines
- Develop scalable data transformations using Python and PySpark
- Optimize large-scale data processing leveraging Apache Spark architecture
- Collaborate with business and technical teams to define data models and datasets
- Ingest and process data from multiple sources (transactional, case management, reference data)
- Implement data quality checks and ensure audit readiness
- Contribute to modernization initiatives (legacy to in-house platform migration)
- Document pipelines, workflows, and operational processes
- Work in an Agile environment supporting sprint-based delivery
Required Skills
- 5 years of experience in Data Engineering / ETL / Data Platforms
- Strong hands-on experience with Python, PySpark (Apache Spark), and SQL
- Experience with large-scale data processing and performance tuning
- Solid understanding of data modeling, lineage, and governance
- Experience working in regulated environments
- Strong communication and stakeholder management skills
Nice to Have
- Experience with GCP (Dataproc, BigQuery, GCS)
- Familiarity with Airflow, Kafka, Databricks, Snowflake, or BigQuery
- Experience with CI/CD pipelines and DevOps practices
- Knowledge of data security (PII handling, encryption, access control)
- Background in Financial Crimes (AML, Fraud, KYC, etc.)