What are the responsibilities and job description for the Big Data Architect position at SGF Global?
Job Title: Big Data Architect
Location: 3 2nd St. Harborside Plaza 10 Jersey City NJ 07302
Pay rate: $75/hr. on w2
Job Description
We are seeking an experienced Senior Engineer with strong programming and cloud platform expertise. The ideal candidate will have hands-on experience across core AWS services, a solid background in Python, PySpark, SQL, and data modeling, along with proficiency in leveraging AI development tools (e.g., GitHub Copilot) to enhance engineering productivity.
Key Responsibilities:
• Write efficient, maintainable code in Python, leveraging frameworks like PySpark for large-scale data processing.
• Investigate and troubleshoot data pipelines, demonstrating a strong understanding of data structures and distributed processing.
• Develop and optimize complex SQL queries; implement data warehousing concepts including Slowly Changing Dimensions (SCD Type 1 & Type 2).
• Design, develop, and deploy scalable, reliable APIs on AWS (ECS).
• Work extensively with core AWS services, including ECS, Lambda, SNS, and DynamoDB.
• Build, test, and deploy applications via CI/CD pipelines to ensure automated delivery.
• Utilize AI-powered developer tools (such as GitHub Copilot) to accelerate delivery and code quality.
• Collaborate with cross-functional teams to troubleshoot and resolve cloud infrastructure and application performance issues.
Required Skills & Qualifications:
• AWS Services: Hands-on experience with AWS ECS, Lambda, SNS, and DynamoDB.
• Programming & Data: Proficient in Python with strong PySpark experience for data pipeline investigation and processing.
• Databases & Modeling: Solid understanding of SQL, data modeling concepts, and SCD (Type 1 & Type 2).
• API & Cloud Deployment: Proven experience building and deploying APIs on AWS / ECS.
• DevOps: Working knowledge of CI/CD processes and pipelines.
• AI Tooling: Experience using AI-assisted coding tools (GitHub Copilot, etc.).
• Strong analytical, debugging, and problem-solving skills.
Who We Are
SGF Global is an integrated talent solutions provider, offering staffing, recruitment, Employer of Record (EOR), nearshore, and consulting services across a wide range of industries in 35 countries. We're a dynamic, people-first organization where fresh ideas are always welcome. Our culture is built on collaboration, innovation, and a genuine passion for helping people grow. At SGF Global, smiles are part of the dress code, and every voice matters.
Are you looking to join an organization where your ideas are valued, your growth is supported, and your work makes a global impact?
Explore opportunities
Grow your career
Be part of something global
Your future starts here.
Salary : $70 - $75