What are the responsibilities and job description for the Data Platform Engineer position at Software Guidance & Assistance, Inc. (SGA, Inc.)?
Software Guidance & Assistance, Inc., (SGA), is searching for a Data Platform Engineer for a contract assignment with one of our premier SaaS clients in San Jose, CA.
Responsibilities:
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
Responsibilities:
- Setup and maintain production-scale Databricks environments on public cloud platforms such as Microsoft Azure and AWS
- Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform
- Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services
- Maintain enterprise-scale SQL Server and SSAS environments
- Provide triage and mentorship to the team on various support issues raised by our tenants
- Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting
- Ensure security and privacy compliance, implementing Adobe Security & Compliance solutions to secure data in our data lake
- Explore GenAI technologies to integrate technical improvements and improve user experience
- Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product
- BS or equivalent experience in Computer Science, Computer Engineering, or a similar field
- Cloud Infrastructure Administration and Automation:
- AWS
- Azure
- Proficiency in Storage Technologies:
- ADLS Gen2
- S3
- MongoDB
- Vector Databases
- AI Agent Development and Maintenance:
- Langchain
- Setup and Operation:
- Databricks
- SQL Server & SSAS
- Airflow
- Azure Kubernetes Service or Elastic Kubernetes Service
- Monitoring and Alerting:
- DBX System Tables
- Prometheus
- Splunk
- MLFlow
- Maintenance:
- Linux Servers
- Kubernetes Environment
- Operational Tools:
- Jira
- Service Now
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
Salary : $70 - $80