What are the responsibilities and job description for the AI Security Engineer position at United Software Group Inc?
Job Title: AI Security Engineer
Location: Charlotte, NC
Interview: Video Interview
Description:
We are seeking a Senior Cloud GenAI Governance Engineer to manage enterprise-scale GenAI platform engineering. This role focuses on the critical gateway and security layers, managing the architecture flow from User API requests, through Model Armor, to the inference endpoint, and finally into telemetry and Arize AI. The core of this position is building responsible AI infrastructure and AI runtime governance.
Key Responsibilities
Enterprise AI Security: Act as the primary owner of AI security guardrails. Implement and manage Model Armor to handle prompt filtering, data leakage prevention, request/response inspection, and enterprise-safe inference.
Advanced API Ecosystem Debugging: Manage complex API lifecycle tracing rather than simple API integration. Troubleshoot endpoint bottlenecks, container orchestration failure analysis, and trace the exact origin of 429 errors across ingress, gateway, load balancing, and GPU saturation.
AI Observability & Telemetry: Utilize Arize AI for runtime monitoring, inference tracing, and model behavior analysis.
Traffic & Gateway Operations: Manage distributed inference debugging, token queueing, and upstream/downstream API flows.
Cloud Infrastructure: Maintain GCP/Azure landing zones, Terraform deployments, and Kubernetes clusters to support these governance pipelines.
Required Qualifications
8 years’ experience in API lifecycle tracing, rate limiting, and token throughput management.
8 years hands-on expertise with AI security tools, specifically Model Armor.
Deep understanding of enterprise AI observability platforms, particularly Arize AI.
Strong background in cloud networking (GCP/Azure) and Kubernetes infrastructure.