Agentic AI Engineer/LLMOps

Job Title: Agentic AI Engineer/LLMOps

Duration: 6 Months (Temp to Hire)

Location: Newark, NJ (Hybrid)

We are looking for an Agentic AI Developer to join our growing Agentic AI Platform team. This role will focus on developing, integrating, and managing enterprise-scale AI and MCP (Model Context Protocol) systems including Kong AI Gateway, AWS Bedrock, Azure AI Foundry, and Agentcore. The ideal candidate is hands-on, comfortable with platform engineering, and passionate about shaping the future of enterprise AI enablement.

Key Responsibilities:

• AI Gateway Management:

• Install, configure, and maintain Kong AI Gateway and related plugins (e.g., PII sanitation, observability, routing).

• Implement secure and scalable patterns for MCP server onboarding and routing.

• Agentic Platform Enablement:

• Develop and maintain enterprise agentic AI patterns for consistent and governed agent development.

• Integrate and evaluate platforms such as AWS Bedrock, Agentcore, and Azure AI Foundry for agent lifecycle management.

• Business Partnering:

• Collaborate with business units to design, develop, and deploy intelligent agents aligned with enterprise use cases.

• Create intake workflows and forms (e.g., via ServiceNow) to standardize request and approval processes for new agents or AI capabilities.

• Governance & Standards:

• Work with security and cloud teams to implement guardrails, logging standards, and LLM usage policies.

• Contribute to the development of Agentic AI engineering specifications and best practices.

• Continuous Improvement:

• Participate in platform assessments, proof-of-concepts, and production rollouts.

• Optimize cost, performance, and reliability across AI workloads.

Required Skills & Experience:

• 4 years of experience in AI platform engineering, DevOps, or backend development.

• Hands-on experience with Kong Gateway or equivalent API/AI gateway technologies.

• Experience integrating with AWS Bedrock, Azure AI Foundry, Anthropic Claude, or Agentcore.

• Strong knowledge of Python, Node.js, or similar languages for automation and plugin development.

• Familiarity with ServiceNow, REST APIs, OAuth2/OpenID, and observability tooling

• Understanding of LLM operations, governance, and security in enterprise settings.

• Excellent collaboration skills and ability to communicate with cross-functional teams (cloud, security, business).

• Python development and API development experience

Preferred Qualifications:

• Prior experience with agentic frameworks or MCP server development.

• Knowledge of AI observability, model routing, or enterprise cost optimization.

• Contributions to AI governance, compliance, or ISO-standard development efforts.