New
Agentic AI Engineer/LLMOps
![]() | |
![]() United States, New Jersey, Newark | |
![]() | |
Job Title: Agentic AI Engineer/LLMOps
Duration: 6+ Months (Temp to Hire) Location: Newark, NJ (Hybrid) We are looking for an Agentic AI Developer to join our growing Agentic AI Platform team. This role will focus on developing, integrating, and managing enterprise-scale AI and MCP (Model Context Protocol) systems including Kong AI Gateway, AWS Bedrock, Azure AI Foundry, and Agentcore. The ideal candidate is hands-on, comfortable with platform engineering, and passionate about shaping the future of enterprise AI enablement. Key Responsibilities: * AI Gateway Management: * Install, configure, and maintain Kong AI Gateway and related plugins (e.g., PII sanitation, observability, routing). * Implement secure and scalable patterns for MCP server onboarding and routing. * Agentic Platform Enablement: * Develop and maintain enterprise agentic AI patterns for consistent and governed agent development. * Integrate and evaluate platforms such as AWS Bedrock, Agentcore, and Azure AI Foundry for agent lifecycle management. * Business Partnering: * Collaborate with business units to design, develop, and deploy intelligent agents aligned with enterprise use cases. * Create intake workflows and forms (e.g., via ServiceNow) to standardize request and approval processes for new agents or AI capabilities. * Governance & Standards: * Work with security and cloud teams to implement guardrails, logging standards, and LLM usage policies. * Contribute to the development of Agentic AI engineering specifications and best practices. * Continuous Improvement: * Participate in platform assessments, proof-of-concepts, and production rollouts. * Optimize cost, performance, and reliability across AI workloads. Required Skills & Experience: * 4+ years of experience in AI platform engineering, DevOps, or backend development. * Hands-on experience with Kong Gateway or equivalent API/AI gateway technologies. * Experience integrating with AWS Bedrock, Azure AI Foundry, Anthropic Claude, or Agentcore. * Strong knowledge of Python, Node.js, or similar languages for automation and plugin development. * Familiarity with ServiceNow, REST APIs, OAuth2/OpenID, and observability tooling * Understanding of LLM operations, governance, and security in enterprise settings. * Excellent collaboration skills and ability to communicate with cross-functional teams (cloud, security, business). * Python development and API development experience Preferred Qualifications: * Prior experience with agentic frameworks or MCP server development. * Knowledge of AI observability, model routing, or enterprise cost optimization. * Contributions to AI governance, compliance, or ISO-standard development efforts. |