AgentOps-AI/agentops: Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen
AgentOps-AI provides a Python SDK designed for monitoring AI agents, tracking costs associated with large language models (LLMs), and benchmarking performance. It integrates seamlessly with various LLMs and agent frameworks, making it a valuable resource for developers and researchers in the AI field.