langchain/docs/modules/agents/examples/serialization.ipynb

Serialization

This notebook goes over how to serialize agents. For this notebook, it is important to understand the distinction we draw between agents and tools. An agent is the LLM powered decision maker that decides which actions to take and in which order. Tools are various instruments (functions) an agent has access to, through which an agent can interact with the outside world. When people generally use agents, they primarily talk about using an agent WITH tools. However, when we talk about serialization of agents, we are talking about the agent by itself. We plan to add support for serializing an agent WITH tools sometime in the future.

Let's start by creating an agent with tools as we normally do:

In [1]:

from langchain.agents import load_tools
from langchain.agents import initialize_agent
from langchain.llms import OpenAI

llm = OpenAI(temperature=0)
tools = load_tools(["serpapi", "llm-math"], llm=llm)
agent = initialize_agent(tools, llm, agent="zero-shot-react-description", verbose=True)

Let's now serialize the agent. To be explicit that we are serializing ONLY the agent, we will call the save_agent method.

In [2]:

agent.save_agent('agent.json')

In [3]:

!cat agent.json

{
    "llm_chain": {
        "memory": null,
        "verbose": false,
        "prompt": {
            "input_variables": [
                "input",
                "agent_scratchpad"
            ],
            "output_parser": null,
            "template": "Answer the following questions as best you can. You have access to the following tools:\n\nSearch: A search engine. Useful for when you need to answer questions about current events. Input should be a search query.\nCalculator: Useful for when you need to answer questions about math.\n\nUse the following format:\n\nQuestion: the input question you must answer\nThought: you should always think about what to do\nAction: the action to take, should be one of [Search, Calculator]\nAction Input: the input to the action\nObservation: the result of the action\n... (this Thought/Action/Action Input/Observation can repeat N times)\nThought: I now know the final answer\nFinal Answer: the final answer to the original input question\n\nBegin!\n\nQuestion: {input}\nThought:{agent_scratchpad}",
            "template_format": "f-string",
            "validate_template": true,
            "_type": "prompt"
        },
        "llm": {
            "model_name": "text-davinci-003",
            "temperature": 0.0,
            "max_tokens": 256,
            "top_p": 1,
            "frequency_penalty": 0,
            "presence_penalty": 0,
            "n": 1,
            "best_of": 1,
            "request_timeout": null,
            "logit_bias": {},
            "_type": "openai"
        },
        "output_key": "text",
        "_type": "llm_chain"
    },
    "allowed_tools": [
        "Search",
        "Calculator"
    ],
    "return_values": [
        "output"
    ],
    "_type": "zero-shot-react-description"
}

We can now load the agent back in

In [4]:

agent = initialize_agent(tools, llm, agent_path="agent.json", verbose=True)

In [ ]: