langchain/docs/examples/chains/question_answering.ipynb

Question Answering

This notebook walks through how to use LangChain for question answering over a list of documents. It covers three different types of chaings: stuff, map_reduce, and refine. For a more in depth explanation of what these chain types are, see here.

Prepare Data

First we prepare the data. For this example we do similarity search over a vector database, but these documents could be fetched in any manner (the point of this notebook to highlight what to do AFTER you fetch the documents).

In [1]:

from langchain.embeddings.openai import OpenAIEmbeddings
from langchain.text_splitter import CharacterTextSplitter
from langchain.vectorstores.faiss import FAISS
from langchain.docstore.document import Document

In [2]:

with open('../state_of_the_union.txt') as f:
    state_of_the_union = f.read()
text_splitter = CharacterTextSplitter(chunk_size=1000, chunk_overlap=0)
texts = text_splitter.split_text(state_of_the_union)

embeddings = OpenAIEmbeddings()

In [3]:

docsearch = FAISS.from_texts(texts, embeddings)

In [4]:

query = "What did the president say about Justice Breyer"
docs = docsearch.similarity_search(query)

In [5]:

from langchain.chains.question_answering import load_qa_chain
from langchain.llms import OpenAI

The stuff Chain

This sections shows results of using the stuff Chain to do question answering.

In [6]:

chain = load_qa_chain(OpenAI(temperature=0), chain_type="stuff")

In [7]:

docs = [Document(page_content=t) for t in texts[:3]]

In [8]:

query = "What did the president say about Justice Breyer"
chain({"input_documents": docs, "question": query}, return_only_outputs=True)

Out [8]:

{'output_text': ' The president did not mention Justice Breyer.'}

The map_reduce Chain

This sections shows results of using the map_reduce Chain to do question answering.

In [9]:

chain = load_qa_chain(OpenAI(temperature=0), chain_type="map_reduce")

In [10]:

query = "What did the president say about Justice Breyer"
chain({"input_documents": docs, "question": query}, return_only_outputs=True)

Out [10]:

{'output_text': ' The president did not mention Justice Breyer.'}

The refine Chain

This sections shows results of using the refine Chain to do question answering.

In [11]:

chain = load_qa_chain(OpenAI(temperature=0), chain_type="refine")

In [12]:

query = "What did the president say about Justice Breyer"
chain({"input_documents": docs, "question": query}, return_only_outputs=True)

Out [12]:

{'output_text': "\n\nThe president did not mention Justice Breyer in his speech to the European Parliament about building a coalition of freedom-loving nations to confront Putin, unifying European allies, countering Russia's lies with truth, and enforcing powerful economic sanctions."}

In [ ]: