0 Fork 0

mirror of https://github.com/langchain-ai/langchain.git synced 2026-10-05 09:25:14 +03:00

Files

T

KennyandHarrison Chase 1e8fca5518 Add ConcurrentLoader (#7512 )

Works just like the GenericLoader but concurrently for those who choose
to optimize their workflow.

@rlancemartin @eyurtsev

---------

Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>

2023-07-31 17:56:31 -07:00

1.7 KiB

Raw Blame History

Concurrent Loader

Works just like the GenericLoader but concurrently for those who choose to optimize their workflow.

In [3]:

from langchain.document_loaders import ConcurrentLoader

In [8]:

loader = ConcurrentLoader.from_filesystem('example_data/', glob="**/*.txt")

In [9]:

files = loader.load()

In [12]:

len(files)

Out [12]:

In [ ]:

1.7 KiB Raw Blame History

Concurrent Loader

1.7 KiB

Raw Blame History