Document loaders are designed to load document objects. LangChain has hundreds of integrations with various data sources to load data from: Slack, Notion, Google Drive, etc.
IntegrationsYou can find available integrations on the Document loaders integrations page.
InterfaceDocuments loaders implement the BaseLoader interface.
Each DocumentLoader has its own specific parameters, but they can all be invoked in the same way with the .load method or .lazy_load.
Here's a simple example:
from langchain_community.document_loaders.csv_loader import CSVLoader
loader = CSVLoader(
... # <-- Integration specific parameters here
)
data = loader.load()
When working with large datasets, you can use the .lazy_load method:
for document in loader.lazy_load():
print(document)
Please see the following resources for more information:
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4