Is there a way to split text using a token encoder? #1304
yidasanqian
started this conversation in
General
Replies: 1 comment
-
Hi, yes, please check https://docs.langchain4j.dev/tutorials/rag#document-splitter and |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
A method similar to LangChain:RecursiveCharacterTextSplitter.from_tiktoken_encoder
Beta Was this translation helpful? Give feedback.
All reactions