You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The sentence-window approach breaks down documents into smaller chunks (sentences) and indexes them separately.
During retrieval, we retrieve the sentences that are most relevant to the query via similarity search and replace the
sentence with the full surrounding context, using a static sentence-window around the context.
The text was updated successfully, but these errors were encountered:
@davidsbatista Could you please clarify in the issue description and title whether this issue includes adding sentence retrieval to our benchmarks? Or is this issue limited to adding a new feature/component to Haystack? I would expect the latter to keep the issue small.
But then talking with Mathis and Stefano pointing out the issue, I've been working on extending the DocumentSplitter in a way that implementing sentence-window-retrieval becomes easier.
So the idea for this issue for now is just to have the DocumentSplitter provide the functionality as described in #7389 - then latter we can add an implementation to the haystack-evaluation repo.
The sentence-window approach breaks down documents into smaller chunks (sentences) and indexes them separately.
During retrieval, we retrieve the sentences that are most relevant to the query via similarity search and replace the
sentence with the full surrounding context, using a static sentence-window around the context.
The text was updated successfully, but these errors were encountered: