Feat/metada with azure ai search

[fb33]

Issue

#1263

Change

add a mapper of filter to azure ai search filter string base on the default index structure with metadata.

General checklist

• [X ] There are no breaking changes
• [X ] I have added unit and integration tests for my change
• [X ] I have manually run all the unit and integration tests in the module I have added/changed, and they are all green
• I have manually run all the unit and integration tests in the core and main modules, and they are all green

• I have added/updated the documentation
• I have added an example in the examples repo (only for "big" features)
• I have added/updated Spring Boot starter(s) (if applicable)

Checklist for adding new model integration

• I have added my new module in the BOM

Checklist for adding new embedding store integration

• I have added a {NameOfIntegration}EmbeddingStoreIT that extends from either EmbeddingStoreIT or EmbeddingStoreWithFilteringIT
• I have added my new module in the BOM

Checklist for changing existing embedding store integration

• I have manually verified that the {NameOfIntegration}EmbeddingStore works correctly with the data persisted using the latest released version of LangChain4j

[fb33]

Ping @jdubois

[langchain4j]

@fb33 thanks a lot!

Please make sure EmbeddingStoreWithFilteringIT.should_filter_by_metadata and should_filter_by_metadata_not are passing for Azure implementations.

cc @jdubois

[fb33]

@jdubois I've made a few changes to make it possible to create and use specific mapper implementations.
I change AzureAiSearchContentRetrieverIT to extend EmbeddingStoreWithFilteringIT as mention by @langchain4j but I don't run it 😁

[langchain4j]

@fb33 could you run it? :)

[fb33]

I don't have the well configured environment for that... The IT in azure-ai-search module are not managed with TestContainer so I need to have the good env in my Azure subscription.

[jdubois]

@fb33 I've run it, unfortunately I'm getting errors, here's a screenshot

[fb33]

Ok, I'll have a look. Do I need some specific index definition ?
I quickly ran it this morning and all the tests was failed. I didn't have time to look for the root cause.
I create an empty azure ai search resource and the IT from the main branch are Ok, so I'll be able to investigate.

[fb33]

@jdubois It should be ok now.

[jdubois]

@fb33 I'm still getting 2 errors:

DefaultAzureAiSearchFilterMapperTest.map_handlesComplexFilter()

org.opentest4j.AssertionFailedError: 
Expected :(metadata/attributes/any(k: k/key eq 'key1' and k/value eq 'value1') and (metadata/attributes/any(k: k/key eq 'key2' and not search.in(k/value, ('value2, value3'))) or metadata/attributes/any(k: k/key eq 'key3' and k/value gt '100')))
Actual   :(metadata/attributes/any(k: k/key eq 'key1' and k/value eq 'value1') and ((not metadata/attributes/any(k: k/key eq 'key2' and search.in(k/value, ('value2, value3')))) or metadata/attributes/any(k: k/key eq 'key3' and k/value gt '100')))
<Click to see difference>


	at org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
	at org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
	at org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)
	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)
	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:177)
	at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1141)
	at dev.langchain4j.rag.content.retriever.azure.search.DefaultAzureAiSearchFilterMapperTest.map_handlesComplexFilter(DefaultAzureAiSearchFilterMapperTest.java:75)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1597)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1597)

And DefaultAzureAiSearchFilterMapperTest.map_handlesIsNotIn() :

org.opentest4j.AssertionFailedError: 
Expected :metadata/attributes/any(k: k/key eq 'key1' and not search.in(k/value, ('value1, value2')))
Actual   :(not metadata/attributes/any(k: k/key eq 'key1' and search.in(k/value, ('value1, value2'))))
<Click to see difference>


	at org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
	at org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
	at org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)
	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)
	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:177)
	at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1141)
	at dev.langchain4j.rag.content.retriever.azure.search.DefaultAzureAiSearchFilterMapperTest.map_handlesIsNotIn(DefaultAzureAiSearchFilterMapperTest.java:63)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1597)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1597)

[fb33]

Sorry, I was focus on the IT test, I forgot to align my TU... It's done now.

[fb33]

@langchain4j @jdubois, did this PR go to the right way for you ?

[jdubois]

@fb33 yes, I confirm all the tests pass on my side!