Package com.redis.vl.utils

Class FullTextQueryHelper

java.lang.Object

com.redis.vl.utils.FullTextQueryHelper

public final class FullTextQueryHelper
extends Object

Shared utility methods for full-text query processing.

Ported from Python: redisvl/utils/full_text_query_helper.py

Provides tokenization, escaping, and stopword loading used by both HybridQuery (native FT.HYBRID) and AggregateHybridQuery (FT.AGGREGATE-based hybrid search).

Since:

0.2.0

Method Summary

Modifier and Type	Method	Description
static Set<String>	loadDefaultStopwords(String language)	Load default stopwords for a given language.
static String	tokenizeAndEscapeQuery(String userQuery, Set<String> stopwords)	Tokenize and escape a user query, removing stopwords.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

loadDefaultStopwords

public static Set<String> loadDefaultStopwords(String language)

Load default stopwords for a given language.

Python uses nltk, we use a simple file-based approach.

Parameters:

language - the language (e.g., "english", "german")

Returns:

set of stopwords

tokenizeAndEscapeQuery

public static String tokenizeAndEscapeQuery(String userQuery,
 Set<String> stopwords)

Tokenize and escape a user query, removing stopwords.

Ported from Python: _tokenize_and_escape_query

Parameters:

userQuery - the user query to tokenize

stopwords - the set of stopwords to filter out

Returns:

tokenized and escaped query string joined by OR (pipe)