Skip to content

fix: remove deprecated Tantivy FTS, fix Redis hset mypy error#8146

Merged
ysolanky merged 1 commit into
mainfrom
worktree-fix-vectordb-ci-failures
May 28, 2026
Merged

fix: remove deprecated Tantivy FTS, fix Redis hset mypy error#8146
ysolanky merged 1 commit into
mainfrom
worktree-fix-vectordb-ci-failures

Conversation

@Mustafa-Esoofally

Copy link
Copy Markdown
Contributor

Summary

Fixes CI failures on main caused by:

  1. LanceDB FTS tests failing - LanceDB v0.32.0 removed Tantivy-based FTS and now uses native FTS. Our code passed use_tantivy=True which now raises ValueError.
  2. Redis mypy error - hset(mapping=metadata) where metadata: Dict[str, Any] was incompatible with stricter redis-py type stubs.

Changes

LanceDB (lance_db.py)

  • Changed use_tantivy default from True to False
  • Removed passing use_tantivy to create_fts_index() calls (lines 618, 644)
  • Removed the tantivy import guard (dead code now)
  • Added deprecation warning when use_tantivy=True is passed

Redis (redisdb.py)

  • Added convert_bytes() call in update_metadata() to match other methods
  • Changed parameter type from Dict[str, Any] to Mapping[str, Any]
  • Added # type: ignore[arg-type] for the redis-py stub incompatibility

Dependencies (pyproject.toml)

  • Removed tantivy from lancedb extras
  • Removed tantivy.* from mypy ignore list

Cookbooks

  • Updated 5 cookbooks to remove tantivy from install instructions

Type of change

  • Bug fix (non-breaking change that fixes an issue)

Checklist

  • ./scripts/format.sh passes
  • ./scripts/validate.sh passes (no new mypy errors introduced)
  • Tests pass locally (test_keyword_search, test_hybrid_search)

LanceDB removed Tantivy-based FTS in v0.32.0 and now uses native FTS.
This caused test_keyword_search and test_hybrid_search to fail with
"Tantivy-based FTS has been removed" error.

Changes:
- LanceDB: default use_tantivy to False, remove passing it to
  create_fts_index(), emit deprecation warning if True passed
- Redis: add convert_bytes() call (like other methods), fix mypy
  arg-type error by using Mapping[str, Any] and type: ignore
- Remove tantivy from lancedb dependencies in pyproject.toml
- Update cookbook install instructions to remove tantivy
@Mustafa-Esoofally Mustafa-Esoofally requested a review from a team as a code owner May 28, 2026 19:04
@ysolanky ysolanky merged commit fc8bad1 into main May 28, 2026
6 checks passed
@ysolanky ysolanky deleted the worktree-fix-vectordb-ci-failures branch May 28, 2026 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants