BM25 is only as good as your tokens

T1Covered by 1 source · first reported by Databricks / ClickHouse / DuckDB / Supabase / Neon / PlanetScale at 07 Oct, 12:00 UTC

Lakebase Search is the search primitive of the Neon backend. One of the best things about it is that it ranks keyword results with BM25. That said, BM25 can only score the terms it's given.

Sources

• T1BM25 is only as good as your tokensDatabricks / ClickHouse / DuckDB / Supabase / Neon / PlanetScale07 Oct, 12:00