fix: BM25 score normalization - use Math.abs instead of Math.max (#76)

BM25 scores in SQLite FTS5 are negative (lower = better match).
The previous code used Math.max(0, score) which clamped all negative
scores to 0, resulting in all results showing 100% (score = 1.0).

Fix: Use Math.abs(score) to properly convert negative BM25 scores
to positive values for the normalization formula.

Before: All results show Score: 100%
After:  Scores vary based on actual BM25 relevance (e.g., 16%, 5%, 6%)

Fixes #74
This commit is contained in:
David Gil 2026-02-01 22:38:52 +01:00 committed by GitHub
parent 0f87e2429d
commit 47b705409e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -1877,9 +1877,10 @@ export function searchFTS(db: Database, query: string, limit: number = 20, colle
const rows = db.prepare(sql).all(...params) as { filepath: string; display_path: string; title: string; body: string; hash: string; bm25_score: number }[];
return rows.map(row => {
const collectionName = row.filepath.split('//')[1]?.split('/')[0] || "";
// Convert bm25 (lower is better) into a stable (0..1] score where higher is better.
// Convert bm25 (negative, lower is better) into a stable (0..1] score where higher is better.
// BM25 scores in SQLite FTS5 are negative (e.g., -10 is strong, -2 is weak).
// Avoid per-query normalization so "strong signal" heuristics can work.
const score = 1 / (1 + Math.max(0, row.bm25_score));
const score = 1 / (1 + Math.abs(row.bm25_score));
return {
filepath: row.filepath,
displayPath: row.display_path,