fix: BM25 score normalization - use Math.abs instead of Math.max (#76)
BM25 scores in SQLite FTS5 are negative (lower = better match). The previous code used Math.max(0, score) which clamped all negative scores to 0, resulting in all results showing 100% (score = 1.0). Fix: Use Math.abs(score) to properly convert negative BM25 scores to positive values for the normalization formula. Before: All results show Score: 100% After: Scores vary based on actual BM25 relevance (e.g., 16%, 5%, 6%) Fixes #74
This commit is contained in:
parent
0f87e2429d
commit
47b705409e
@ -1877,9 +1877,10 @@ export function searchFTS(db: Database, query: string, limit: number = 20, colle
|
||||
const rows = db.prepare(sql).all(...params) as { filepath: string; display_path: string; title: string; body: string; hash: string; bm25_score: number }[];
|
||||
return rows.map(row => {
|
||||
const collectionName = row.filepath.split('//')[1]?.split('/')[0] || "";
|
||||
// Convert bm25 (lower is better) into a stable (0..1] score where higher is better.
|
||||
// Convert bm25 (negative, lower is better) into a stable (0..1] score where higher is better.
|
||||
// BM25 scores in SQLite FTS5 are negative (e.g., -10 is strong, -2 is weak).
|
||||
// Avoid per-query normalization so "strong signal" heuristics can work.
|
||||
const score = 1 / (1 + Math.max(0, row.bm25_score));
|
||||
const score = 1 / (1 + Math.abs(row.bm25_score));
|
||||
return {
|
||||
filepath: row.filepath,
|
||||
displayPath: row.display_path,
|
||||
|
||||
Loading…
Reference in New Issue
Block a user