0
0
mirror of https://github.com/tursodatabase/libsql.git synced 2025-05-22 03:08:19 +00:00

71 Commits

Author SHA1 Message Date
6a5b840195 chore: fix minor style/grammar issues in markdown files 2025-01-23 12:48:15 +01:00
e2de2504b4 Revert "libsql: Wire up xCheckpointSeqCount"
This reverts commit bb7f011f79.
2025-01-23 13:01:39 +02:00
bb7f011f79 libsql: Wire up xCheckpointSeqCount 2024-12-11 10:37:23 +02:00
27b3fc4d4e add anti-hacker test 2024-11-24 18:13:30 +04:00
963256b36c add backward compatibility test for on-disk format of vector index 2024-11-24 18:01:49 +04:00
246667c7fd Merge pull request from tursodatabase/wal-api
libSQL WAL API
2024-11-11 12:00:39 +00:00
69001c546d fix test 2024-10-29 18:15:25 +04:00
61558b2a9e libsql-{sqlite3,ffi}: Add xReadFrameRaw() to the virtual WAL API
This adds a new xReadFrameRaw() function to the virtual WAL API, which
upper layers can use to fetch the full frame, including the page number,
that is useful for appending frames to a WAL.
2024-10-29 13:30:27 +02:00
3ac4aa1689 libsql-{sqlite3,ffi}: Add xFrameCount() to the virtual WAL API 2024-10-29 13:30:27 +02:00
badbbe979f add test for unknown schema name 2024-10-29 15:10:16 +04:00
93bac68cb9 add test for vector search in ATTACHED db 2024-10-29 13:12:43 +04:00
4091efb5b1 accept K parameter as float if there is no loss in the precision after rounding to the integer
- it cah be hard in some cliens (JS for example) to distinguish between INTEGERs and FLOATs - so we always bind FLOATs instead
- this create unnecessary error: "vector index(search): third parameter (k) must be a non-negative integer"
2024-09-29 15:09:47 +04:00
bd3e0d6904 Merge pull request from tursodatabase/vector-search-fix-integrity-check
vector search: fix integrity check
2024-08-23 11:21:53 +00:00
2f15a0e060 Merge pull request from tursodatabase/hide-vector-index-for-sqlite-planner
vector search: hide vector index for sqlite planner
2024-08-23 08:45:12 +00:00
0d8ca0c715 rename BFLOAT16 to FLOATB16 everywhere 2024-08-22 12:59:26 +04:00
74346590f3 implement and integrate bfloat16 2024-08-22 12:32:49 +04:00
c5dbc8c4a1 fix integrity check for vector indices 2024-08-22 12:15:03 +04:00
69bce662bf properly integrate float16 2024-08-22 00:48:30 +04:00
6e67b36c32 add COUNT(*) test with partial index 2024-08-19 20:16:12 +04:00
f2271b04a8 Merge pull request from tursodatabase/vector-search-int8
vector search: int8 support
2024-08-16 09:11:04 +00:00
fd1f5c4dee Merge pull request from tursodatabase/vector-search-full-support-all-column-types
vector search: full support all column types
2024-08-14 16:35:56 +00:00
bd25344573 add tests and refine error messages 2024-08-13 18:08:08 +04:00
34c297451e support float8 neighbors compression 2024-08-13 17:41:11 +04:00
244a34a16f fix bug in cosine distance 2024-08-13 17:21:38 +04:00
8a2a019b1b add implementation of float8 vector type (int8 quantization) 2024-08-13 16:22:40 +04:00
7cafb80b46 use float1bit instead of 1bit everywhere in the code in index settings 2024-08-13 11:24:46 +04:00
30a198e962 refine error messages 2024-08-12 17:36:02 +04:00
e0035d6e17 add more tests 2024-08-12 17:25:29 +04:00
1a704d8ba4 fix test 2024-08-12 17:19:40 +04:00
307139fda9 add conversion tests 2024-08-12 16:15:24 +04:00
4a57f02b78 add simple conversion test 2024-08-12 15:20:52 +04:00
0f4531a10e add support for vector indices over f64 embeddings 2024-08-12 13:45:38 +04:00
c135391f60 fix unstable test 2024-08-12 12:16:52 +04:00
cea87253fb fix DELETE from vector index as there can be no row due to the NULL value of the vector 2024-08-12 11:43:51 +04:00
90007425ba add simple pragma test 2024-08-11 19:08:38 +04:00
8262d238f5 Merge pull request from tursodatabase/vector-search-compression
vector search: neighbors compression (1bit quantization)
2024-08-11 09:41:58 +00:00
8441108e71 allow vector index to be partial 2024-08-08 18:31:38 +04:00
11e6a93264 add simple test 2024-08-08 14:56:42 +04:00
f80444ac45 fix test 2024-08-08 14:50:43 +04:00
76558e8df4 fix behaviour of VACUUM for vector indices to make rowid consistent
between shadow tables and base table
2024-08-06 13:33:23 +04:00
c03c00b77e Merge pull request from penberg/merge-sqlite-3.45.1-new
Merge upstream SQLite 3.45.1
2024-08-01 09:09:15 +00:00
90dbcff1df improve vector index key handling code 2024-07-26 22:51:36 +04:00
9981d607a7 refine errors even more 2024-07-26 18:54:58 +04:00
ad766c429a refine errors for vector search 2024-07-26 18:38:50 +04:00
675cdd4710 rename max_edges to max_neighbors 2024-07-25 19:26:40 +04:00
ea1bb70e80 add simple test which mention all index parameters 2024-07-25 19:26:40 +04:00
9057bcb6cb add more tests for vector feature 2024-07-25 15:49:09 +04:00
9ed72eb5ae Merge upstream SQLite 3.45.1
This merges the version-3.45.1 tag from upstream SQLite git repository
to libSQL with the following conflicts resolved:

Conflicts:
      README.md
      ext/jni/src/org/sqlite/jni/capi/ConfigSqllogCallback.java
      libsql-sqlite3/configure
      libsql-sqlite3/doc/jsonb.md
      libsql-sqlite3/ext/fts5/test/fts5faultH.test
      libsql-sqlite3/ext/fts5/test/fts5origintext.test
      libsql-sqlite3/ext/fts5/test/fts5origintext2.test
      libsql-sqlite3/ext/fts5/test/fts5origintext3.test
      libsql-sqlite3/ext/fts5/test/fts5origintext4.test
      libsql-sqlite3/ext/fts5/test/fts5origintext5.test
      libsql-sqlite3/ext/fts5/test/fts5secure8.test
      libsql-sqlite3/ext/fts5/test/fts5tokenizer2.test
      libsql-sqlite3/ext/fts5/test/fts5trigram2.test
      libsql-sqlite3/ext/jni/src/org/sqlite/jni/annotation/Experimental.java
      libsql-sqlite3/ext/jni/src/org/sqlite/jni/capi/ConfigSqlLogCallback.java
      libsql-sqlite3/ext/jni/src/org/sqlite/jni/capi/ConfigSqllogCallback.java
      libsql-sqlite3/ext/jni/src/org/sqlite/jni/wrapper1/WindowFunction.java
      libsql-sqlite3/ext/wasm/GNUmakefile
      libsql-sqlite3/ext/wasm/batch-runner-sahpool.html
      libsql-sqlite3/ext/wasm/batch-runner-sahpool.js
      libsql-sqlite3/src/pager.c
      libsql-sqlite3/src/shell.c.in
      libsql-sqlite3/src/sqliteInt.h
      libsql-sqlite3/src/wal.c
      libsql-sqlite3/test/fts3integrity.test
      libsql-sqlite3/test/json/jsonb-q1.txt
      libsql-sqlite3/test/json106.test
      libsql-sqlite3/test/json107.test
      libsql-sqlite3/test/jsonb01.test
      libsql-sqlite3/test/mmapcorrupt.test
      libsql-sqlite3/test/releasetest_data.tcl
      libsql-sqlite3/test/shell9.test
      libsql-sqlite3/test/wapp.tcl
      libsql-sqlite3/test/wapptest.tcl
2024-07-25 13:45:06 +03:00
ccc9f58d51 fix dump and vacuum of vector indices ()
* fix dump and vacuum of vector indices

* fix comment a bit

* build bundles

* slightly improve test

* review fixes

* build bundles
2024-07-25 07:26:41 +00:00
5e6afb386d Vector search respect db idx ()
* propagate schema name (iDb) for vector index to support working not only with main DB

* add basic test

* sometimes zDbSName can be null and this is fine

* avoid test from writing files to disk

* build bundles
2024-07-22 18:29:11 +00:00