Timeline

Not logged in

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

112 check-ins using file kbench/README.md version dac3d7178e

2026-05-15
11:10
Remove BDB from everywhere including documentation except for historical factual references. BDB was a useful part of the original proof of concept, showing that multiple backends were possible. The port was done by Oracle, long-since abandoned, as is BDB. Also started to update the documentation generally. Many things have changed since 2022, and we now have a feeling for which of the many original goals are likely to be most useful. Leaf check-in: 83e970b26e user: danshearer tags: trunk
2026-05-06
08:33
Updated for the many changes to 2026 check-in: a2ac713d02 user: danshearer tags: trunk
2026-05-05
00:24
Update status of the checksum VFS, which is maintained and still has lessons for us check-in: 09245f16bb user: danshearer tags: trunk
00:19
Refine the rowsum argument with respect to what exists already in 2026 check-in: 2e53111960 user: danshearer tags: trunk
00:15
Update database support claims for 2026 check-in: 2b6a0c9245 user: danshearer tags: trunk
2026-05-04
23:46
Tighten up crypto thoughts check-in: 0651665169 user: danshearer tags: trunk
23:40
Tighten up LMDB v1.0 draft plan for comment check-in: 9894a41503 user: danshearer tags: trunk
2026-05-02
09:59
Update mirror comment check-in: 24cca33fed user: danshearer tags: trunk
2026-04-30
17:14
Fix strangeness with LMDB v1.0 numbering in preparation for 1.0 port Document the benchmark SQLite database schema and give examples of useful queries check-in: 5420617f59 user: danshearer tags: trunk
17:05
Plan for and comments about LMDB 1.0 backend, which will be another not-fork recipe and involve page level crypto at the later stages. check-in: dd5e63598d user: danshearer tags: trunk
2026-04-29
16:34
Notes on current status check-in: 1d0c11edf0 user: danshearer tags: trunk
12:33
Summarise work remaining in Lumo as-is in TODO.md Add TODO-CRYPTO.md, which is only about page-level crypto via LMDB which cut a v1.0 branch yesterday Row-level crypto is only addressed in the docs, there is no code or prototype work check-in: fb7b27fd17 user: danshearer tags: trunk
2026-04-27
06:42
Corrected comments in sql coverage for current supported status. There's a lot less broken now, which gives us nice regression tests for the future. check-in: 12288843ad user: danshearer tags: trunk
04:12
Reduced the lower bound for LumoSQL to be SQLite 3.30.0 (August 2020). This needed five small #if SQLITE_VERSION_NUMBER additions not-fork.d/lmdb/files/btree.c and pager.c. Things like the pager filename, and a couple of the Btree transaction API function calls were renamed around 3.34, and a minor change to BtreeMaxPageCount's rootpage type which changed in 3.33 etc. This is probably where the lower bound will stay unless there a user who is stuck on an older version really really wants another backend. check-in: cad2ad9692 user: danshearer tags: trunk
2026-04-26
20:03
Document the limitations of rowsum, which now works for all normal schemas. Later we can make it work for all cases. The fix isn't hard, just requires a care not to break vdbe. check-in: 42b1a0b6ee user: danshearer tags: trunk
19:01
Made rowsum work: * In vdbe: fix OP_Column and OP_Insert_Idx * In vdbeAdd.c: stop returning corruption on non-rowid last column * In sql-coverage, add all the failure conditions found for rowsum (loads - 7 in total, although most were due to a few errors.) check-in: bb02b3969a user: danshearer tags: trunk
12:08
Add rowsum tests check-in: 37835880b0 user: danshearer tags: trunk
2026-04-25
20:18
Fix FTS3 cursor mis-positioning bug: sqlite3BtreeMovetoUnpacked (via either of its two helpers) lied to the caller whenever the search key compared larger than every existing row in the table. Every SQLite optimiser path issuing a "seek just past this key" trusted the cursor's current row, but was actually reading the wrong row whenever the seek key happened to exceed the table's maximum. Added one probe to the coverage suite. LMDB coverage went from 60 pass / 4 expected_fail / 0 unexpected_pass to 64 pass / 1 expected_fail / 0 unexpected_pass (with one more probe in the suite, so 65 → 65 total); no-backend went from 64 pass / 0 expected_fail to 65 pass / 0 expected_fail. check-in: c3a3bac37d user: danshearer tags: trunk
16:47
Added FTS5 to build flags. FTS5 only works for the no-backend builds, but it stops errors on other builds that test for FTS5 existence even though FTS5 errors when exercised. Not quite as obvious as it looked: upstream enables FTS4 by default. sql-coverage now probes for FTS5. check-in: 4d7b976df6 user: danshearer tags: trunk
16:18
Deleting cruft, dead files, an #IF 0, etc. check-in: 0965e5ccff user: danshearer tags: trunk
15:46
LMDB doesn't have a pager so everything here is a no-op. There are 14 functions previously returning unintelligent reponses, all now return the best response I can think of. some of these changes have visible effects: - PRAGMA journal_size_limit=N now round-trips: setting a number then querying reports N back, instead of always 0. - PRAGMA journal_mode=delete|truncate|persist|memory now round-trips and behaves like SQLite. - PRAGMA journal_mode=wal is now silently suppressed (the prior journal mode is preserved). - PRAGMA locking_mode now reports normal check-in: b124ab6be3 user: danshearer tags: trunk
15:09
Tests for SQL we're supporting. The goal is to watch the failures go down to zero. check-in: df9264f7f9 user: danshearer tags: trunk
15:08
ANALYZE on LMDB now writes correct row counts to sqlite_stat1 (was 0 1, now 200 1 for a 200-row table) sqlite_offset() returns distinct values per row instead of always 0. Did this by replacing four LMDB-backend stubs returning bogus values of SQLITE_INTERNAL or 0 where the upstream callers expected real numbers. Specifically: sqlite3BtreeRowCountEst now returns mdb_stat().ms_entries sqlite3BtreeCursorIsValidNN now reports mdb cursor state sqlite3BtreeMaxRecordSize returns 2147483647 upper bound, which I took from the comment in Btree.c: "Everything will still work if this routine always returns 2147483647 (which is the largest record that SQLite can handle)". sqlite3BtreeOffset returns the LMDB data pointer, which I think is probably correct check-in: efc81884ad user: danshearer tags: trunk
14:22
These are SQLite settings that have no LMDB equivalent (LMDB doesn't have a page cache, autovacuum, or a configurable page size in the SQLite sense). Stubs returning SQLITE_INTERNAL is wrong because the call sites in pragma.c, vacuum.c, etc. expect a sensible return. The fix is to return a safe and sometimes meaningful default. This converts 16 stubs to intelligent NO-OPs: SetSpillSize SetMmapLimit SetPagerFlags SetPageSize GetPageSize MaxPageCount SecureDelete GetRequestedReserve SetAutoVacuum GetAutoVacuum Checkpoint IncrVacuum SetVersion ConnectionCount GetReserveNoMutex HeaderSizeBtree check-in: 092d4d9ac5 user: danshearer tags: trunk
14:05
Made SAVEPOINT work on LMDB backend. SQLite's native btree backend rolls back at the page level via the rollback journal. LMDB's rollback unit is a transaction, so we open MDB_txn at SAVEPOINT BEGIN, abort it at ROLLBACK TO, commit it into its parent at RELEASE. SQLite WAL is lower level, so savepoint behaviour is the same whether journalling or WAL. check-in: 1f1c4b73e9 user: danshearer tags: trunk
13:41
Update for new benchmark commands (-average, -compare etc) check-in: 04cd997a03 user: danshearer tags: trunk
13:40
Add -average , -compare , -group-by and the TSV (tab-separated values) format. TSV is native to Unix and generally easier and safer. check-in: 958dfddfa0 user: danshearer tags: trunk
13:37
A partial or stale lock directory can really confuse subsequent runs. Now it removes the lock dir regardless of the nature of the exit. check-in: 7a8332b984 user: danshearer tags: trunk
13:35
CREATE TABLE dropped CHECK clauses with LMDB backend, because the stub for sqlite3BtreeIsReadonly always returned read-only. Invisible except with EXPLAIN INSERT. check-in: 81d5014182 user: danshearer tags: trunk
06:23
if versions_list returns nothing for latest sqlite3, exit with error suggesting not-fork cache is corrupt and SQLITE_FOR_DB=. reject an empty SQLITE_FOR_DB. in the bulld loop, if any build name is empty, abort with an internal-error message including the offending build_list, instead of silently trying to open the lock directory. (Which won't work) check-in: 6529085477 user: danshearer tags: trunk
02:05
Bringing lumosql up to date for 2026 check-in: 13466cbb10 user: danshearer tags: trunk
2024-03-07
17:31
Make "among the most-deployed software", not "the most deployed" check-in: 024abcebc7 user: danshearer tags: trunk
2023-01-11
11:46
Add paper on definitions of Functional Encryption. Predicate Encryption seems to be a subclass of Functional Encryption. check-in: be5579f383 user: danshearer tags: trunk
2023-01-09
14:46
Add a DOI etc check-in: 39a2897050 user: danshearer tags: trunk
13:50
Add paper "Attribute‐based encryption implies identity‐based encryption" check-in: 177c8a57ba user: danshearer tags: trunk
2022-12-22
12:52
Rename README to README.md and start to update for current documentation conventions check-in: fc70d1e0e8 user: danshearer tags: trunk
12:48
Improve description of source tools. Note: this file was an experiment in Fossil-flavoured Markdown, which should be replaced with Github-flavoured Markdown for use with the new documentation toolchain. check-in: 88245ad2a7 user: danshearer tags: trunk
12:41
Start to document R presentation instructions. check-in: 03229234aa user: danshearer tags: trunk
12:36
Make the licensing situation even clearer in response to an enquiry. check-in: ae5938dcb1 user: danshearer tags: trunk
11:50
Add Ruben and Gabby check-in: 9cc1f1ed2c user: danshearer tags: trunk
10:27
Fix typo in README check-in: 025c324cde user: abdur-rahmaanj tags: trunk
10:17
Fix typo in CONTRIBUTING check-in: 6ae23b3ac1 user: abdur-rahmaanj tags: trunk
2022-10-26
12:16
Add Martina Palmucci's thesis: Securing databases using Attribute Based Encryption and Shamir’s Secret Sharing. check-in: cf77c681fe user: danshearer tags: trunk
2022-10-24
19:37
Add reference to supported hardware architectures and operating systems. check-in: b3c54d382c user: danshearer tags: trunk
15:16
Adding a fallback to "uname -m" if nothing else works for CPU detection. Also added a special case to recognise Virtio block devices on an emulated riscv running Linux check-in: f02941290c user: Uilebheist tags: trunk
14:37
Refactor the first part of the README to add two images and remove verbose words. check-in: 374ba9190d user: danshearer tags: trunk
2022-09-06
18:17
Make error message for missing not-fork more useful by pointing at master URL. check-in: 6a0b3966ce user: danshearer tags: trunk
17:52
Reinstate comment that GitHub is a read-only mirror check-in: 1530cc70b7 user: danshearer tags: trunk
2022-08-05
17:09
CHanging the context size in the fragment patch (vdbe-changes.mod) to cope with a larger range of sqlite versions, including the current latest (3.39.2) check-in: f4a08a00ce user: Uilebheist tags: trunk
2022-08-04
11:22
Removing some warnings produced when testing with clang check-in: f80048502d user: Uilebheist tags: trunk
07:25
Small update to hardware-detect for FreeBSD on non-x86 check-in: a8d095c05b user: Uilebheist tags: trunk
2022-08-03
08:27
Adding an option to specify a version of sqlite3 to build and use to update the results databases (default latest, which was the version used before). Also adding an option to pass a mirror directory to not-fork. Updating documentation. check-in: aacad5c1a9 user: Uilebheist tags: trunk
2022-08-02
07:19
Adding recent versions of sqlite3 to the "upstream.lock" file check-in: 881386f1dd user: Uilebheist tags: trunk
2022-07-10
14:28
Minor typo check-in: c8427d4252 user: Uilebheist tags: trunk
2022-07-07
13:48
adding mdbook settings file check-in: f2dc4ac441 user: moonshine tags: trunk
13:46
adding toc preprocessor tag to documentation files check-in: 6cfa464328 user: moonshine tags: trunk
2022-06-24
08:28
Add MongoDB blog post as reference check-in: 85f162cbd5 user: rubdos tags: trunk
07:58
Fix two incorrect paper dates check-in: dbf69b7e07 user: danshearer tags: trunk
07:57
Database/data store internals references check-in: 552050da7f user: danshearer tags: trunk
2022-06-16
14:13
fixed internal links to account for new filenames check-in: 0a7a702eaa user: moonshine tags: trunk
2022-06-14
17:14
renaming the documentation files and moving it all to doc/ check-in: 17993985fb user: moonshine tags: trunk
2022-06-11
23:41
merged the meetbot documentation into CONTRIBUTING.md check-in: 724559ed0a user: moonshine tags: trunk
2022-06-10
16:35
Deleted the generated docs from the current merkle tree. In addition, on the server, shunned half a dozen image files so they are physically removed from the repo. check-in: 5d6c6bb96a user: danshearer tags: trunk
2022-06-03
09:24
added a chapter about the data structure design motivation check-in: ee4bb010f7 user: moonshine tags: trunk
2022-05-16
08:44
Define the LumoSQL timezone as being Brussels local time check-in: 4f5e4447d6 user: danshearer tags: trunk
2022-05-13
12:35
Add dudle for open source and accessible meeting scheduling and polling check-in: 5845074ff5 user: danshearer tags: trunk
2022-05-04
16:48
Regenerated upstream.lock with full commit ID rather than truncated check-in: 0559d60a5c user: Uilebheist tags: trunk
2022-04-19
02:36
This is the first version of the documentation using mdbook, html output is in the book directory, read how.sh for how it's made, I'm ignoring fossil warnings, sorry if I make a mess check-in: 185cc271c1 user: moonshine tags: trunk
01:46
added SUMMARY.md, which determines the layout of mdbook check-in: f84e49f558 user: moonshine tags: trunk
2022-04-18
12:10
Typo fix check-in: dcddde5bd0 user: Uilebheist tags: trunk
2022-04-14
20:50
editing the documentation check-in: a7e4e48d56 user: moonshine tags: trunk
2022-04-13
14:31
Adding some extra information so that not-fork can find locally mirrored sources. Adding "upstream.lock" files containing the list of revisions known at the time of committing. build.tcl will not use them automatically because they require the latest not-fork, but they are there in preparation. check-in: 24305c2754 user: Uilebheist tags: trunk
2022-04-11
08:02
Adding sha-256 checksum for BDB download check-in: 19b27de50a user: Uilebheist tags: trunk
2022-04-09
17:08
benchmark-filter.tcl now recognised "-datasize x,x" as equal to "-datasize x" for compatibility; also "-details" shows some more information check-in: fc56cbc572 user: Uilebheist tags: trunk
2022-04-06
11:58
Add comments by gabby_bch check-in: 8447484636 user: luisdamiano tags: trunk
2022-04-05
20:17
Filled in Bayes' question sheet, improving the questions check-in: f639f979b9 user: danshearer tags: trunk
2022-04-03
09:21
Missing "?" in regexp caused wrong parsing of -datasize in benchmark-filter check-in: 8e57ba6dd6 user: Uilebheist tags: trunk
2022-03-29
07:46
Make -fields and -tests option behave as documented, and clarified the note about specifying multiple files for -import check-in: 19b267dcc2 user: Uilebheist tags: trunk
2022-03-25
20:39
Adding two dream questions for a future time check-in: 1da188fb48 user: Uilebheist tags: trunk
19:45
Add notes on model questions check-in: 0e4991bfa8 user: luisdamiano tags: trunk
17:11
Add missing '@' in curl command. check-in: 335b6b5f99 user: danshearer tags: trunk
15:23
Add SPDX attribution and copyright block to top of cluster scripts check-in: 1d5cd5ad02 user: danshearer tags: trunk
12:26
Double the number of jobs for a given DATASIZE range. All read sizes are now tried against all write sizes. Also improve dry run output. check-in: 697c400942 user: danshearer tags: trunk
12:01
Script to submit jobs to work-loop.sh. Initial version does lots of sanity checks and will loop over a simple DATASIZE progression. check-in: c8dcb7d0e8 user: danshearer tags: trunk
2022-03-24
16:35
Simplify. check-in: 621c25fec0 user: danshearer tags: trunk
2022-03-23
22:06
Update analysis check-in: 43c0fce7f0 user: luisdamiano tags: trunk
19:05
deleting benchmark result databse check-in: 5a008b6181 user: moonshine tags: trunk
18:58
Add mockup page for "Releases and Downloads". This will take some thought because it involves explaining accessibly how the 700+ work products of the LumoSQL project relate to the needs of different groups of people. It is likely this will change a lot. check-in: de6e4c6f4f user: danshearer tags: trunk
18:54
Adding some new columns in the benchmark-filter output; updating docs check-in: 3af40942ee user: Uilebheist tags: trunk
18:13
shiny app check-in: 419b855e11 user: moonshine tags: trunk
2022-03-22
15:56
Remove references to the Lumodoc project. Vita brevis. check-in: 9b4643c430 user: danshearer tags: trunk
15:15
First step to using Pandoc to create a landing page. Updated index.md text. Added Makefile. Changed CSS to be more accessible. check-in: 496c17d370 user: danshearer tags: trunk
13:42
Update for 2022 state of LumoSQL. Remove all references to the documentation project, which is now merged into the main repo. check-in: a36257b64e user: danshearer tags: trunk
13:25
Updating code to make it easier to use alternative test lists (tests only for now, rather than benchmarks). Updated documentation. Added a new set of tests to check the interaction between Lumo metadata and unmodified sqlite check-in: d8a12beeb4 user: Uilebheist tags: trunk
12:24
Initial commit of existing top-level website check-in: df140f7aab user: danshearer tags: trunk
12:23
Add link to license discussion, bump copyright year check-in: 5cfd71c3ab user: danshearer tags: trunk
12:22
Initial commit of existing license website check-in: 5f11692b4e user: danshearer tags: trunk
2022-03-19
19:32
Moving Gabby's refactored docs from the lumodoc project to the lumosql project. BibLaTex references also moved. The lumodoc project will be closed down. check-in: e25fb647f6 user: danshearer tags: trunk
12:07
Adding a note "rotational" or "non-rotational" for Linux devices when the kernel has this information. This helps distinguishing solid state disks when no other information will tell us. check-in: b3fb0cac73 user: Uilebheist tags: trunk
2022-03-18
08:56
Adding timestamps to some of the messages likely to be followed by longer processing check-in: 079d9e4b7e user: Uilebheist tags: trunk
2022-03-17
10:38
Fix link check-in: d387a8ea84 user: danshearer tags: trunk
2022-03-16
20:44
Update notes, add analysis script check-in: 491ccc7260 user: luisdamiano tags: trunk
19:19
Add analysis notes check-in: 72f5e50d73 user: luisdamiano tags: trunk
19:12
Create statistical analysis directory check-in: b0a01567b4 user: danshearer tags: trunk
14:06
Updating docs for the options added in the last 2 commits check-in: 24d30eb75f user: Uilebheist tags: trunk
14:01
Implementing option to delete selected runs ("-delete"), and also adding option to delete selected runs from a different database ("-delete-from DB"), which can be used to delete runs which were added by copying from another database. check-in: 2f76c2261a user: Uilebheist tags: trunk
13:55
Adding a "-normalise" (or "-normalize") to show individual test timings normalised against the total duration, to help comparing results from similar systems but with different overall speed check-in: c491bd90ab user: Uilebheist tags: trunk
2022-03-15
13:41
New option, discard_output, to prevent reading the test/benchmark output into a TCL string. This allows very large datasize values without having TCL try to create a string too big and fail. Default is "Off" i.e. same code as before. check-in: c1678c4bae user: Uilebheist tags: trunk
2022-03-10
16:13
Removing extra "incr tc" which causes only half of the test to display in "-details" mode check-in: 2d92923346 user: Uilebheist tags: trunk
15:44
Deleting empty values before "-add" of a new value, to stop duplicate issues. Fixing wrong docs in the comments at the top of add-missing-comments check-in: 8edc36f300 user: Uilebheist tags: trunk
14:34
Update work loop with hostname, Promotheus, SIGUSR for restarts and more failure recovery. check-in: 018bfeff21 user: rubdos tags: trunk
2022-03-09
20:10
Be clearer about how very early the Lumion spec is check-in: 43894c12fd user: danshearer tags: trunk