5d915de2e2
enhance: add more useful counts to validation script
...
helpful for checking a new/imported db graph hasn't regressed
2024-02-26 11:52:46 -05:00
a61ee21e25
enhance: add basic script to test db graph import
...
also tweaked query script to work with db graphs by relative path
2024-02-24 00:42:46 -05:00
f28cf73ef4
enhance: validate db once for an import
...
and notify if there are invalid blocks. Removed validating per tx during
import which speeds up import 5-10% on small graphs and more on larger
graphs. Also print some useful stats in the console
2024-02-19 15:34:58 -05:00
72f5218b39
dev: add tasks for saving and diffing datoms
...
part of LOG-2974
2023-12-19 13:19:10 -05:00
ffa6aaae29
fix: remove unused db.sqlite related fns
...
- remove sqlite-db/close! as its not used and didn't make sense to be
used in other electron ns
- remove sqlite-db/connections atom as its not needed
- remove read-graph as its not necessary
- rename cli.persist-graph as its primary purpose has changed
- update effected scripts
2023-12-13 12:06:24 -05:00
1117ad3cb4
fix lint
...
also comment out print that prevented chaining query results with bb
2023-11-29 10:14:53 -05:00
e5e25bb403
update schema for new hidden page attributes
...
part of LOG-2854. Also update --closed-maps to use library fn
2023-10-26 12:05:12 -04:00
4fd591620b
validate entities that are changed per transact!
...
This should help us catch bugs due to invalid data fairly quickly.
This only runs when in dev?
part of LOG-2818
2023-10-20 16:57:00 -04:00
edaf9b286a
chore: move frontend db namespaces to a dedicated parent ns
...
Moved these namespaces to logseq.db.frontend.* to make their purpose
explicit and make the namespaces easier to maintain
2023-10-16 17:24:51 -04:00
8756600fd7
Add CI job to test creating and validating a db graph
...
also update older actions
2023-10-13 10:53:01 -04:00
82bcd01525
simplify :map declarations in db schema
...
Make :closed opt in rather than required in order for --closed-maps
to work
2023-10-12 10:02:45 -04:00
fe7a46eac9
Move db malli schema into db dep since it's stable
...
Also add a validate-db task. Part of LOG-2739
2023-10-11 08:40:26 -04:00
172ee0ae24
Provide sqlite.cli for reusable sqlite fns
...
Already had to do read-graph 3 times and will soon need to it outside
logseq so worth putting this behind an api ns
2023-08-15 18:08:44 -04:00
3f52860cf1
Fix perf issue with property rules for db graphs
...
Use multiple clauses instead as confirmed by perf test.
Using multiple clauses made rule preparation for d/q more complex
so introduced extract-rules
2023-07-25 17:20:17 -04:00
e9fecfa280
Fix property rules for advanced queries with db graphs
...
and provide a rules var just for db graphs.
Also simplify query-dsl db-graph support as query-dsl/parse-query
doesn't need to know about db graphs for how it's used
2023-07-25 13:53:18 -04:00
671453aadb
Add nbb script to demonstrate datascript querying a sqlite db
...
Also give test vars more appropriate name
2023-07-08 16:20:42 -04:00
Gabriel Horner