Gabriel Horner
32ca012635
enhance: pretty print + colorize query script by default
2024-05-23 14:58:55 -04:00
Gabriel Horner
670b46f221
fix: validate property values again
...
caused by property pair revert 5d4ae66d86
2024-04-30 12:25:12 -04:00
Gabriel Horner
2f0fc3c18c
fix: large graph creation having blank and incorrect block counts
...
large graph chunking assumed a certain tx order which isn't guaranteed.
There are also some edge cases where blocks could get separated from
each other which are now fixed. Also fixed a bug with validating user
properties and made small enhancement for query script
2024-04-23 09:25:07 -04:00
Gabriel Horner
0853940a34
fix: closed :default values validate correctly
...
and values can be selected from UI. Also tweak query to expand
properties if available
2024-04-16 11:59:04 -04:00
Gabriel Horner
8ec360759a
enhance(dev): humanize option for validation script
...
also fix nil entity query results
2024-04-15 09:36:09 -04:00
Gabriel Horner
8cbc0ac32a
fix: validate property values
2024-04-12 15:27:26 -04:00
Gabriel Horner
4f3b7e7687
fix: ref checks in schema
...
attribute in the wrong schema and db graph only vars had file graph
keys. Also temp fix to avoid crashing ui with props
2024-04-12 12:15:59 -04:00
Gabriel Horner
b2a22498ea
fix: closed validation with new properties
...
Also fix group error reporting incorrectly and improve it by adding
:db/id
2024-04-12 11:32:03 -04:00
Gabriel Horner
354c0c1e42
fix: built-in? helper and most deps tests
...
Also fix validate script's count
2024-04-12 10:04:43 -04:00
Gabriel Horner
cbcff4bae8
fix: schema graph creation for previous properties schema
...
Also add db/id to query script and fix outdated case insensitive
constraint on property db idents
2024-04-11 17:46:49 -04:00
Gabriel Horner
608d627544
fix: add back properties validation
...
and fix closed validation. Also temporarily comment out properties graph parts
that are still invalid
2024-04-04 21:09:28 -04:00
Gabriel Horner
a8a2afbf4a
chore: allow query script to fetch by entity
2024-04-03 09:00:38 -04:00
Gabriel Horner
3d49585078
fix: create properties graph and validate graph script
2024-04-02 13:58:52 -04:00
Gabriel Horner
5d915de2e2
enhance: add more useful counts to validation script
...
helpful for checking a new/imported db graph hasn't regressed
2024-02-26 11:52:46 -05:00
Gabriel Horner
a61ee21e25
enhance: add basic script to test db graph import
...
also tweaked query script to work with db graphs by relative path
2024-02-24 00:42:46 -05:00
Gabriel Horner
f28cf73ef4
enhance: validate db once for an import
...
and notify if there are invalid blocks. Removed validating per tx during
import which speeds up import 5-10% on small graphs and more on larger
graphs. Also print some useful stats in the console
2024-02-19 15:34:58 -05:00
Gabriel Horner
72f5218b39
dev: add tasks for saving and diffing datoms
...
part of LOG-2974
2023-12-19 13:19:10 -05:00
Gabriel Horner
ffa6aaae29
fix: remove unused db.sqlite related fns
...
- remove sqlite-db/close! as its not used and didn't make sense to be
used in other electron ns
- remove sqlite-db/connections atom as its not needed
- remove read-graph as its not necessary
- rename cli.persist-graph as its primary purpose has changed
- update effected scripts
2023-12-13 12:06:24 -05:00
Gabriel Horner
1117ad3cb4
fix lint
...
also comment out print that prevented chaining query results with bb
2023-11-29 10:14:53 -05:00
Gabriel Horner
e5e25bb403
update schema for new hidden page attributes
...
part of LOG-2854. Also update --closed-maps to use library fn
2023-10-26 12:05:12 -04:00
Gabriel Horner
4fd591620b
validate entities that are changed per transact!
...
This should help us catch bugs due to invalid data fairly quickly.
This only runs when in dev?
part of LOG-2818
2023-10-20 16:57:00 -04:00
Gabriel Horner
edaf9b286a
chore: move frontend db namespaces to a dedicated parent ns
...
Moved these namespaces to logseq.db.frontend.* to make their purpose
explicit and make the namespaces easier to maintain
2023-10-16 17:24:51 -04:00
Gabriel Horner
8756600fd7
Add CI job to test creating and validating a db graph
...
also update older actions
2023-10-13 10:53:01 -04:00
Gabriel Horner
82bcd01525
simplify :map declarations in db schema
...
Make :closed opt in rather than required in order for --closed-maps
to work
2023-10-12 10:02:45 -04:00
Gabriel Horner
fe7a46eac9
Move db malli schema into db dep since it's stable
...
Also add a validate-db task. Part of LOG-2739
2023-10-11 08:40:26 -04:00
Gabriel Horner
172ee0ae24
Provide sqlite.cli for reusable sqlite fns
...
Already had to do read-graph 3 times and will soon need to it outside
logseq so worth putting this behind an api ns
2023-08-15 18:08:44 -04:00
Gabriel Horner
3f52860cf1
Fix perf issue with property rules for db graphs
...
Use multiple clauses instead as confirmed by perf test.
Using multiple clauses made rule preparation for d/q more complex
so introduced extract-rules
2023-07-25 17:20:17 -04:00
Gabriel Horner
e9fecfa280
Fix property rules for advanced queries with db graphs
...
and provide a rules var just for db graphs.
Also simplify query-dsl db-graph support as query-dsl/parse-query
doesn't need to know about db graphs for how it's used
2023-07-25 13:53:18 -04:00
Gabriel Horner
671453aadb
Add nbb script to demonstrate datascript querying a sqlite db
...
Also give test vars more appropriate name
2023-07-08 16:20:42 -04:00