Commit Graph

29 Commits (bbb454a7d70265dd431fa65c8a42f097972d5065)

Author SHA1 Message Date
Gabriel Horner 32ca012635 enhance: pretty print + colorize query script by default 2024-05-23 14:58:55 -04:00
Gabriel Horner 670b46f221 fix: validate property values again
caused by property pair revert 5d4ae66d86
2024-04-30 12:25:12 -04:00
Gabriel Horner 2f0fc3c18c fix: large graph creation having blank and incorrect block counts
large graph chunking assumed a certain tx order which isn't guaranteed.
There are also some edge cases where blocks could get separated from
each other which are now fixed. Also fixed a bug with validating user
properties and made small enhancement for query script
2024-04-23 09:25:07 -04:00
Gabriel Horner 0853940a34 fix: closed :default values validate correctly
and values can be selected from UI. Also tweak query to expand
properties if available
2024-04-16 11:59:04 -04:00
Gabriel Horner 8ec360759a enhance(dev): humanize option for validation script
also fix nil entity query results
2024-04-15 09:36:09 -04:00
Gabriel Horner 8cbc0ac32a fix: validate property values 2024-04-12 15:27:26 -04:00
Gabriel Horner 4f3b7e7687 fix: ref checks in schema
attribute in the wrong schema and db graph only vars had file graph
keys. Also temp fix to avoid crashing ui with props
2024-04-12 12:15:59 -04:00
Gabriel Horner b2a22498ea fix: closed validation with new properties
Also fix group error reporting incorrectly and improve it by adding
:db/id
2024-04-12 11:32:03 -04:00
Gabriel Horner 354c0c1e42 fix: built-in? helper and most deps tests
Also fix validate script's count
2024-04-12 10:04:43 -04:00
Gabriel Horner cbcff4bae8 fix: schema graph creation for previous properties schema
Also add db/id to query script and fix outdated case insensitive
constraint on property db idents
2024-04-11 17:46:49 -04:00
Gabriel Horner 608d627544 fix: add back properties validation
and fix closed validation. Also temporarily comment out properties graph parts
that are still invalid
2024-04-04 21:09:28 -04:00
Gabriel Horner a8a2afbf4a chore: allow query script to fetch by entity 2024-04-03 09:00:38 -04:00
Gabriel Horner 3d49585078 fix: create properties graph and validate graph script 2024-04-02 13:58:52 -04:00
Gabriel Horner 5d915de2e2 enhance: add more useful counts to validation script
helpful for checking a new/imported db graph hasn't regressed
2024-02-26 11:52:46 -05:00
Gabriel Horner a61ee21e25 enhance: add basic script to test db graph import
also tweaked query script to work with db graphs by relative path
2024-02-24 00:42:46 -05:00
Gabriel Horner f28cf73ef4 enhance: validate db once for an import
and notify if there are invalid blocks. Removed validating per tx during
import which speeds up import 5-10% on small graphs and more on larger
graphs. Also print some useful stats in the console
2024-02-19 15:34:58 -05:00
Gabriel Horner 72f5218b39 dev: add tasks for saving and diffing datoms
part of LOG-2974
2023-12-19 13:19:10 -05:00
Gabriel Horner ffa6aaae29 fix: remove unused db.sqlite related fns
- remove sqlite-db/close! as its not used and didn't make sense to be
  used in other electron ns
- remove sqlite-db/connections atom as its not needed
- remove read-graph as its not necessary
- rename cli.persist-graph as its primary purpose has changed
- update effected scripts
2023-12-13 12:06:24 -05:00
Gabriel Horner 1117ad3cb4 fix lint
also comment out print that prevented chaining query results with bb
2023-11-29 10:14:53 -05:00
Gabriel Horner e5e25bb403 update schema for new hidden page attributes
part of LOG-2854. Also update --closed-maps to use library fn
2023-10-26 12:05:12 -04:00
Gabriel Horner 4fd591620b validate entities that are changed per transact!
This should help us catch bugs due to invalid data fairly quickly.
This only runs when in dev?
part of LOG-2818
2023-10-20 16:57:00 -04:00
Gabriel Horner edaf9b286a chore: move frontend db namespaces to a dedicated parent ns
Moved these namespaces to logseq.db.frontend.* to make their purpose
explicit and make the namespaces easier to maintain
2023-10-16 17:24:51 -04:00
Gabriel Horner 8756600fd7 Add CI job to test creating and validating a db graph
also update older actions
2023-10-13 10:53:01 -04:00
Gabriel Horner 82bcd01525 simplify :map declarations in db schema
Make :closed opt in rather than required in order for --closed-maps
to work
2023-10-12 10:02:45 -04:00
Gabriel Horner fe7a46eac9 Move db malli schema into db dep since it's stable
Also add a validate-db task. Part of LOG-2739
2023-10-11 08:40:26 -04:00
Gabriel Horner 172ee0ae24 Provide sqlite.cli for reusable sqlite fns
Already had to do read-graph 3 times and will soon need to it outside
logseq so worth putting this behind an api ns
2023-08-15 18:08:44 -04:00
Gabriel Horner 3f52860cf1 Fix perf issue with property rules for db graphs
Use multiple clauses instead as confirmed by perf test.
Using multiple clauses made rule preparation for d/q more complex
so introduced extract-rules
2023-07-25 17:20:17 -04:00
Gabriel Horner e9fecfa280 Fix property rules for advanced queries with db graphs
and provide a rules var just for db graphs.
Also simplify query-dsl db-graph support as query-dsl/parse-query
doesn't need to know about db graphs for how it's used
2023-07-25 13:53:18 -04:00
Gabriel Horner 671453aadb Add nbb script to demonstrate datascript querying a sqlite db
Also give test vars more appropriate name
2023-07-08 16:20:42 -04:00