Commit Graph

1289 Commits (791192c3de5d35925b4ec9cbcdaf17b79d0d5052)

Author SHA1 Message Date
Gabriel Horner 298c37ffc7 fix: lints + schema key which shouldn't have been removed 2024-05-08 12:31:08 -04:00
Gabriel Horner 22f15a3fb3 fix: validating closed value ents
Also fix closed value membership not being checked from CLI
2024-05-08 11:47:45 -04:00
rcmerci f69094713f enhance: move missionary-util to src/main/frontend/common/ 2024-05-08 21:56:52 +08:00
Andelf da78593eb1 fix(sync): cannot delete some nested files
Close #11278
2024-05-08 16:42:41 +08:00
Gabriel Horner be9237d101 refactor: move rules deps usage into helper fn
Dries up task dependency that was copied in query-dsl
2024-05-07 22:11:27 -04:00
Gabriel Horner 489e7f3422 fix: :default-queries for db graphs
closes LOG-3042. Moved :default-queries to default-config as this allows
for any future fix to automatically update for a user. There's also a
breaking change with this config key from :block/journal? so moving this
to default-config makes the migration easier e.g. just tell users to
remove the config key
2024-05-07 18:03:50 -04:00
Tienson Qin 89afdcdd7b fix: outliner core tests 2024-05-08 01:29:23 +08:00
Tienson Qin 976e5c2f6b fix: generate n keys for fractional index 2024-05-08 00:37:17 +08:00
Tienson Qin 1cb0896e3b refactor: remove [:block/schema :values]
Some changes:
1. use :block/closed-value-property instead to record which property
this value entity belongs to.
2. use :block/content instead of [:block/schema :value].
3. :page and :date have been removed from closed-value-property-types
because there could be a page/date that's a closed value for multiple
properties, we have no idea what's the `:block/order` for a specific
property.
2024-05-07 23:33:04 +08:00
Gabriel Horner ead9f30f1b fix: typing hashtag sets heading
also remove unused var
2024-05-07 10:53:32 -04:00
Tienson Qin 4e32a5042a fix: reset *max-key when loading graph 2024-05-07 21:52:56 +08:00
Tienson Qin 308c3bcd17 fix: reset max key when generate-n-keys-between 2024-05-07 20:07:06 +08:00
Tienson Qin ee0d89ad85 refactor: replace [:block/schema :value] with :property/schema.value 2024-05-07 17:26:56 +08:00
Gabriel Horner 4c3fc530b9 fix: task rule and filter for db graphs
Part of LOG-3042
2024-05-06 16:55:45 -04:00
Gabriel Horner 4059062919 fix: block property rules for new properties structure 2024-05-06 16:40:55 -04:00
Gabriel Horner 0d95786a7f fix: remove unused db attributes from db graph schema
part of LOG-3042
2024-05-06 11:59:32 -04:00
Gabriel Horner 6a83812ae9 fix: typing TODO/DOING/etc shouldn't create marker pages for db graphs 2024-05-06 11:49:56 -04:00
Gabriel Horner 8a8dba6af8 fix: db graphs shouldn't have :block/marker at all
part of LOG-3042
2024-05-06 11:40:54 -04:00
Gabriel Horner 42e00f00d7 fix: typo and add more fix-mes left from :block/order change
/cc @tiensonqin and @RCmerci for tests to fix
2024-05-06 11:26:16 -04:00
Gabriel Horner 110813accd fix: deps and frontend lints 2024-05-06 10:45:40 -04:00
Gabriel Horner fe27ce9807 fix: remove handling file-graph specific marker 2024-05-06 09:39:02 -04:00
Gabriel Horner 719ba8cdbe Merge branch 'feat/db' into refactor/db-properties-schema 2024-05-06 08:38:32 -04:00
charlie acc9122c36 enhance(ui): refactor the cmdk-related components 2024-05-06 17:00:17 +08:00
rcmerci b0673fc850 refactor(rtc): remake async upload-graph 2024-05-05 18:20:00 +08:00
rcmerci 9bd1b41441 refactor(rtc): ws2 support s3-presign-url resp 2024-05-05 14:30:15 +08:00
rcmerci 64cd588c1a refactor(rtc): update debug ui with new-impl 2024-05-04 19:35:35 +08:00
rcmerci 2e67aed55d refactor(rtc): replace origin rtc-start&stop 2024-05-04 11:46:08 +08:00
Gabriel Horner 333490fde6 enhance: create-graph scripts can generate classes via :classes
Any script can pass a :classes config key. schema script no longer needs
to manage db ids or db idents
2024-05-03 16:24:46 -04:00
Tienson Qin 7aa3bd7d84 fix: issues of :default :one property 2024-05-03 09:59:20 +08:00
Gabriel Horner b5a8f96426 fix: publishing hl-type-area for db graphs 2024-05-02 16:15:06 -04:00
Gabriel Horner 5130ced982 fix: public queries for publishing 2024-05-02 15:53:48 -04:00
Gabriel Horner 24c48e7a87 fix: multiple fixes related to lookup-by-name
- only use it for user properties
- don't use create ident fn to lookup names
- fixed get-area-block-asset-url which didn't work for db graphs without
  the frontend
2024-05-02 15:16:03 -04:00
Tienson Qin 457a74343f refactor: no need to create parent && hidden page for :default value 2024-05-03 00:02:55 +08:00
Gabriel Horner 88e38b16f4 fix: more lints including removing dead code 2024-05-02 10:35:44 -04:00
Gabriel Horner 602b236a4c fix: graph-parser lint 2024-05-02 10:23:20 -04:00
Gabriel Horner 1dbdb16765 fix: whiteboard shapes being invalid 2024-05-02 10:01:08 -04:00
Tienson Qin 89edb3af9a fix: can't remove Many values 2024-05-02 18:03:17 +08:00
Tienson Qin d907eb7654 fix: wrong digs for fractional index 2024-05-02 14:34:38 +08:00
charlie a417c43029 Merge branch 'master' into feat/db 2024-05-02 11:29:08 +08:00
Gabriel Horner d4ecc393f0 fix: schema with :block/order changes 2024-05-01 16:47:25 -04:00
Tienson Qin 1ec4796eff refactor: replace :block/left with :block/order
Finally no need to worry about parent-left conflicts and broken chain.
With :block/order, we only need to re-compute new orders for siblings
with same order (it can happens if there're bugs in our code, or
updates from rtc), but it doesn't break UI.

Another huge potential benefit after discussing with Zhiyuan is:
Ee might be able to simplify both RTC and undo/redo, currently, we
need to handle each new op for both of them, with recently
refactorings like properties being db attributes, :block/order
is a string instead of a ref, we can handle most property value
conflicts using last-write-wins, and others (e.g. :block/parent,
property with :default type) specifically.

I haven't fixed the issues of using :block/left in RTC and undo/redo,
because we might change both soon.
2024-05-02 01:12:22 +08:00
Gabriel Horner 27ed8c7f29 enhance: allow user classes to have db idents
This allows imported and eventually user classes to have db idents.
Updated schema example graph which now imports classes as
:schema.class/X. Also fix schema properties which were removed from
the debug file and remove unused property uuids
2024-05-01 12:20:26 -04:00
Gabriel Horner 5c81b61774 fix: file graphs can't load b/c db specific attribute fetched 2024-05-01 09:07:23 -04:00
Gabriel Horner 2540bb3014 fix: type validations
:default doesn't have closed and tweak validation error messages
2024-04-30 14:14:25 -04:00
Gabriel Horner 77914fbcdf fix: db tests and lint 2024-04-30 12:31:12 -04:00
Gabriel Horner 670b46f221 fix: validate property values again
caused by property pair revert 5d4ae66d86
2024-04-30 12:25:12 -04:00
Gabriel Horner efcffd6e19 fix: rules and most db tests
caused by property pair revert 5d4ae66d86
2024-04-30 10:33:33 -04:00
Gabriel Horner a35bc9b0d6 Bump nbb-logseq version for datascript and ordered-map changes 2024-04-30 10:10:11 -04:00
rcmerci 75f69ffb48 refactor(rtc): split core by adding ns remote, client, exception
and re-impl using missionary
2024-04-30 02:08:00 +08:00
charlie e40e39c3aa enhance(ux): better highlights page name for the search result items 2024-04-29 15:56:11 +08:00
Tienson Qin 95eb0e7f4a Merge branch 'feat/db' into refactor/db-properties-schema 2024-04-29 15:55:23 +08:00
Tienson Qin cdf546dce7 convert fractional-index js to cljs 2024-04-29 15:30:35 +08:00
Tienson Qin 723f0a5bab fix: class ordered properties 2024-04-29 12:27:18 +08:00
Tienson Qin 8275449b3c feat: drag && drop block properties 2024-04-29 11:35:11 +08:00
rcmerci 39228f4409 feat(rtc): add timeout(10s) for creating ws-connection 2024-04-29 01:43:01 +08:00
Tienson Qin dda5f2200e wip: add global :block/order for properties 2024-04-29 00:27:41 +08:00
Tienson Qin 6a976ca0e2 Deprecate more db attributes for db graphs 2024-04-28 22:29:47 +08:00
rcmerci e9f5137a86 refactor(rtc): add frontend.worker.rtc.ws2
- backoff reconnect websocket
- auto reconnect closed websocket when sending data
- support timeout when receiving data from websocket
- support cancel
2024-04-28 20:02:00 +08:00
Tienson Qin 5d4ae66d86 revert: remove :block/properties 2024-04-28 19:44:53 +08:00
Tienson Qin d0e2a0991b fix: :string could be entity for closed values 2024-04-28 18:06:50 +08:00
Tienson Qin c4e0bda579 fix: add :string to user faced and disable :default for closed value 2024-04-28 17:48:33 +08:00
Tienson Qin 6272dd112a fix: use :string instead of :default type for built-in property 2024-04-28 17:06:26 +08:00
Tienson Qin 5a8065db88 fix: template not working for file graphs 2024-04-28 15:18:45 +08:00
Tienson Qin b90eb36e83 perf: load datoms instead of pull data when app loads 2024-04-28 09:23:13 +08:00
Gabriel Horner 1b3b3afd32 fix: invalid placeholder for :date and :page 2024-04-26 09:22:46 -04:00
charlie 82a1a18762 refactor(ui): simplify the old shui codes and remove support for the table.v2 2024-04-26 16:47:53 +08:00
Gabriel Horner edca3049c0 chore: remove unused fn 2024-04-25 11:24:08 -04:00
Gabriel Horner 3681ac354b fix: move db-pipeline and datascript-report back to outliner dep
graph-parser is primarily a file graph dep that is maintained separately
from db graphs. We want to move as many namespaces out of it as
possible. Also moved differing count assertions to
their respective tests
2024-04-25 11:22:14 -04:00
Gabriel Horner cb22dca5e0 fix: db tests 2024-04-25 09:39:02 -04:00
Tienson Qin b84ea96160 fix: handle more non-consecutive cases 2024-04-25 20:39:15 +08:00
Tienson Qin 331aa50379 fix: delete blocks might be consecutive but reversed 2024-04-25 20:28:06 +08:00
Tienson Qin d82c7fa2f5 fix: tests 2024-04-25 17:33:37 +08:00
Tienson Qin b55c064305 fix: move :block/path-res calculation to dep graph-parser 2024-04-25 16:50:04 +08:00
Tienson Qin bcd04dba05 fix: file graph issues 2024-04-25 15:57:14 +08:00
Tienson Qin 349542b7b9 fix: add journal to all pages filter 2024-04-25 14:59:14 +08:00
Gabriel Horner 878d69f342 fix: graph parser tests
extract and dependent namespaces require a db now and :block/path-refs
is no longer being handled in this dep
2024-04-24 16:55:24 -04:00
Gabriel Horner c87c077d29 enhance: new classes can be case sensitive 2024-04-24 15:18:20 -04:00
Gabriel Horner 297e408f6f fix: db graphs can use case sensitive properties 2024-04-24 14:25:29 -04:00
Tienson Qin d416687b7b fix: :block/original-name shouldn't be unique
There're at least two use cases for same page original names:
1. multiple clients can create pages with the same title
2. multiple tagged blocks can have the same :block/original-name
2024-04-24 22:49:57 +08:00
Tienson Qin 706f3c76c2 fix: lazy load class and properties 2024-04-24 22:37:10 +08:00
Tienson Qin e01a771d52 fix: add journal type to malli schema 2024-04-24 20:16:23 +08:00
Tienson Qin 96bdda45fb fix: disable :block/type filter for now 2024-04-24 20:14:55 +08:00
Tienson Qin 8d9e6da41e refactor: use :block/type for journal pages instead of :block/journal?
breaking change:
removes :block/journal attribute
2024-04-24 20:12:15 +08:00
Tienson Qin 558606e18d fix: property test 2024-04-24 19:38:51 +08:00
Tienson Qin fef4e896e1 fix: use existing property pair if exists 2024-04-24 19:13:48 +08:00
Tienson Qin 6d7d4497ff fix: loading whiteboard 2024-04-24 18:19:12 +08:00
Tienson Qin 13edd74c2c fix: can't save whiteboard updates 2024-04-24 17:59:01 +08:00
Tienson Qin 0a13e436be fix: loading block property values 2024-04-24 16:53:08 +08:00
Tienson Qin 4cb2ac6a46 fix: load all classes when app starts 2024-04-24 13:37:34 +08:00
Gabriel Horner 2f0fc3c18c fix: large graph creation having blank and incorrect block counts
large graph chunking assumed a certain tx order which isn't guaranteed.
There are also some edge cases where blocks could get separated from
each other which are now fixed. Also fixed a bug with validating user
properties and made small enhancement for query script
2024-04-23 09:25:07 -04:00
Gabriel Horner 2fad540d01 chore: cleanup setting :many property values
and validating them. Setting :many property values was spread
across fns, hard to understand and needlessly validating differently.
Removed type inferring for :many as it's not possible to do this from
the UI
2024-04-22 16:30:53 -04:00
Gabriel Horner 71f01b1115 fix: load user defined closed values
they aren't lazy loaded by the UI
2024-04-22 14:16:04 -04:00
Tienson Qin 912ddd6ca2 Merge branch 'feat/db' into refactor/db-properties-schema 2024-04-22 23:57:57 +08:00
Tienson Qin a15066c862 perf: db reload
Load as less pages && closed values as we can to avoid loading too
much data.

We already know that transacting db attributes is slow, going to
investigate it later.
2024-04-22 23:48:40 +08:00
Gabriel Horner 543677ef32 fix: outliner lint 2024-04-22 11:14:14 -04:00
Gabriel Horner 0bee9b12c0 fix: frontend lints and remove dead code 2024-04-22 11:10:16 -04:00
Gabriel Horner 1b66755876 fix: outliner lint 2024-04-22 10:50:37 -04:00
Gabriel Horner b09031579e fix: remove outdated code which was causing circular deps in db dep 2024-04-22 10:41:00 -04:00
Tienson Qin 4a0736f62b fix: property unit tests 2024-04-22 08:50:51 +08:00
Tienson Qin 5a595b1626 fix: property tests 2024-04-21 15:19:38 +08:00