greatbody
/
logseq
mirror of https://github.com/logseq/logseq
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
logseq/docs/dev-practices.md

5.3 KiB
Raw Blame History

Description

This page describes development practices for this codebase.

Linting

Most of our linters require babashka. Before running them, please install https://github.com/babashka/babashka#installation.

Clojure code

To lint:

clojure -M:clj-kondo --lint src

We lint our Clojure(Script) code with https://github.com/clj-kondo/clj-kondo/. If you need to configure specific linters, see this documentation. Where possible, a global linting configuration is used and namespace specific configuration is avoided.

There are outstanding linting items that are currently ignored to allow linting the rest of the codebase in CI. These outstanding linting items should be addressed at some point:

  • Comments starting with TODO:lint
  • Code marked with #_:clj-kondo/ignore require a good understanding of the context to address as they usually involve something with a side effect or require changing multiple fns up the call stack.

Unused vars

We use https://github.com/borkdude/carve to detect unused vars in our codebase.

To run this linter:

scripts/carve.clj

By default, the script runs in CI mode which prints unused vars if they are found. The script can be run in an interactive mode which prompts for keeping (ignoring) an unused var or removing it. Run this mode with:

scripts/carve.clj '{:interactive true}'

When a var is ignored, it is added to .carve/ignore. Please add a comment for why a var is ignored to help others understand why it's unused.

Large vars

Large vars have a lot of complexity and make it hard for the team to maintain and understand them. To run this linter:

scripts/large_vars.clj

To configure the linter, see its config var.

Datalog linting

We use datascript's datalog to power our modeling and querying layer. Since datalog is concise, it is easy to write something invalid. To avoid typos and other preventable mistakes, we lint our queries and rules. Our queries are linted through clj-kondo and datalog-parser. clj-kondo will error if it detects an invalid query. Our rules are linted through a script that also uses the datalog-parser. To run this linter:

scripts/lint_rules.clj

Nbb compatible

Namespaces have the metadata flag ^:nbb-compatible indicate they are compatible with https://github.com/logseq/nbb-logseq. This compatibility is necessary in order for namespaces to be reused by the frontend and CLIs. To confirm these compatibilities, run:

bb test:load-nbb-compatible-namespaces

Testing

We have unit and end to end tests.

End to End Tests

To run end to end tests

yarn electron-watch
# in another shell
yarn e2e-test # or npx playwright test

Unit Testing

Our unit tests use the shadow-cljs test-runner. To run them:

yarn test

There are a couple different ways to develop with tests:

Focus Tests

Tests can be selectively run on the commandline using our own test runner which provides the same test selection options as cognitect-labs/test runner. For this workflow:

  1. Run clj -M:test watch test in one shell
  2. Focus tests:
  3. Add ^:focus metadata flags to tests e.g. (deftest ^:focus test-name ...).
  4. In another shell, run node static/tests.js -i focus to only run those tests. To run all tests except those tests run node static/tests.js -e focus.
  5. Or focus namespaces: Using the regex option -r, run tests for frontend.util.page-property-test with node static/tests.js -r page-property.

Multiple options can be specified to AND selections. For example, to run all frontend.util.page-property-test tests except for the focused one: node static/tests.js -r page-property -e focus

For help on more options, run node static/tests.js -h.

Autorun Tests

To run tests automatically on file save, run yarn shadow-cljs watch test --config-merge '{:autorun true}'. The test output may appear where shadow-cljs was first invoked e.g. where yarn watch is running. Specific namespace(s) can be auto run with the :ns-regexp option e.g. npx shadow-cljs watch test --config-merge '{:autorun true :ns-regexp "frontend.util.page-property-test"}'.

Logging

For logging, we use https://github.com/lambdaisland/glogi. When in development, be sure to have enabled custom formatters in the desktop app and browser. Without this enabled, most of the log messages aren't readable.

Data validation and generation

We currently use spec for data validation (and generation someday). We may switch to malli if we need to datafy our data models at some point.

Specs should go under src/main/frontend/spec/ and be compatible with clojure and clojurescript. See frontend.spec.storage for an example. By following these conventions, specs should also be usable by babashka. This is helpful as it allows for third party tools to be written with logseq's data model.