joplin.xtdb

Migrate and seed XTDB data.

Install

lein / boot:

[org.pariyatti/joplin.xtdb "0.0.4-SNAPSHOT"]

CLI / deps.edn:

org.pariyatti/joplin.xtdb {:mvn/version "0.0.4-SNAPSHOT"}

Usage - Clojure

You can use the joplin.repl namespace from within Clojure itself. In these examples:

• config is an example Joplin Config (EDN)
• :prod is an example environment
• :xtdb-prod is an example database

(joplin.repl/migrate config :prod)
(joplin.repl/rollback config :prod :xtdb-prod 1)
;; or (joplin.repl/rollback config :prod :xtdb-prod 20151215114952-users)
(joplin.repl/seed config :prod)
(joplin.repl/reset config :prod :xtdb-prod)
(joplin.repl/pending config :prod :xtdb-prod)

Usage - Command Line

You can run a lein alias from the command line if you configure them in your project.clj, like so:

:aliases {"migrate"  ["run" "-m" "joplin.xtdb.alias/migrate"  "joplin/config.edn"]
          "seed"     ["run" "-m" "joplin.xtdb.alias/seed"     "joplin/config.edn"]
          "rollback" ["run" "-m" "joplin.xtdb.alias/rollback" "joplin/config.edn"]
          "reset"    ["run" "-m" "joplin.xtdb.alias/reset"    "joplin/config.edn"]
          "pending"  ["run" "-m" "joplin.xtdb.alias/pending"  "joplin/config.edn"]
          "create"   ["run" "-m" "joplin.xtdb.alias/create"   "joplin/config.edn" "dev" "xtdb-dev"]}

Then you can run Joplin commands from the command line:

lein migrate prod
lein rollback prod xtdb-prod 1
# or lein rollback prod xtdb-prod 20151215114952-users
lein seed prod
lein reset prod xtdb-prod
lein pending prod xtdb-prod

NOTE: You must refer to the joplin.xtdb.alias shim in your aliases, unlike the default alias configuration seen in the joplin.core example.. Because joplin.xtdb is a plugin, joplin.alias doesn't know about it out of the box. This is arguably a bug in Joplin.

Generate Migrations

(joplin.repl/create config :dev :xtdb-dev "add_users_schema")

or

lein create add_users_schema

Additional Documentation

• Using Joplin (including a config example)
• Joplin Example Project
• Joplin Example REPL Usage
• Joplin Example project.clj

TODO

• It was suggested by @jarohen that joplin.xtdb could use Transaction Functions to ensure that all migrations executed at once share the same tx-time. This will definitely make the historical timeline for schema and data migrations cleaner, but it also requires a "meta schema change" of sorts, which is the Transaction Function itself. I'm a bit nervous making any assumptions about what sort of entities the consumers of joplin.xtdb want in their database, so I've left the direct (naive) implementation for now. This upgrade can always come later without impacting historical migrations.

Developing

Run tests:

lein test

Deploying to Clojars

One-time Setup

1. Get admin permissions to the org.pariyatti Clojars group. This group is already verified against pariyatti.org.
2. Set up GPG:

brew install gnupg2
echo "GPG_TTY=$(tty)\nexport GPG_TTY" >> ~/.zshrc # or ~/.bash_profile
gpg --gen-key
# save your passphrase in your password manager
gpg --list-keys
gpg --fingerprint 1A1A11A11AA11A111A1AAA1A11AA1111A11A1111
gpg --send-keys   1A1A11A11AA11A111A1AAA1A11AA1111A11A1111
# save your revocation certificate in your password manager:
cat ~/.gnupg/openpgp-revocs.d/1A1A11A11AA11A111A1AAA1A11AA1111A11A1111.rev

3. Create a Clojars Deploy Token, which is now mandatory. Save it in your password manager.
4. Create ~/.lein/credentials.clj (as described here):

{#"clojars"
 {:username "my-web-username"
  :password "CLOJARS_5a5a5aa5a555555555a55aa..."}}

5. Encrypt it:

gpg --default-recipient-self -e ~/.lein/credentials.clj > ~/.lein/credentials.clj.gpg

6. Try it out:

lein deploy clojars

Deployment Checklist

1. Bump (drop "SNAPSHOT") and commit a new SemVer in project.clj.
2. Deploy:

lein deploy clojars

3. Bump and commit "SemVer+1-SNAPSHOT"

License

Copyright © 2021 Pariyatti

Distributed under either the MIT License or the Eclipse Public License (1.0 or later).