Sign in

Search issue titles and bodies, change requests and comments. Private repositories you cannot read are not included.

vole
Clone

Read only, no credentials:

https://rodent.software/vole.git

Write over SSH with a registered key:

git clone ssh://git@rodent.software:2222/vole.git

A free and open-source forge that lives in your Git repo.

Run several jobs at once with --jobs

18c559ea0010dc22db13c889afda4fe9af3c15d7 · Keenan Nemetz · 3d ago · parent 91b47a22

Run several jobs at once with --jobs

A runner process leased one job and blocked on it, so the only way to get a
second job onto a machine was a second process: another host, another key,
another allowlist entry, and another --dir that learns the repositories cold.
The server was never the limit — a lease is taken per session and claimed by a
conditional update — so this is the runner catching up.

`--jobs N` is N slots in one process. Each slot owns a session and runs at most
one job, and everything that belongs to the process happens once, before the
slots start: the directories, the cache bounds, the leftover sweep, and the
connections. A slot that refuses a job stops every slot, because reconnecting
would ask the same instance the same question. A slot that loses its connection
reconnects with a doubling delay instead, so one flaky link does not take the
other slots' jobs with it; the job it was running is requeued when its lease
expires.

The log stream moves from the session to the job, which is what makes two jobs
on one session impossible to confuse: a slot has one, and it is the stream for
the job in front of it.

Deployment: `RUNNER_JOBS` in the first-boot renderer, the packaged argument
file, and the docs. The container limits are per job, so the machine has to
carry --jobs times what they allow; max_jobs_per_repo is what stops one
repository claiming every slot.

Refs: 01M6SCWCSX39QXS38QAHQSMVGX (#216)

docs/cli.md +6−1

@@ -264,7 +264,7 @@ See [Sites](sites.md).
264 264 ## CI
265 265
266 266 ```sh
267 vole runner --remote <ssh-url> [--once] [--dir <path>] [--repos <name>]... [--label <name>]...
267 vole runner --remote <ssh-url> [--once] [--jobs <n>] [--dir <path>] [--repos <name>]... [--label <name>]...
268 268 [--container-runtime <name>] [--container-network none|bridge]
269 269 [--container-pull missing|always|never] [--container-user <uid:gid>] [--container-userns <mode>]
270 270 [--container-memory <size>] [--container-cpus <n>] [--container-pids <n>]
@@ -282,6 +282,11 @@ vole workflow dispatch --remote <name|url> --workflow <path> [--ref <branch>]
282 282 [--input name=value]...
283 283 ```
284 284
285 `--jobs` is how many jobs one runner process runs at once (default 1). Each is a
286 session of its own, so the container limits are per job and a machine running four
287 jobs needs room for four containers. Under `--once` the runner still starts `--jobs`
288 jobs, and exits when they all finish.
289
285 290 `workflow run` executes steps in the working tree, in the job's image. It needs no
286 291 runner, but it does read the secrets its jobs declare from the instance the
287 292 checkout's `origin` names, using your key; a value it cannot read is left unset with