aboutsummaryrefslogtreecommitdiffstats
path: root/pkgs/populate
Commit message (Collapse)AuthorAgeFilesLines
* populate: add prunetv46 hours1-1/+40
| | | | | | | | | | | | | | | | | | | Populate never removes what it delivered for sources that aren't configured anymore. For flake and flake-input sources, that keeps their garbage collector roots, so what they delivered never gets collected. With prune, populate removes everything from the target directory that isn't a source, except .populate, after syncing the sources. It also removes the roots in .populate/flake-inputs of names that aren't flake or flake-input sources, and uploads left behind by interrupted runs. Pruning is opt-in, because the target directory may contain other things worth keeping, or be shared by deployments with different sources. writeDeploy, writeTest, and writeCommand pass prune on to populate. A feature scenario deploys sources, deploys fewer without pruning, then with pruning, and checks that the removed sources' entries and roots are gone, while the remaining sources and .populate stay.
* populate: stop the ssh master only if there is onetv48 hours1-1/+4
| | | | | | | Populate ends by stopping the ssh master, which fails if no source started one, e.g. for local targets, which populate doesn't reach via ssh. Populate then exits with ssh's exit status, though all sources got delivered. Populate now checks for a master first.
* populate flake-input: support subdirectories named in URLstv48 hours1-7/+41
| | | | | | | | Depending on the version of Nix, flake references and lock entries name the subdirectory containing a flake either as attribute dir or as query parameter dir of their URL. fetchTree supports neither, so populate looks for both: it takes the subdirectory from either, from the locked or the original reference, and removes both before fetching.
* populate flake: support fetchOnTargettv2 days1-22/+183
| | | | | | | | | | | | | | | | | | With fetchOnTarget, the target fetches the flake's inputs using the arguments recorded in the lock file, like it does for flake-input sources. The flake itself has no lock entry, so the target fetches it by its locked reference, unless that refers to the deploying machine, e.g. a path or a Git work tree. Then the flake's tree gets transferred using rsync and added to the target's store using nix-store --add-fixed, which yields the same store path as on the deploying machine, because flake store paths are content-addressed by their NAR hash. Adding paths like this needs neither signatures nor a trusted user, so this works for targets using sudo. The transfer gets skipped if the target's store has the flake already, and populate fails if the added path differs from the expected one. rsync' gets a filterFiles option, so the flake's tree gets transferred without applying .rsync-filter files, which would change it.
* populate: add flake-input source typetv2 days1-9/+11
| | | | | | | The flake-input source type delivers an input of a flake, as recorded in the flake's lock file, and the flake source type delivers the flake itself. fetchOnTarget belongs to flake-input, because only a locked input can be fetched on the target.
* populate: generate flakes for inputs drawn from sourcestv2 days1-5/+131
| | | | | | | | | | | | | | For each source that draws inputs from other sources, populate generates a flake in .populate/flakes/<name>, which re-exports the outputs of the source's flake with those inputs drawn from the other sources. The source itself stays as it is, so NIX_PATH still refers to it. Generated flakes refer to each other's generated flakes, so a source's own declarations apply wherever it gets drawn from, and get generated in dependency order. Evaluation fails for sources drawing inputs from missing sources, from themselves, or from each other. Generated flakes get locked on every run, and get removed once their sources no longer draw inputs from other sources.
* populate flake: add fetchOnTargettv2 days1-18/+80
| | | | | | | | | | With fetchOnTarget, the target fetches the input and its own inputs itself, using fetchTree with the arguments recorded in the flake's lock file. Only nix flake metadata runs on the deploying machine, so the inputs get downloaded once, by the target. This needs Nix with flake support on the target, which populate checks before fetching. Because nothing gets copied, this also works for targets using sudo.
* populate: add flake source typetv2 days1-1/+97
| | | | | | | | | | | | Deliver a flake, or one of its locked inputs, to the target: archive the flake locally, copy the selected input together with its own inputs into the target's store, and link it at the target path, registered as garbage collector root. The result can be used in NIX_PATH as well as by flakes evaluated on the target, without network access. nix copy runs with a separate ssh wrapper without the control socket, because Nix waits for its LocalCommand, which may not run over a multiplexed connection.
* populate: export TMPDIRtv2 days1-0/+1
| | | | | | | Each job and the ssh wrapper run as separate scripts, which only see TMPDIR if it's exported. Without TMPDIR in the caller's environment, jobs fail, and the ssh wrapper's control socket ends up at the root directory.
* populate backup: fix error messagetv2 days1-1/+1
|
* populate: derive socket name from target hosttv2026-01-011-2/+2
|
* populate: use ssh control socket1.30.0tv2025-12-091-6/+12
|
* populate use singular tmpdirtv2025-12-091-24/+22
| | | | | | | | Set TMPDIR to a fresh, private top-level temporary directory, and run each job in a separate subdirectory beneath it. TMPDIR remains shared across all jobs, allowing reuse of resources like ssh control sockets.
* populate pass{,age}: use $pass_outtv2025-12-091-9/+9
|
* populate pipe: use rsynctv2025-12-091-2/+10
| | | | Generate a reproducible output to transmit it only if it has changed.
* populate passage: rename loop variablestv2025-04-091-6/+7
|
* populate rsync': reduce verbositytv2025-04-091-1/+2
|
* populate: add passage source type1.29.0tv2024-01-111-1/+32
|
* populate pass: calculate hash for each symlink1.28.2lassulus2023-03-131-1/+9
| | | | | this fixes folders with symlinks not getting updated if the symlinked file is in another subfolder of the pass repo
* populate git: remove trailing spaces1.26.3tv2022-02-121-1/+1
|
* populate git: remove non-worktree targettv2022-02-121-0/+5
|
* target: use default port from SSH configErik Arvstedt2021-11-201-2/+1
| | | | | This is the expected behavior. The SSH config is also implicitly used for other SSH-related settings.
* populate file: isDerivation -> isStorePath1.26.1tv2021-10-261-2/+2
|
* populate file: admit derivations1.26.0tv2021-10-261-4/+15
|
* populate: add rsyncDefaultConfigtv2021-10-261-7/+14
|
* populate pass: don't decrypt .gpg-idlassulus2021-02-161-1/+1
|
* populate pass: make git optional againlassulus2021-01-171-2/+6
|
* Make pass source follow symlinksv1.24.0Simon Bruder2020-12-151-1/+1
|
* add `shallow` option to git source typeEnno Lohmeier2020-07-021-3/+15
|
* treewide: harmonize ssh callsv1.22.0tv2020-06-081-12/+11
|
* add target.extraOptionsErik Arvstedt2020-04-181-0/+1
|
* Merge pull request #15 from nyantec/feature/filtersv1.20.0tv2020-02-181-2/+5
|\ | | | | support for include filters
| * support for include filtersMilan Pässler2020-02-031-2/+5
| | | | | | | | | | | | | | - Added a new option for `file` sources, which allows to specify a list of `include` and `exclude` filters - Added a new option for `file` sources, which allows to disable the `--delete-excluded` behaviour.
* | use writers from nixpkgsJörg Thalheim2020-02-171-3/+3
|/ | | | | This makes the evaluation of krops pure (no import from derivation) and makes it faster since the fetchGit result might be garbage collected.
* populate: re-add default values for useChecksum/excludeJörg Thalheim2019-12-231-2/+2
| | | | Turns out, those where required.
* populate file: add exclude optionJörg Thalheim2019-12-231-2/+5
|
* ssh: support using ssh-configured usertv2019-11-291-5/+7
| | | | | | | Let ssh use the user configured in its configuration files when the target user is set to the empty string. Closes https://github.com/krebs/krops/issues/2
* ssh, rsync: support using sudo on remoteMilan Pässler2019-11-291-3/+7
| | | | | | | | This allows deployment of remote hosts without having ssh access to the root user. Passwordless sudo is recommended since krops will use multiple ssh sessions and the password will not be remembered. Closes https://github.com/krebs/krops/issues/3
* populate git: add fetchAlways optionv1.16.0lassulus2019-08-081-2/+6
|
* populate: support backupping targettv2019-07-161-1/+23
|
* populate: allow directories as sentineltv2019-07-161-1/+1
|
* populate derivation: print nix-build output to stderrlassulus2019-01-281-1/+1
|
* populate pass: check only hash of source directoryv1.11.0lassulus2018-12-141-1/+1
|
* populate pass: set -efuv1.10.2tv2018-12-141-0/+2
|
* populate: add derivation typev1.10.0lassulus2018-12-041-0/+4
|
* populate pass: check if already up to datev1.9.0lassulus2018-11-301-0/+15
|
* populate git: set -efuv1.8.1tv2018-11-301-0/+1
|
* populate file: add useChecksumv1.8.0tv2018-11-281-3/+8
|
* populate symlink: fail if target is a directoryv1.7.3tv2018-11-281-1/+1
|
* populate check: mkdir's verbose output to stderrv1.7.2tv2018-11-201-1/+1
|
generated by cgit v1.3.1 (git 2.54.0) at 2026-11-13 22:18:34 +0000