Feature: Take command output as stdin for restic

[jkellerer]

PR introducing "stdin-command" to allow scheduling backups of streams (e.g. mysql-dump) without requiring temporary storage.

Usage:

my-profile:
  backup:
    schedule: 'hourly'
    stdin-filename: mysql-dump.sql
    stdin-command:
      - mysqldump --order-by-primary --host=db-host --user=db-user --password=db-pw db-name

• Needs rebase when PR Added configuration support for additional restic commands #94 is merged
  (depends on ResolveConfiguration())
• Testing (unit & manual tests)
• Contains data race that requires fixing

[codecov]

Codecov Report

Merging #98 (f36cbd2) into master (d46265d) will increase coverage by 0.54%.
The diff coverage is 86.79%.

@@            Coverage Diff             @@
##           master      #98      +/-   ##
==========================================
+ Coverage   65.18%   65.73%   +0.54%     
==========================================
  Files          65       66       +1     
  Lines        6495     6636     +141     
==========================================
+ Hits         4234     4362     +128     
- Misses       2062     2070       +8     
- Partials      199      204       +5     

Impacted Files	Coverage Δ
shell/command.go	64.42% <45.45%> (-2.00%)	⬇️
config/profile.go	93.40% <57.14%> (-1.01%)	⬇️
shell/command_windows.go	66.66% <66.66%> (-33.34%)	⬇️
wrapper.go	79.86% <77.77%> (+0.58%)	⬆️
wrapper_streamsource.go	94.69% <94.69%> (ø)
config/config.go	72.93% <100.00%> (ø)
shell_command.go	86.95% <100.00%> (+6.52%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d46265d...f36cbd2. Read the comment docs.

[creativeprojects]

I like it.

I was using a temp file, but that will make my config simpler 😄

    [azure.backup]
    limit-upload = 500
    exclude = [ "azure-backup.log" ]
    exclude-file = [ "root-excludes", "excludes" ]
    exclude-caches = true
    tag = [ "mysql", "git" ]
    run-before = [
        "rm -f /tmp/mysqldump.gz",
        "mysqldump -u{{ mysql_backup_user }} -p{{ mysql_backup_password }} --opt zabbix | gzip > /tmp/mysqldump.gz"
    ]
    source = [ "/tmp/mysqldump.gz", "/git/creativeprojects" ]
    run-after = [
        "rm -f /tmp/mysqldump.gz"
    ]
    schedule = "04:18"
    schedule-permission = "system"
    schedule-log = "azure-backup.log"

[creativeprojects]

it is a bit annoying, but I think we have to synchronise the stdin goroutine with the command runner during a --dry-run

[creativeprojects]

That'd be nice to find a better way to stop on Windows but I'm not even sure we can do it.
Apart from that, it's all good for me, nice job 😊

[sonarqubecloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
5 Code Smells

No Coverage information
0.0% Duplication