Skip to content

sftp sync script

the script that actually syncs the data. It will run periodically triggered by a cron job.

will sync from an external sftp server to our (internal) sftp-server aka object storage.

Usage: sftp_sync.py THING_UUID KEYFILE
Sync external SFTP files to minio storage.

Arguments
  THING_UUID        UUID of the thing.
  KEYFILE           SSH private key file to authenticate at the sftp server.

Additional set the following environment variables:

  MINIO_SECURE      Use minio secure connection; [true, false, 1, 0] 
  FTP_AUTH_DB_DSN   DB which store the credentials for the internal 
                    and external sftp server. See also DSN format below. 
  LOG_LEVEL         Set the verbosity, defaults to INFO.
                    [DEBUG, INFO, WARNING, ERROR, CRITICAL]

DSN format: 
  postgresql://[user[:password]@][netloc][:port][/dbname]

THis is now a standalone MR and can be merged any time. No dependencies to other MR.

Edited by Bert Palm

Merge request reports

Loading