What is Connect
Connect is a unified data transfer toolkit that brings dependable automation to SFTP, Amazon S3 (and compatible services), Google Cloud Storage, and Azure Blob Storage. Whether you are managing ad‑hoc pushes, nightly sync jobs, or fully automated pipelines, Connect keeps files moving with predictable logging and minimal babysitting.
Key Features
Section titled “Key Features”- Versatile CLI Commands: Use
copy,move,sync,list, andremoveto cover the full lifecycle of file distribution—from discovery to cleanup—across local and remote targets. - Powerful Pattern Matching: Target files with familiar globs (
*.zip,logs/*.csv) or RE2 regular expressions (regex:^report_\\d{8}\\.csv$) for precise selection. - Connection Shortcuts: Store credentials in encrypted aliases, reference S3/GCS/Azure connection strings, and reuse SFTP host keys automatically.
- Performance on Tap: Scale throughput with
--parallelworkers and SFTP connection pooling, keep an eye on transfers with a live progress bar, or switch to--batchwhen output will feed automation. - Built with Go: Written in Go for exceptional efficiency and native parallelism. The lightweight binary has a minimal memory footprint while leveraging Go’s powerful goroutines for concurrent operations—making it ideal for high-throughput transfers on resource-constrained systems.
- Automation Ready: Drop the CLI into cron, systemd timers, Windows Task Scheduler, or any CI runner. Batch output, JSON logging, and exit codes make scripting predictable.
- Familiar Experience: Unix-friendly flags, verbose help, and POSIX-style patterns make the CLI feel instantly comfortable to Linux administrators and power users alike.
- Lightweight Footprint: Configuration lives alongside the binary (
license.key) while user secrets stay under~/.connect/, keeping deployments simple. - Secure by Design: Encrypted alias files, controlled file permissions, and trusted-host validation keep access credentials and SSH fingerprints safe.
Get started with Connect today and replace brittle scripts with a consistent, auditable transfer workflow. Your data, your way—efficient, automated, and secure.