The Wayback Machine - https://web.archive.org/web/20210826011929/https://github.com/rclone/rclone
Skip to content

/ rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

rclone.org
MIT License
28.5k stars 2.6k forks
Star
Notifications
master
Switch branches/tags
103 branches 86 tags
Code

Latest commit

@ncw
ncw cache: don't run failing tests on windows/386
4 6a9ef27 Aug 20, 2021
cache: don't run failing tests on windows/386 
After updating rclone's dependencies these tests started failing on
windows/386

- TestInternalDoubleWrittenContentMatches
- TestInternalMaxChunkSizeRespected

The failures look like this. The root cause is unknown. The `Wait(n=1)
would exceed context deadline` errors come from golang.org/x/time/rate
but it isn't clear what is calling them.

2021/08/20 21:57:16 ERROR : worker-0 <one>: object open failed 0: rate: Wait(n=1) would exceed context deadline
[snip ~10 duplicates]
2021/08/20 21:57:56 ERROR : tidwcm1629496636/one: (0/26) error (chunk not found 0) response
2021/08/20 21:58:02 ERROR : worker-0 <one>: object open failed 0: rate: Wait(n=1) would exceed context deadline
--- FAIL: TestInternalDoubleWrittenContentMatches (45.77s)
    cache_internal_test.go:310:
        	Error Trace:	cache_internal_test.go:310
        	Error:      	Not equal:
        	            	expected: "one content updated double"
        	            	actual  : ""

        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-one content updated double
        	            	+
        	Test:       	TestInternalDoubleWrittenContentMatches
2021/08/20 21:58:03 original size: 23592960
2021/08/20 21:58:03 updated size: 12
6a9ef27 4

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
.github
build: make go1.14 the minimum supported Go for building
Aug 20, 2021
backend
cache: don't run failing tests on windows/386
Aug 20, 2021
bin
Version v1.56.0
Jul 20, 2021
cmd
build: make go1.14 the minimum supported Go for building
Aug 20, 2021
cmdtest
cmdtest: end-to-end test for commands, flags and environment variables
Jul 5, 2021
contrib/docker
Contrib: Add sample WebDAV server Docker Compose manifest.
Sep 15, 2019
docs
build: make go1.14 the minimum supported Go for building
Aug 20, 2021
fs
build: make go1.14 the minimum supported Go for building
Aug 20, 2021
fstest
Use binary prefixes for size and rate units
Apr 26, 2021
graphics
build: Add file properties and icon to Windows executable (fixes #4304)
Jun 11, 2020
lib
build: make go1.14 the minimum supported Go for building
Aug 20, 2021
librclone
librclone: add missing sync/* rc methods
Jul 20, 2021
vfs
vfs: ensure names used in cache path are legal on current os
Aug 19, 2021
.gitattributes
build: add azure pipelines build
Aug 6, 2019
.gitignore
docs for serve docker and docker plugin (#5415)
Jul 10, 2021
.golangci.yml
build: move linter build tags into Makefile to fix golangci-lint
Apr 12, 2019
CONTRIBUTING.md
cmdtest: end-to-end test for commands, flags and environment variables
Jul 5, 2021
COPYING
Initial commit - some small parts working
Nov 18, 2012
Dockerfile
build: add an rclone user to the Docker image but don't use it by def…
Feb 11, 2021
MAINTAINERS.md
compress: finish docs
Dec 2, 2020
MANUAL.html
Version v1.56.0
Jul 20, 2021
MANUAL.md
Version v1.56.0
Jul 20, 2021
MANUAL.txt
Version v1.56.0
Jul 20, 2021
Makefile
build docker plugin (#5415)
Jul 10, 2021
README.md
deprecate cache backend (#5382)
Jun 10, 2021
RELEASE.md
build: update notes on how to build the release manually with docker
Mar 24, 2021
VERSION
Start v1.57.0-DEV development
Aug 1, 2021
go.mod
build: update all dependencies
Aug 20, 2021
go.sum
build: update all dependencies
Aug 20, 2021
notes.txt
docs: spelling: etc.
Oct 28, 2020
rclone.1
Version v1.56.0
Jul 20, 2021
rclone.go
lib: add plugin support
Sep 29, 2019
Rclone Storage providers Features Installation & documentation Downloads License

README.md

rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDav/FTP/SFTP/dlna

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).

About

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

rclone.org

Topics

go golang sync encryption dropbox amazon-drive ftp s3 google-cloud-storage onedrive google-drive sftp webdav cloud-storage openstack-swift rclone hubic fuse-filesystem azure-blob backblaze-b2

Resources

Readme

License

MIT License

Releases 86

rclone v1.56.0 Latest
Jul 20, 2021
+ 85 releases

Sponsor this project

  •  
Learn more about GitHub Sponsors

Packages

No packages published

Used by 3

Contributors 451

+ 440 contributors

Languages