New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Preserve hard links #6160
Comments
I'm sure what you what to happen. If you have a file that's a hard link, it would get fully copied to the remote. Remotes have no concept of hard links so if you have: /dira/file.txt On the same physical volume and want to copy it to a cloud remote, you get two copies as the cloud remotes have no idea/concept of hard links as those are physical file constraints. In the scenario above, what would you want to happen on the remote? |
Yes, understood. Wastefully as many times as there are hard links.
Is that universally true? AFAICT, SFTP supports hard links.
Again, I believe SFTP understands hard links. So when a remote is an SFTP server on a POSIX filesystem, there is no reason to not support hard links.
I would want the remote, which is an SFTP remote, to create hard links on it's POSIX file system. So while, yes, many "cloud" providers don't support hard links, it is not universally true of all rclone remote types and where they are supported by a remote, they should be used. |
So let me be specific, generally rclone uses cloud based remotes and most/many do not support hard links. Are the exceptions? Sure. I was speaking generally so thanks for clarifying as I didn't say all but I do see it was implied.
As above, there are so many SFTP servers out there as some support / some don't. It's very dependent on what the SFTP does as if it is supported or not. It's a very narrow use case in terms of rclone so it can be logged as an enhancement, but realistically unless you plan to implement, it will most likely sit unless someone else picks it up, sponsor someone to make the change or it'll just collect dust. |
What problem are you are trying to solve?
Space efficiency with hard links.
How do you think rclone should be changed to solve that?
It should recognize, say, when doing rclone sync, when files are actually hard links and preserve those on the remote. This not only saves space on the remote but also saves the bandwidth of transferring all of the links to that one file as separate files.
How to use GitHub
The text was updated successfully, but these errors were encountered: