this post was submitted on 21 Oct 2023
63 points (100.0% liked)

Linux

48186 readers
1234 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
 

Hi,

I currently use a program called copywhiz on windows that backs up any files or directories created after a certain date to a usb hard drive and runs once a day.

I want to transition fully to Linux. Is there any easy to use software that works on Linux that can do this?

P.S. I have tried creating a bash script to do this but for some reason it has trouble with the date part. So a software solution would be prefered.

all 36 comments
sorted by: hot top controversial new old
[–] yote_zip@pawb.social 17 points 1 year ago (1 children)

I'm curious to know more about your "certain date" requirement - this sounds like it might be an XY problem. As for general advanced backup programs, I have two easy recommendations that are similar in featureset:

The most important parts of real backup software IMO is the ability to compress your backups, version your files with rolling/pruning snapshots, and version your files efficiently with only deltas between them taking extra space. You can also encrypt your backup if you want to store it with a remote party, or run integrity checks to check for bitrot.

[–] hallettj@beehaw.org 2 points 1 year ago

Yeah, with those options it's easier to back up your whole home directory, and then daily backups only take a minute or so and a small amount of additional space to back up what's changed since the day before.

[–] naeap@sopuli.xyz 7 points 1 year ago (1 children)

I'm using borg with vorta as a front-end, which seems to work quite well, with different possible backup targets

[–] NotAnArdvark@lemmy.ca 2 points 1 year ago (1 children)

2nd'ing Vorta+Borg. It's also really easy to find off-site backup options compatible with Borg. I'm using BorgBase, which offers ridiculously cheap storage, the choice of EU and US destination, and supports the development of both Vorta and Borg.

[–] kylian0087@lemmy.world 2 points 1 year ago (1 children)

What is the bennefit of vorta? Personally i have always used borg directly.

[–] lemmyvore@feddit.nl 1 points 1 year ago* (last edited 1 year ago)

No benefit other than being a GUI. It has a complex interface that attempts to cover many Borg options but not all.

I usually suggest Pika Backup instead because it has a very simple GUI that makes it easy to perform one-click backups. If you're gonna use a GUI might as well get something out of it.

[–] Kongar@lemmy.dbzer0.com 5 points 1 year ago

I’m pretty sure there are lots of options that work great. I personally just use rsync-but I know the command line is scary for a lot of people making the transition. There are lots of options like timeshift that basically put a gui wrapper around rsync. I’ve seen a lot of love for borg as well - maybe try one of those two.

I feel backups are personal and it’s hard to get a “just do this instruction”. You’ll probably have to pick a product, and then do some homework to see if it can do what you want. This is further complicated by the distro you use - or more specifically if your distro uses btrfs. Some people use a backup as a sort of snapshot, and btrfs is more full featured than ext in that regard.

Good luck!

[–] carcus@lemmy.ml 5 points 1 year ago (1 children)

I like restic, haven’t seen it mentioned yet.

[–] nezach@discuss.tchncs.de 1 points 1 year ago

I like restic too.

[–] entropicdrift@lemmy.sdf.org 5 points 1 year ago (1 children)

I use Linux Mint and love the automatic backup tool that's built in: timeshift

[–] smileyhead@discuss.tchncs.de 5 points 1 year ago (2 children)

Timeshift is for a system backup, in case your system broke for whatever reason you could get back quickly to your work without rebuilding and reconfiguring it. It's not ment for backing up user files.

[–] entropicdrift@lemmy.sdf.org 3 points 1 year ago (2 children)

It's built on top of rsync, you can easily configure it to make a backup of any arbitrary set of files

[–] smileyhead@discuss.tchncs.de 2 points 1 year ago (1 children)

You can use it like that, but it's not a primary focus I think.

[–] entropicdrift@lemmy.sdf.org 2 points 1 year ago

That's true, sure. I still find it a convenient tool, so I thought OP might find it convenient for this use-case even if that's not the primary purpose

[–] lemmyvore@feddit.nl 1 points 1 year ago

It wasn't designed for that. Use backintime instead, or any number of other backup tools.

[–] MangoPenguin@lemmy.blahaj.zone 1 points 1 year ago (1 children)

A system backup would include user files though, so that would be fine.

[–] lemmyvore@feddit.nl 2 points 1 year ago

Timeshift explicitly omits /home by default. "System" here means the operating system files not all the files on the machine.

[–] Minty95@lemm.ee 4 points 1 year ago

Use timeshift, install it, just chose where you want the backups to be installed, preferably a second HD or SD Flash. Chose when like once a day, week at start up for instance and forget it. Then if you screw up your Linux, just start in console mode, timeshift --restore and five mins later your up and running.

If you want just your data to be copied, then Cron

Both are standard Linux programs, often already installed depending on what Linux you have

[–] lemmyvore@feddit.nl 4 points 1 year ago

Pika Backup. It's very easy to use, you select the directories you want to backup and the ones you want to exclude, then your job is over. Every time you ask it to backup it will add the new and changed files to the backup without deleting the old ones. This way the backups only grow with what's changed.

You can also ask Pika to schedule automatic backups, or you can ask for one manually if the USB HDD is not plugged in all the time.

[–] TheCaconym@hexbear.net 4 points 1 year ago* (last edited 1 year ago)

If the aim is simply to mirror an existing directory, including mirroring suppression/deletions/new files/edits, and only copying what has changed (which is what I suspect you were trying to emulate with the "created after a certain date" thing), just do:

rsync -avh -P /path/to/source/ /path/to/destination

If the aim is to copy all files created since, say, three days ago, but not to update existing files or to remove files that have been removed from your source (which is what you described):

rsync -avh -P --ignore-existing --files-from=<(find -L /path/to/source -ctime -3 -exec basename {} \;) /path/to/source/ /path/to/destination

Edit: lemmy is html encoding my "lesser than" symbol in the second command above; replace accordingly

[–] therealbabyshell@lemmy.ml 4 points 1 year ago (2 children)

UPDATE: The specific date thing is because every 6 months i backup my nas to LTO tape so this backup is anything that isn't currently on tape just in case the NAS dies between backups.

Have you looked into using software meant for tape backup for that? It should back up only what's been changed/added since the last tape backup was done.

[–] Holzkohlen@feddit.de 0 points 1 year ago* (last edited 1 year ago) (1 children)

You said you run it daily in the post, but now it's every 6 months. You really should be more specific. I for one don't understand why you can't just do rsync -au /source /target

[–] therealbabyshell@lemmy.ml 0 points 1 year ago

i run this backup daily because the from date for it is based on the date of the last 6 monthly backup to tape

[–] smileyhead@discuss.tchncs.de 2 points 1 year ago

I think that for your use case (backing up to an external USB drive) great option would be something based on Borg.

Vorta and Pika Backup are great graphical tools for Borg program, with the first being more advanced while the latter being simplier.

[–] Rootiest@lemmy.world 2 points 1 year ago

I use Kopia on both Linux and Windows.

It's really fast and has a lot of great features.

And it's FOSS

[–] sqw@lemmy.sdf.org 2 points 1 year ago* (last edited 1 year ago)

I use backintime, which is basically a GUI for rsync.

[–] fxt_ryknow@lemmy.world 1 points 1 year ago (1 children)

I use Syncthing to do a similar thing. I jus have Syncthing pointed to nfs mount to my Nas. Any files synced to the folder via Syncthing just end up on my Nas.

[–] captain_aggravated@sh.itjust.works 2 points 1 year ago (1 children)

Don't consider this a backup. Yes, it could help you survive some failures, but if you simply delete a file by accident on your computer, it'll get deleted from your NAS as well.

[–] axzxc1236@lemm.ee 3 points 1 year ago

Syncthing has built-in file history function, it's not enabled by default but it's easy to configure.

[–] knobbysideup@lemm.ee 1 points 1 year ago

I use Borg to my nas, then rclone that to rsync.net. With Borg if you need the remote copy, you can interact with it directly.

You can, of course, Borg directly to rsync.net. You can also use rsync instead and let their ZFS snapshots do retention for you.

[–] Kushia@lemmy.ml 0 points 1 year ago

I use a service called iCloud which has both cloud storage and local backup support built into it. Not free or open source but no cloud platform fully is. It's also really cheap for students.