I know, I know. I really shouldn’t use NTFS with Linux if I plan to write to it, especially not my only backup drive, which is my external media drive for libreELEC as well.

So I was moving/copying/renaming stuff through SMB on my libreELEC machine. And then suddenly I noticed 50 episodes of old-school Sonic animated series just… disappeared. Strange, but I continued renaming files, and those too poof nonexistent anymore.

Okay, maybe a Dolphin bug - I thought, since I was using Dolphin for SMB. But same from Android (I’m using Solid Explorer)

Then, Ghost In The Shell Stand Alone Complex too disappeared. Then some episode of Serial Experiments Lain.

Star Trek Discovery? Fucking gone, tho I didn’t mind that one. All of the files are 0B. Then Regular Show.

Now, this was the point where I needed to step in. Linux just didn’t see the files.

Oh well, I have a Windows 10 PC I use for work so it was a time for bringing the drive “home” and give it some chkdsk, in the meantime I was really hoping it wouldn’t just destroy my 4TB backup drive. Wasn’t sure it would work, but that was pretty much my only hope and idea. Trying to access those folders and files from Windows gave me error messages before the check.

The check and fix dialog of chkdsk was also kinda fucked, the progressbar jumped around, didn’t make any sense BUT it restored my files. Hooray!

Except SAC, it was still unreadable from Windows, but! Linux does see all the episodes so I guess it’s a win… of some sort. It sill bothers me there is some - from Windows’s point of view - invalid files and folders on my BACKUP disk, but this will be another story.

It turned out, libreELEC is using ntfs-3 (and not 3g), which is famous for this kind of errors - files disappearing and the filesystem becoming funky.

So, I ordered a drive just for my media and media PC, tho no idea how to format it (to be readable from anywhere else - maybe exFAT?)

But this scared me like hell 😅

Just wanted to share this with you guys, there’s no moral of the story, except do not use ntfs heavily under Linux, or at least do not write it a lot, which is a known thing since forever, I was just a lazy ass, don’t be like me, please, unless you have a Windows machine around and some luck. But relying on these two, well…

Cheers!

Update: I formatted my new media drive to ext4. In the end, it’ll be a fixed disk under my TV in a linux box, this seemed to be the best choice. I don’t think I’ll pick it out and use it elsewhere that much or at all.

10 points

Everyone needs at least two backups: one local and one remote in case of natural catastrophe. Glad you came out ok.

permalink
report
reply
3 points
*

yeah, well, I really need a better backup system, I almost lost my stuff countless times now. TestDisk saved my ass everytime on more major fuckups, but sooner or later I’ll burn myself…

permalink
report
parent
reply
3 points

Backblaze and rsync with a network or external drive.

https://samuelhewitt.com/blog/2018-06-05-time-machine-style-backups-with-rsync

permalink
report
parent
reply
1 point
*

I’ll raise you one and attach a mount point over iscsi!

permalink
report
parent
reply
6 points

Ah, now that’s a scare! Glad you mostly managed to recover at any rate.

As for the fs to use, exfat is probably a safer bet but btrfs is also an option. I’ve used winbtrfs in the past and it works surprisingly well.

permalink
report
reply
6 points

DO NOT USE WIN BTRFS. Recently I used a current version and it fucked up my btrfs filesystem in a way that was almost impossible to diagnose and fix.

permalink
report
parent
reply
2 points

It is in Alpha

permalink
report
parent
reply
2 points

Right, thanks for the input. I used to use it for unimportant stuff like game storage so it’s entirely possible errors just went unnoticed 😅

permalink
report
parent
reply
1 point

But I don’t think BTRFS can be used on a backup drive because it often needs backups lol

permalink
report
parent
reply
2 points

Said drive is a new one for media and regular everyday usage, not the existing backup drive according to the OP. Btrfs is more than stable enough barring specific RAID configurations, at any rate.

permalink
report
parent
reply
1 point
Deleted by creator
permalink
report
parent
reply
1 point

Thanks for the tip. Though I wouldn’t mind if it would work on almost anything - even like Android or some older systems. Not a real need, just would be nice if I could plug mymedia drive into anything and watxh stuff from it (maybe even from older, not smart TVs if it’s possible)

permalink
report
parent
reply
3 points
*

Yeah I guess exfat is the way to go then, it’s how I handle my external SSD rn as well

Edit: Also, I’m not sure how well btrfs handles external drives. Didn’t realize that when I suggested it.

permalink
report
parent
reply
4 points

Don’t use ext4 for that data. Use btrfs

Also one copy of the data is zero copies and 2 copies is one copy.

permalink
report
reply
6 points

Also one copy of the data is zero copies and 2 copies is one copy.

ah, just like with beer

permalink
report
parent
reply
2 points

Something happened to me like that but I was not able to recover the data. I will thy to do as you did.

permalink
report
reply
1 point

🤞

permalink
report
parent
reply
2 points

Just another thing to consider with exFAT is that it doesn’t support having symlinks written on it. (for example, if your exFAT drive is located at /mnt/exfat, doing ln -s ~/Documents/cool-document.txt /mnt/exfat/ will fail) Idk if that’s a problem for your use case, but just so you’re aware.

I do have a drive that is formatted with exFAT that I made with the intention of having it be readable by both Linux and Windows, but I ended up not really using windows ever lmao. It should be fine if you’re just using it to store media

permalink
report
reply

Linux

!linux@lemmy.ml

Create post

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word “Linux” in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

  • Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
  • No misinformation
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

Community stats

  • 8.4K

    Monthly active users

  • 6.3K

    Posts

  • 172K

    Comments