So, I’m selfhosting immich, the issue is we tend to take a lot of pictures of the same scene/thing to later pick the best, and well, we can have 5~10 photos which are basically duplicates but not quite.
Some duplicate finding programs put those images at 95% or more similarity.
I’m wondering if there’s any way, probably at file system level, for the same images to be compressed together.
Maybe deduplication?
Have any of you guys handled a similar situation?
File system deduplication might be best bet, though I don’t know what’s the potential.
No, it is impossible to solve this on filesystem level. In theory, it would be possible to adopt some video codec for compression of such photo series, but it would be a lot of work to integrate it into immich.
Compression?
Storage is cheap. You suggest combining the images and storing the difference.
You can’t separate the images anymore. You have to store them in a container such that you have one common base image. You can then later on decide which image to look at.
You could also take a short video and only display one image.
Avif uses a video compression algorithm, meaning it’s basically one frame of a video.
Btw, I wouldn’t care about your problem. Storage is cheap. Try saving 10 4k videos and you’ll laugh about your image library
we can have 5~10 photos which are basically duplicates
Have any of you guys handled a similar situation?
I decide which one is the best and then delete the others. Sometimes I keep 2, but that’s an exception. I do that as early as possible.
I don’t mind about storage space at all (still many TB free), but keeping (near-)duplicates costs valuable time of my life. Therefore I avoid it.
