[Feature] Duplicate Rules #10665
Replies: 29 comments 35 replies
-
|
Another very useful feature is enable/disable video dedupe. I have a lot of false positives due to the AI model. |
Beta Was this translation helpful? Give feedback.
-
|
Here are some more points to think about. It would be great if we could set a list of rules and prioritize them. And each user can have a different priority - basically, an option to reorder them as needed. The following are some rules I could think of:
The list can be refined based on what people think. |
Beta Was this translation helpful? Give feedback.
-
|
this is fairly easy to implement since the suggestDuplicateByFileSize object is just sorting each iteration by file size and selects the last object (biggest file). instead you could first check if there is one or more HEIC file and then ignore JPGs. obviously this should be optional. and it would need a UI for user preferences. |
Beta Was this translation helpful? Give feedback.
-
|
Also been thinking about this as I go through my 13,000 duplicates. Would at least reduce my clicks so I don't have to switch the heic and the jpg auto selection. |
Beta Was this translation helpful? Give feedback.
-
|
also the ability to skip a duplicate pairing would be nice and come back to it later. |
Beta Was this translation helpful? Give feedback.
-
|
I effed up big time and uploaded from my wifes "recent" folder which seems to be populated by google photos? We now got like 8k photos and video as duplicates with/without GPS. being able to select by GPS would save me tears. |
Beta Was this translation helpful? Give feedback.
This comment has been minimized.
This comment has been minimized.
-
|
Wanted to bump this - file size is a decent criteria but might end up selecting for poor compression algorithms (JPEG instead of HEIC, for example) rather than actually more data. For a preliminary go, how about sorting by (decompressed) pixel count rather than size? I believe it's possible to get the 'real' pixel dimensions of HEIF/HEIC and JPEG images without decoding them. |
Beta Was this translation helpful? Give feedback.
-
|
A dilemma I run into is camera backup from my phone. I want my photos from my phone immediately available, so I turn-on camera backup. But I also manually copy my camera photos to my external library every month because my external library is my "single source of truth" as it's accessible outside of Immich. I need a rule to always delete the duplicate in the camera backup if a dupe exists in external library. |
Beta Was this translation helpful? Give feedback.
-
|
Prefer to keep photos already in an album. |
Beta Was this translation helpful? Give feedback.
-
|
Hi. I'm a Google Photo use from years. I have my home Immich server and I push to it my 450 Go of media from Google Takeout. |
Beta Was this translation helpful? Give feedback.
-
|
Another one bumping this feature. I'm using immich-go to import from Google Photos, but the dupe detection is not perfect, leaving most of the work to be done in Immich itself. Would be great to have the ability to prefer assets already in albums. |
Beta Was this translation helpful? Give feedback.
-
|
immichDuplicate.html.zip |
Beta Was this translation helpful? Give feedback.
-
|
I want the option to be able to 'skip' and 'ignore'. Currently I have multiple albums that are of different resolutions but same file name. IE: WebRes, FullRes, Raw. I don't want any of those removed. Maybe be able to see which albums the dupes are in and then uncheck it from looking in there anymore? |
Beta Was this translation helpful? Give feedback.
-
|
An "undo" button and the ability to not classify assets as dupes if they have different filenames (e.g. IMG_1234 and IMG_1235) would be nice as well. |
Beta Was this translation helpful? Give feedback.
-
|
As mentioned initially, regarding de-duplication: Select one or more preferred libraries for resolving duplicates. Images from these libraries will be selected to keep (or will be automatically kept in case of resolving all duplicates), and images from all other libraries will be deleted unless you define additional criteria. |
Beta Was this translation helpful? Give feedback.
-
|
As someone who is having to go through 8000+ duplicates found by the utility manually, this would seriously be a god send. I want to add a rule to prioritize auto selection of a date timestamp instead of a generic "img_2492.jpg" |
Beta Was this translation helpful? Give feedback.
-
|
I would find ability to review dups associated with images in a particular album useful. |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
Hey everyone! |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
I changed the way here you select the preferred libbrary, now you can choose between internal external or leave default.
The logic prior to preference has not been changed. What do you think of this implementation? @jjmonester @bo0tzz |
Beta Was this translation helpful? Give feedback.
-
|
The critical duplication "rule" for me that is missing is the ability to exclude certain albums (id take an option to exclude all of them) from comparison. For example I have my wedding photos in my immich which due to the nature of them I have ~1000 items that need deduplicating, but 99% of it is photos I definitely want to keep. |
Beta Was this translation helpful? Give feedback.
-
|
any news on when this will be available? |
Beta Was this translation helpful? Give feedback.
-
|
Duplicate Tool could not only delete photos, but also merge META information. I have a lot of duplicates in my library, and it often happens that a photo I want to keep because of its image, does not have all the EXIF data that the photo I am deleting has. This would add the EXIF information from the deleted photo to the one I want to keep. It would be great if we could consider the Duplicate tool as a merge tool — something like Merge Contacts in your Contacts app. |
Beta Was this translation helpful? Give feedback.
-
|
Similar to the proposal from @dhlavaty, often times there is duplicate with lower quality that has ended up in an album but the better one is not in album. This is often the case when someone has performed Google Photos upload and also managed to get the original photos uploaded too. Proposing option when a deleted photo was in a album, there to be option to be replaced with some of the photos that were kept.
|
Beta Was this translation helpful? Give feedback.
-
|
I hope this feature gets implemented soon with some options.
This would mean if the higher resolution file is jpg then discard the heic |
Beta Was this translation helpful? Give feedback.
-
|
I am removing duplicates. |
Beta Was this translation helpful? Give feedback.





Uh oh!
There was an error while loading. Please reload this page.
-
I have searched the existing feature requests to make sure this is not a duplicate request.
The feature
Great job with the duplicate feature.
I have 75,000 dupes! So while I click away, I have had some time to think about how the "recommendations" might be more finely tuned.
ex. If photo resolution is the same and a HEIC and JPG show as dupes, immich usually recommends the JPG as the file size as bigger. However, I prefer the HEIC because of the compression and the live photo
another one - if an item exists in an external library and in the immich library and the resolutions are the same, I prefer the external library version.
I'm sure others have different opinions, but that's why it would be nice to be able to define our own rules.
Thanks for the project!
Platform
Beta Was this translation helpful? Give feedback.
All reactions