Skip to Main Content
Improve Capture One

Request a new feature, or support for a camera/lens that you would like to use in Capture One.

Status Awaiting review
Workspace Feature requests
Categories Capture One Pro
Created by Guest
Created on Jan 16, 2024

Time taken to exclude duplicates when importing

What problem do you see this solving?

I have a 32Gb SD card with 957 raw files on it. I can import a batch of files successfully. I then ask to import another batch. If the first batch contained a large number of files and I have 'exclude duplicates' selected in takes far too long before I can see the remaining files on the card.

When was the last time you were affected by this lack of functionality, or specific tool?

This slows up my workflow.

Current workaround

Are you using any workarounds or other solutions to achieve your goals in Capture One?

If Capture One could holdin short term memory which files had already been downloaded and thumbnails of all those not yet downloaded the whole process could be sped up up considerably. I appreciate that if I eject the SD card and start again then Capture One will also need to start again. Apologies if this is not clear but I have no idea of what is possible. Thank you

  • JR Peterson
    Reply
    |
    Sep 2, 2024

    I appriciate that there may be a desire by developers to be absolutely certain that the files truly are duplicates before potientially ignoring them and the user wipeing the card. Adding a second option "ignore suspected duplicates" that rapidly ignores files based on filesystem metadata would be a real performance boost. I often import data, then add more images to the SD card, the later imports become painful.

  • Wolfgang Stoiber
    Reply
    |
    Jan 17, 2024

    One would think, in today's time of AI hype and all, could these tasks (including relinking missing photos, etc) be done more intelligently...

    instead of using AI to do my actual creative job, which I did not choose out of boredom ;)

  • Walter Rowe
    Reply
    |
    Jan 17, 2024

    Synchronize Folder also takes an inordinate amount of time. When you Synchronize it clearly identifies which files are new because it shows a count of them. When you press Sync it still counts through ALL of the images when it could simply import the ones it already identified.

  • Wolfgang Stoiber
    Reply
    |
    Jan 17, 2024

    ...and to explain why this can matter:

    I have two 128GB CFcards which I bought for occasional video jobs. Using a 24MP still camera I can leave the images on the cards for a LOOONG time (an easy backup) until I swap to the other card, which I then empty before using it for the first shoot. 

    So, opening the import window becomes very slow for me, because there are ~2000-3000 RAWs on it and I only need the last 300 - or better "the ones from the last shoot".

    (For comparison, Lr Classic (6.14) does the same thing, but at least lets me quickly select all photos by date in the import dialog so I don't have to wait for the previews.)

  • Wolfgang Stoiber
    Reply
    |
    Jan 17, 2024

    CaptureOne introduced the import grouping feature to show they care about import speed. That may speed up _some_ workflows but the main problem stays:

    IMHO the real bottleneck is obviously reading ALL the RAW files into memory to show me the previews and ONLY AFTER THAT try to "exclude the duplicates" from this long list.

    I use a somewhat fast card reader and have fast internal SSD therefore copying all the RAWs via filesystem is literally as fast as opening the import dialog, let it display the previews, sorting out duplicates BEFORE even starting the import.

    A better solution would be if the import window would FIRST check the card's contents by file system metadata (e.g. fast checking only filename and creation date) and remove duplicates from its internal list and THEN read from the card ONLY the remaining images's previews.

  • +2