Skip to Main Content
Improve Capture One

Request a new feature, or support for a camera/lens that you would like to use in Capture One.

Status Awaiting review
Workspace Feature requests
Categories Capture One Pro
Created by Nicolas Det
Created on Nov 3, 2023

Catalog backup as Zip/Tar/7Zip

What problem do you see this solving?

Along side with sessions which I use for pro work, I have a big catalogue (15 Gb).for all my private and own projects. It's big and old (was imported from Lr!). Trying to backup that catalogue takes about one day (yes 24 hours !). It looks like it contains a lot of empty folder (like >100k) so the copy seens quite complicated and takes soo much time.

In the end, I do not backup it a lot because it's too slow.

-> Instead of copying the whole folder with héach subfolders and files, pack everything in a zip/tar/7zip/lha (whatsoever).

-> Try to not create empty subfolder in the catalog

When was the last time you were affected by this lack of functionality, or specific tool?

Each time I try to backup my big catalogue

Current workaround

Are you using any workarounds or other solutions to achieve your goals in Capture One?

Yes! I'm using the little tool "7Zip". Instead of asking C1 to do the backup ot to copy manually in Explorer the catalog folder, I just "7zip" it info the backup drive. It takes 20-25 minutes.

  • Walter Rowe
    Reply
    |
    Nov 9, 2023

    373245276637 – did you try importing your catalog into a new catalog? I'm anxious to see if this cleans up your catalog folders.

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    SFA has a great suggestion.

    1. Create a new empty catalog.
    2. File > Import Catalog > Capture One catalog.

    This will safely import the catalog and perhaps not recreate all those empty folders. Once that import is complete you can check if the new catalog has the same empty folders. If it does, provide that feedback here. If it doesn't then try backing up the new catalog. See if it goes faster.

  • Nicolas Det
    Reply
    |
    Nov 3, 2023

    Yeah, there might be some trick to clean the catalogue.

    However, empty catalogue have a HUGE effect on filesystem / IO performances. Unfortunately.

  • Nicolas Det
    Reply
    |
    Nov 3, 2023

    I actually never "dare" to touch to much my catalog. But indeed, it might help. If wou wish we could keep in touch and try next week. I am running out of time.

    Do you work for C1 ?

  • Grant Perkins
    Reply
    |
    Nov 3, 2023

    Nicolas,

    Do you know where the empty folder came from?

    Were they something created as part of the Lr catalog conversion?

    Have you considered creating a new catalog and importing the old one to see if it tidies up?

    Or just Export the old catalog to a new catalog. 

    (In both the above cases it may be better to undertake the work in sections it you can work out how to assess any improvement in total size for just a partial copy.)

    On the other hand, empty folders of zero size would seem to be worthless, as you point out, but also should not greatly affect the size of the catalog on disk unless each is allocated a block and the block size set is large. Even then difference would probably not be that great.

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    I agree a compressed format also would be better. I provide 1-on-1 assistance to Capture One users over Zoom. Multiple users I have helped have gotten themselves into trouble because they opened and started using one of their backups. Each backup folder looks exactly like a catalog folder. Making it a compressed archive format of some type would prevent that.

  • Nicolas Det
    Reply
    |
    Nov 3, 2023

    I do not know. They should just make it better :))

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    Could you make a copy of the catalog, find and remove all the "empty" directories in the copy, and do a verify on that copy? Does Verify complain of missing folders? Does a backup go faster? Is the backup tree smaller? This is all just data gathering to provide to Capture One to more fully inform a solution.

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    Or even better, but everything in a single database file - and optimize that. (?)

    Is SQLite3 capable of holding that kind of binary layer mask data efficiently?

    Would Capture One be slower if updating a layer mask stored in a database vs a file?

  • Nicolas Det
    Reply
    |
    Nov 3, 2023

    Have you run a File > Verify Catalog on that catalog? I don't know if that would clean these up. My suspicion is that it will not. I have also observed that Capture One isn't the best at house keeping in some areas.

    Sure. It makes no difference

     

    I wonder whether this should be considered an "Improvement" or a "Bug". In my opinion Capture One should keep a very tidy folder tree – only create these folders for images with layers, and remove empty folders if all the local adjustment mask (LAM) files inside are deleted.

    Or even better, but everything in a single database file - and optimize that. (?)

    The Verify Catalog process includes a checkbox for "Optimize". I imagine that only applies to the SQLite catalog database.

     

    On Mac? On Windows I could not see that.

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    Have you run a File > Verify Catalog on that catalog? I don't know if that would clean these up. My suspicion is that it will not. I have also observed that Capture One isn't the best at house keeping in some areas.

    I wonder whether this should be considered an "Improvement" or a "Bug". In my opinion Capture One should keep a very tidy folder tree – only create these folders for images with layers, and remove empty folders if all the local adjustment mask (LAM) files inside are deleted.

    The Verify Catalog process includes a checkbox for "Optimize". I imagine that only applies to the SQLite catalog database.

  • Nicolas Det
    Reply
    |
    Nov 3, 2023

    sure. Hier some examples:

     

     

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    Can you look in the backup folder and tell us the path of the "empty folder"? See my edited reply above with screenshots.

    The Adjustments folder contains all of the layer masks of all the images. It can grow quite large. Here is a screenshot of my backups folder showing the latest backup from my primary catalog "Masters". That catalog references 66K images.

    Note the Adjustments folder is nearly 3GB. The more images with more layers, the larger Adjustments will grow.

  • Nicolas Det
    Reply
    |
    Nov 3, 2023

    Not a single photo in the catalog.

    The main issue for the bakup is not the data but mostly the empty folder C1 created.

     

  • Walter Rowe
    Reply
    |
    Nov 3, 2023

    How many images are indexed in your legacy catalog imported from LR? Are they Stored inside the catalog or Referenced? Stored and Referenced catalogs are backed up the same.

    Catalog backups do not include the Originals or Cache folders. They only include the catalog database and Adjustments folder (layer masks).

    I just exported a collection to a new catalog and included the referenced images in the exported catalog. This made the exported catalog a Stored catalog.

     

     

  • Marcin Mrzygłocki
    Reply
    |
    Nov 3, 2023

    15GB are for the database file or everything including photos?

  • +3