I am testing the Enterprise content manager 6.x. I have a usecase in which I have to upload 120 million documents to Alfresco. Alfresco will be used mainly as content store (i.e. without any seach functionality that Alfresco provides). There is an application which will call Alfresco to get a document based on a document identifier. At this point, I have created a folder in Repository. Using Java batch, I am uploading the documents along with their meta data to this folder (for testing, I have uploaded around 500k documents). The loading goes thru without any issues. However when accessing this folder the application freezes / crashes. From the forums, it looks like, we should not create more than 10,000 documents in a folder. https://hub.alfresco.com/t5/alfresco-content-services-forum/large-folders-in-the-content-repository/...
Based on this link, I am thinking of creating folder for a date and then about 1000 subfolders (For certain dates I have 1 million documents. With 1000 subfolders, I can limit the numbers to less than 10,000 per folder). The structure of the folders will be as follows :
<Parent Folder: Application XYZ>
<sub folder 2020-06-01 -0001>
<sub folder 2020-06-01 -0002>
<sub folder 2020-06-01 -0003>
I have few questions :
1 - Is there a way to automatically create this folder structure in Aflresco? At the start of the day, I want to create this folder structure automatically. I would like to avoid writing any custom routine / batch to create these folders.
2 - I am planning to load the document in main parent folder. The document will have a meta data for create date. Can I apply a rule which will move the document to the correct folder based on the create date of the document and last three digits of another meta data - document number.
3. I need Alfresco to generate a document number and associate it with the document that is being saved. It looks like there is a module available https://hub.alfresco.com/t5/alfresco-content-services-add/alfresco-numbering-redpill/td-p/289334
I am not sure if it is supports by Alfresco 6.x Has this been used in any implmentation? If yes, can you let me know the steps? Also let me know if there is any other alternative for this functonality.