document all places where CRABCache is used

[belforte]

document all places where CRABCache is used and describe the needed functionality

i.e. look for all places where there are references to
https://github.com/dmwm/CRABServer/tree/master/src/python/UserFileCache

[ddaina]

@belforte I had first look into this task and tried to list files that uses UserFileCache. I documented it in excel, once we get through review cycle and come to the final result, I will copy it here for documentation purpose.

For now, you can find file here.

[belforte]

thanks, looks good. See also dmwm/CRABClient#4971

[belforte]

I am turning that spreadsheet into a list items below. I have also updated the spreadsheet with comments as appropriate.

Will mark tasks below as closed once they have their own GH issues so we close this as "done with making the list".

• use S3 for DryRun tarball uploading in TW/DryRunUploder.py ( use S3 to upload tarball needed for DryRun #6465 ) and in submit --dry in client ( replace CRABCache use with CERN S3 CRABClient#4971 (comment) )
• remove "sandbox touching" in tape recall recurring action when sandbox is in S3 ( Remove sandbox touching in tape recall recurring action #6466 )
• upload TW log to S3 ( Modify TW to upload log to S3 instead of crabcache #6459 )
• figure out that to do with https://github.com/dmwm/CRABServer/blob/master/setup.py ( remove UserFileCache from setup.py #6467 )
• verify if there is references to crabcache in old, unused CRAB Client test file https://github.com/dmwm/CRABClient/blob/master/test/python/CRABClient_t/JobType_t/CMSSW_t.py and remove it
• once CrabClient code does not use old crabcache anymore, remove reference to it from https://github.com/dmwm/CRABClient/blob/master/src/python/CRABClient/Emulator.py ( remove references to RESTInteractions and UserFileCache in Emulator.py CRABClient#4979 )

@ddaina please cross check that I did not forget something, thanks

[ddaina]

verify if there is references to crabcache in old, unused CRAB Client test file https://github.com/dmwm/CRABClient/blob/master/test/python/CRABClient_t/JobType_t/CMSSW_t.py and remove it

indeed, crabcache is not used there. we can mark it is done.

Also, I cannot find in this list issue that would cover this use case: https://github.com/dmwm/CRABServer/blob/master/src/python/TaskWorker/Actions/DagmanCreator.py#L1157-#L1174

[belforte]

well spotted. I added a note [here]9#6457 (comment))