biomed-shifts:full

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision		 Previous revision
biomed-shifts:full [2016/02/01 15:40] – created fmichelbiomed-shifts:full [2016/05/23 11:37] (current) – [DPM and dCache] fmichel
Line 3: Line 3:
 =====  Identification of full SEs  ===== =====  Identification of full SEs  =====
  
-Some SEs are shared with other VOs, therefore biomed users may not be responsible for an SE being full. To figure out if biomed is a heavy user of that SE or not, check the last VAPOR's [[https://operations-portal.egi.eu/vapor/vapor-sesScanHistory?vo=biomed|space usage report]], and pick up those with **less than 10% AND less than 500 GB of free space left**.+Some SEs are shared with other VOs, therefore biomed users may not be responsible for an SE being full. To figure out if biomed is a heavy user of that SE or not, check the last VAPOR's [[http://operations-portal.in2p3.fr/vapor/jobmon/vaporDataManSEsScanHistory|space usage report]], and pick up those with **less than 10% AND less than 500 GB of free space left**.
  
 Then, before going further, **check that the SEs do not fall into one of the following cases**: Then, before going further, **check that the SEs do not fall into one of the following cases**:
Line 20: Line 20:
   -  Put a link or attach the files list in the ticket.   -  Put a link or attach the files list in the ticket.
   -  Notify the concerned users by email, and require them to move or delete their data:   -  Notify the concerned users by email, and require them to move or delete their data:
-    *  Go to the last VAPOR [[https://operations-portal.egi.eu/vapor/vapor-sesScanHistory?vo=biomed|catalog-based SE scan]] __with minimum used space = 0__, look for SE, and follow the link "Show email template", then copy and paste the different fields (TO, SUBJECT and the body) into a new email. Set Reply-to=biomed-technical-support [NOSPAM][AT] googlegroups.com. You may also use the [[Biomed-Shifts:FullSE_Template|email template]] instead.+    *  Go to the last VAPOR [[http://operations-portal.in2p3.fr/vapor/jobmon/vaporDataManSEsScanHistory|catalog-based SE scan]] __with minimum used space = 0__, look for SE, and follow the link "Show email template", then copy and paste the different fields (TO, SUBJECT and the body) into a new email. Set Reply-to=biomed-technical-support [NOSPAM][AT] googlegroups.com. You may also use the [[Biomed-Shifts:FullSE_Template|email template]] instead.
     *  Attach the list of files to the email.     *  Attach the list of files to the email.
   -  Send reminders to users every week until at least 90% (or at least 500 Go for big SEs) of the SE space is free. Note that you may need to contact the site admins in order to get the accurate value of the storage space for biomed (see https://ggus.eu/index.php?mode=ticket_info&ticket_id=58733).   -  Send reminders to users every week until at least 90% (or at least 500 Go for big SEs) of the SE space is free. Note that you may need to contact the site admins in order to get the accurate value of the storage space for biomed (see https://ggus.eu/index.php?mode=ticket_info&ticket_id=58733).
Line 34: Line 34:
  
 ====  DPM and dCache  ==== ====  DPM and dCache  ====
-VAPOR [[https://operations-portal.egi.eu/vapor/vapor-sesCleanupHistory?vo=biomed|automatic cleanup of dark data]] applies to **DPM** and **dCache** Storage Elements, using the GFAL API with GSIFTP access URLs.+VAPOR [[http://operations-portal.in2p3.fr/vapor/jobmon/vaporDataManSEsCleanupHistory|automatic cleanup of dark data]] applies to **DPM** and **dCache** Storage Elements, using the GFAL API with GSIFTP access URLs.
  
 ====  StoRM  ==== ====  StoRM  ====
 StoRM SEs do not support GSIFTP as an access protocol, only SRM is available but it is very limited and does not allow long listing (limit to 2000 files by directory). StoRM SEs do not support GSIFTP as an access protocol, only SRM is available but it is very limited and does not allow long listing (limit to 2000 files by directory).
 As a result, **the clean-up of a StoRM SE cannot be done from the user side only**: it must involve an action on the administrator side, to get the dump of biomed files on the SE. As a result, **the clean-up of a StoRM SE cannot be done from the user side only**: it must involve an action on the administrator side, to get the dump of biomed files on the SE.
 +
 +=> Use this [[Biomed-Shifts:dumpse_ticket_template|ticket template]] to request a dump from the site admin.
  
 This [[https://github.com/frmichel/vo-support-tools/tree/master/SE/cleanup-se-storm|tool]] compares a dump provided by an admin with an LFC dump and removes dark data files on the SE. This [[https://github.com/frmichel/vo-support-tools/tree/master/SE/cleanup-se-storm|tool]] compares a dump provided by an admin with an LFC dump and removes dark data files on the SE.
  • biomed-shifts/full.1454341257.txt.gz
  • Last modified: 2016/02/01 15:40
  • by fmichel