[Hadstruct] Fw: NOTICE: Migration of your data to a new Lustre file-system

[Joseph Karpie]

Hey yall,

Please make sure that if you have files on cache that they are above the small size limit. If you have small things tar them together before the migration happens.

Best,
Joe
________________________________
From: lqcd-users <lqcd-users-bounces at jlab.org> on behalf of Amitoj Singh via lqcd-users <lqcd-users at jlab.org>
Sent: Friday, February 6, 2026 10:32 AM
To: lqcd-users at jlab.org <lqcd-users at jlab.org>
Subject: Re: [lqcd-users] NOTICE: Migration of your data to a new Lustre file-system

Dear LQCD JLab compute and storage users,

      The JLab Scientific Computing Operations team will be commencing the migration of data from existing /volatile and /cache filesystems to the new Lustre filesystem next week. The first migration will be followed by several sweeps to catch up on any subsequent filesystem changes for the rest of the month.

      Please take notice and action on my previous email (appended below) about small files (<1MB) since these will be excluded in the data migration.

      If you have any questions or concerns, please do not hesitate to email me directly.


Amitoj Singh,

HPC Architect

High Performance Data Facility

Computational Sciences and Technology Division

Thomas Jefferson National Accelerator Facility



From: Amitoj Singh <amitoj at jlab.org>
Date: Wednesday, January 14, 2026 at 11:05 AM
To: lqcd-users at jlab.org <lqcd-users at jlab.org>
Subject: NOTICE: Migration of your data to a new Lustre file-system

Dear LQCD JLab compute and storage users,

      As we get ready to deploy a new 4PB Lustre-filesystem based storage hardware we need to address the topic of migrating existing data with small files from /volatile and /cache storage areas to the new filesystem. Small files are a performance killer for the Lustre filesystem and will slow down the data migration process and so we would like to take the opportunity to bring this to your attention.

      Small files are defined as files that have sizes less than 1MB.

      As of now we plan to not migrate any small files to the new storage system. To mitigate this, we encourage everyone to please do the following:


  1.
Check your group/project small file count in /volatile and /cache using this following web pages -> link to volatile<https://lqcd.jlab.org/lqcd/volatileDisk/project>, link to cache<https://lqcd.jlab.org/lqcd/cacheDisk/project>
  2.
Do the following to reduce your small file count:
     *
delete files that are no longer needed -OR-
     *
compress small files into a single file -OR -
     *
move small files to /work.

If you have any questions or concerns, please do not hesitate to email me directly.


Amitoj Singh,

HPC Architect

High Performance Data Facility

Computational Sciences and Technology Division

Thomas Jefferson National Accelerator Facility


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/hadstruct/attachments/20260206/abbbf1ed/attachment.htm>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: ATT00001.txt
URL: <https://mailman.jlab.org/pipermail/hadstruct/attachments/20260206/abbbf1ed/attachment.txt>