[Rtdp] Hall-B -> EJFAT transfer speed.

David Lawrence davidl at jlab.org
Thu Dec 14 08:38:31 EST 2023


Hi All,

  Beam in Hall-B was unexpectedly down for a couple of hours this morning so I took advantage and
ran som bandwidth tests to the ejfat-fs-daq node from clonfarm21sro. I cut and pasted some of the
details into a wiki page at the link below. Here is the summary of what I found:


  1.  iperf3 does not report rates as high as iperf(2)
     *   (I copied /usr/bin/iperf from efat-fs-daq to a temporary directory on clonfarm21sro to use it)
  2.  Can achieve 99Gbps between ejfat-2 and ejfat-fs-daq
  3.  Can achieve 75Gbps between clonfarm21sro and ejfat-fs-daq
     *   n.b. 75Gbps is a reasonably reliable average, but it fluctuates. The highest I saw was just over 80Gbps, but not sustained.
  4.  UDP is very limited (~1Mbps/thread). Possibly due to maximum allowed packet size on the system.
  5.  Routing from ejfat-fs-daq to clonfarm21sro is broken so only connections initiated from clonfarm21sro can be made at the moment.

The wiki page has exact commands run which include window and buffer sizes as well as number of
streams.

https://wiki.jlab.org/epsciwiki/index.php/Hall-B_to_EJFat_transfer_speeds




Regards,
-David

-------------------------------------------------------------
David Lawrence Ph.D.
Staff Scientist - - EPSCI Group Lead
Thomas Jefferson National Accelerator Facility
Newport News, VA
davidl at jlab.org
(757) 269-5567 W
(757) 746-6697 C


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/rtdp/attachments/20231214/f4e56ac9/attachment.html>


More information about the Rtdp mailing list