[Clas12_software] CLAS12 AI/ML Group Meeting

[Richard Tyson]

Hi All,

We will have a CLAS12 AI/ML Group meeting tomorrow, Thursday September 4th,  at 11 AM.

The Zoom meeting information and agenda are included below. Tomorrow we will have a presentation by Casey Morean. His presentation covers deploying large language models at JLab using vLLM with an API gateway, designed to leverage shared GPU farm resources and eventually dedicated hardware. Casey will highlight integration with RAG systems for domain-specific use cases, and propose a fine-tuning strategy using QLoRA to reach higher performance on user driven use cases.

As a reminder, please see the wiki<https://clasweb.jlab.org/wiki/index.php/CLAS12_AI_Group> <https://clasweb.jlab.org/wiki/index.php/CLAS12_AI_Group> and mailing list<https://mailman.jlab.org/mailman/listinfo/clas12_ai> for more information.

Best regards,
Richard Tyson

Agenda:

  *
On-Prem LLM Deployment with vLLM and LibreChat (Casey Morean)

Zoom Meeting Link
https://jlab-org.zoomgov.com/j/1605356551?pwd=77EQaaawZkral5NkAzsOZgUHJJHUnZ.1

Meeting ID: 160 535 6551
Passcode: 804001



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/clas12_software/attachments/20250903/e99175a6/attachment.htm>