Working with large language models using Megatron-DeepSpeed on LUMI

3 Jun 2024, 14:00
2h

Speaker

Maciej Szpindler (ACK Cyfronet)

Description

This builds up on details from the first part to setup specific environment for LLM processing. It uses Megatron-DeepSpeed framework to experiment with pretrained data for prompt engineering tasks.

https://events.plgrid.pl/event/55/

Primary author

Maciej Szpindler (ACK Cyfronet)

Presentation Materials

There are no materials yet.
Your browser is out of date!

Update your browser to view this website correctly. Update my browser now

×