Daniel Voigt Godoy

Daniel Voigt Godoy

Data Scientist and Author of Deep Learning with PyTorch Step-by-Step

Daniel has been teaching machine learning and distributed computing technologies at Data Science Retreat, the longest-running Berlin-based bootcamp, for more than three years, helping more than 150 students advance their careers. He writes regularly for Towards Data Science. His blog post "Understanding PyTorch with an example: a step-by-step tutorial" reached more than 220,000 views since it was published. The positive feedback from the readers motivated him to write the book Deep Learning with PyTorch Step-by-Step, which covers a broader range of topics. Daniel is also the main contributor of two python packages: HandySpark and DeepReplay. His professional background includes 20 years of experience working for companies in several industries: banking, government, fintech, retail and mobility.

All Sessions by Daniel Voigt Godoy

Day 1 09/05/2024
1:05 pm - 2:05 pm

Fine-Tuning LLMs 101

<span class="etn-schedule-location"> <span class="firstfocus">LLMs</span> <span class="secfocus">All Levels</span> </span>

In this short workshop, you'll get to fine-tune a language model on a custom dataset. We'll cover the main challenges and the building blocks of the fine-tuning procedure: model quantization, parameter-efficient fine-tuning (PEFT) and low-rank adapters (LoRA), chat templates and dataset formatting, and training arguments such as gradient checkpointing, gradient accumulation, sequence length, and optimizers. We'll use Google Colab, BitsAndBytes, and several Hugging Face libraries (peft, datasets, and transformers).

Day 1 09/05/2024
1:05 pm - 2:05 pm

Fine-Tuning LLMs 101

<span class="etn-schedule-location"> <span class="firstfocus">LLMs</span> <span class="secfocus">All Levels</span> </span>

In this short workshop, you'll get to fine-tune a language model on a custom dataset. We'll cover the main challenges and the building blocks of the fine-tuning procedure: model quantization, parameter-efficient fine-tuning (PEFT) and low-rank adapters (LoRA), chat templates and dataset formatting, and training arguments such as gradient checkpointing, gradient accumulation, sequence length, and optimizers. We'll use Google Colab, BitsAndBytes, and several Hugging Face libraries (peft, datasets, and transformers).

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from - Youtube
Vimeo
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google