Using torch modules
In this third installment of our mini-series introducing torch basics, we replace hand-coded matrix operations by modules, considerably simplifying our toy network’s code.
Related Articles
Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond
Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more.
Distilling knowledge from Neural Networks to build smaller and faster models
This article discusses GPT-2 and BERT models, as well using knowledge distillation to create highly accurate models with fewer parameters than their teachers
CycleGAN: Unpaired Image-to-Image Translation (Part 3)
Table of Contents CycleGAN: Unpaired Image-to-Image Translation (Part 3) Configuring Your Development Environment Need Help Configuring Your Development Environment? Project Structure Implementing CycleGAN Training Implementing Training Callback Implementing Data Pipeline and Model Training Perform Image-to-Image Translation Summary Citation Information CycleGAN:…
The post CycleGAN: Unpaired Image-to-Image Translation (Part 3) appeared first on PyImageSearch.
Attention Mechanism
What is Attention, and why is it used in state-of-the-art models? This article discusses the types of Attention and walks you through their implementations.
Introduction to Adversarial Machine Learning
Machine learning advancements lead to new ways to train models, as well as deceive them. This article discusses ways to train and defend against attacks.
