Self-supervised learning tutorial: Implementing SimCLR with pytorch lightning
Learn how to implement the infamous contrastive self-supervised learning method called SimCLR. Step by step implementation in PyTorch and PyTorch-lightning
Related Articles
SimPer: Simple self-supervised learning of periodic targets
Posted by Daniel McDuff, Staff Research Scientist, and Yuzhe Yang, Student Researcher, Google Learning from periodic data (signals that repeat, such as a heart beat…
CycleGAN: Unpaired Image-to-Image Translation (Part 3)
Table of Contents CycleGAN: Unpaired Image-to-Image Translation (Part 3) Configuring Your Development Environment Need Help Configuring Your Development Environment? Project Structure Implementing CycleGAN Training Implementing Training Callback Implementing Data Pipeline and Model Training Perform Image-to-Image Translation Summary Citation Information CycleGAN:…
The post CycleGAN: Unpaired Image-to-Image Translation (Part 3) appeared first on PyImageSearch.
Attention Mechanism
What is Attention, and why is it used in state-of-the-art models? This article discusses the types of Attention and walks you through their implementations.
Distilling knowledge from Neural Networks to build smaller and faster models
This article discusses GPT-2 and BERT models, as well using knowledge distillation to create highly accurate models with fewer parameters than their teachers
Future of The Dry-Python Project
In this episode, we were joined by Nikita Sobolev, CTO at Drylabs, who talked about the future of the dry-python project. dry-python is a set of libraries for pluggable business logic components which Includes:
