Recurrent Neural Networks: building GRU cells VS LSTM cells in Pytorch
What are the advantages of RNN’s over transformers? When to use GRU’s over LSTM? What are the equations of GRU really mean? How to build a GRU cell in Pytorch?
Related Articles
PyMC Open Source Development
In this episode of Open Source Directions, we were joined by Thomas Wiecki once again who talked about the work being done with PyMC. PyMC3 is a Python package for Bayesian statistical modeling and Probabilistic Machine Learning focusing on advanced Markov chain Monte Carlo (MCMC) and variational inference (VI) algorithms. Its flexibility and extensibility make it applicable to a large suite of problems.
Attention Mechanism
What is Attention, and why is it used in state-of-the-art models? This article discusses the types of Attention and walks you through their implementations.
Jupyter & Nteract Open Source Development
In this episode of Open Source Directions we were joined by Matthew Seal who talked about the work he has been doing with Jupyter and Nteract. Matthew also discussed a particular topic: common Jupyter tools and their adoption for various use cases in the wild.
SymPy Open Source Development
In this episode of Open Source Directions, we were joined by Aaron Meurer who will talk once again with Oscar Benjamin about the work he has been doing with SymPy. SymPy is a Python library for symbolic mathematics. It aims to become a full-featured computer algebra system (CAS) while keeping the code as simple as possible in order to be comprehensible and easily extensible. SymPy is written entirely in Python.
Data Science, Open Source Software, and Their Communities
In this episode, I was fortunate enough to speak with Peter Wang, the CEO of Anaconda. Anaconda is a distribution for the Python and R programming languages for scientific computing. It’s recognized as the heart of the open source data science community.
