Are you looking for a place to learn Deep Learning? Whether you are a beginner or an experienced Machine Learning Engineer, I am sure you will find the below collection useful.
In this post, we gathered together all of our resources and organized them in a step by step guide to help you learn all the popular Deep Learning architectures and algorithms as efficiently and as fast as possible.
You will also find articles focused on specific applications such as Computer Vision and Natural Language Processing (NLP) but also posts about how Reinforcement Learning works.
So, without further ado, let’s get started…
Deep Learning Architectures
Neural network library from scratch
In this post, you will build a Feedforward Neural Network from scratch using C++. You will implement the backpropagation algorithm, define the network’s structure and train it in GPU using OpenCL
Convolutional Neural network library from scratch
In the second part, you will extend the library by including Convolutional neural networks. You will define the convolutional and pooling layers and program the OpenCL kernels to run the backpropagation in parallel.
Intuitive Explanation of Skip Connections in Deep Learning
What are skip connections, why they solve the vanishing gradient problem and how they are applied to popular Convolutional Neural Network architectures such as ResNet, DenseNet and UNet.
Predict Bitcoin price with LSTM
Learn how recurrent neural networks works, what are LSTMs and what problem do they solve and finally use one to predict the bitcoin price using Python and Keras
How to Generate Images using Autoencoders
The inner working of Autoencoders, what is a Variational Autoencoder (VAE) and how they can be used to generate original new images using PyTorch
Decrypt Generative Artificial Intelligence and GANs
How Generative models differ from other machine learning architectures, how Generative Adversarial Networks (GAN) learn from data and why they are able to generate new data points?
Graph Neural Networks
Neural Networks can also be applied in graph data besides images and text. Graph Neural Networks have the ability to take a Graph as an input and encode its information into a single numeric vector.
Explain Neural Arithmetic Logic Units (NALU)
Neural Arithmetic Logic Units solve a problem that most machine learning architectures can’t tackle. They are able to count. With NALU we can perform arithmetic operations such additions and multiplications and approximate simple arithmetic functions.
Computer Vision and Deep Learning
Semantic Segmentation in the era of Neural Networks
In semantic segmentation, the goal is to classify each pixel of the image in a specific category based. That way we can extract contextual information of every object in the image. To achieve this, skip connections are used in neural networks, forming a new architecture called UNets.
Understand how UNets work, why the perform well in semantic segmentation and program one using Keras.
Localization and Object Detection with Deep Learning
Localization is the task of identifying the location of an object in an image, while Object Detection is the classification and detection of all objects in it. To do this, the most popular method is an R-CNN alongside with its improvements Fast R-CNN and Faster R-CNN.
YOLO - You only look once
SIngle shot detectors like YOLO provide a fast way to detect and localize objects in an image. In this post, you will learn the secrets behind YOLO and why it became the industry standard in low-power devices such as smartphones.
Applications
Self-driving cars using Deep Learning
Learn the basics steps behind the development of a car’s autopilots and use a game simulator and python to make your own car drive all by itself.
Human Pose Estimation
This is an overview of the most important research papers on 2D and 3D Human Pose Estimation. You will find intuitive explanations on algorithms like OpenPose, DensePose and VIBE.
Deep learning in medical imaging: 3D medical image segmentation with PyTorch
In this document, we tackle the 3D medical image segmentation with deep learning models using PyTorch. The basic MRI foundations are presented for tensor representation, as well as the basic components to apply a deep learning method that handles the task-specific problems(class imbalance, liited data). Moreover, we present some features of the open source medical image segmentation library. Finally, we discuss our preliminary experimental results and provide sources to find medical imaging data.
Reinforcement Learning
The secrets behind Reinforcement Learning
The purpose of this article is to give you an idea of the fundamentals principles behind reinforcement learning, how we define our agent, the environment and the learning process. It also includes an overview of the different types of RL algorithms and the basic logic behind them.
Deep Q Learning
Here we dive into Q Learning, we analyze what exactly the Q value is and how we can approximate it and also how neural networks and deep learning revolutionize this technique. You will also find code examples on how to build your own Deep Q Learning agent in Python.
Taking Deep Q Networks a step further
As a continuance of the previous post, here we introduce topics like Moving and Fixed Q targets, concepts like Maximation Bias and Experience Replay and we describe how Double Deep Q Networks and Dueling Deep Q Networks improve over the original idea
Unravel Policy Gradients and REINFORCE
What are policy-based methods, why they are different from value-based methods and what’s the idea behind Monte Carlo policy gradients (aka REINFORCE). As always python code is available in the end.
The idea behind Actor-Critics and how A2C and A3C improve them
In this article, you will learn about actor critics and many variations of them such as Advantage Actor-Critics (A2C) and Asynchronous Advantage Actor-Critics (A3C)
Trust Region and Proximal policy optimization (TRPO and PPO)
Returning to policy methods, we present two of the most recent algorithms in the field: Trust region policy optimization (TRPO) and Proximal policy optimization (PPO)
Conclusion
That’s all. But for now. We are constantly producing new content so expect the list to be updated frequently.
If you managed to read all of them, let me say that you are awesome.
Also, if you think that something is missing, don’t hesitate to contact us and suggest a topic. We want to keep the article as complete as possible.
And don’t forget to subscribe to our newsletter to be notified when a new article is out.
Stay tuned and keep learning Deep Learning.
* Disclosure: Please note that some of the links above might be affiliate links, and at no additional cost to you, we will earn a commission if you decide to make a purchase after clicking through.