Category Archive Medium

Deploying Machine Learning Models Using Docker

Productionize the Flask API for deployment using Docker via nginx, gunicorn and Docker Compose to create a scalable template for deploying machine learning models.

Read the rest of the article at Mindboard’s Medium channel

Investigating RNN Memory Stability

A Recurrent Neural Networks (RNN) is a class of Artificial Neural Network that contains connections along a temporal axis, producing a functioning memory of prior network inferences that influences the network’s output. Two of the most common types of RNN are the Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) cells. LSTMs and GRUs are designed for long-term memory capability. In both cases, the RNN cell maintains a hidden memory state that undergoes an alteration after every inference call.

Read the rest of the article at Mindboard’s Medium channel.

Time-Series Prediction Using A Simple RNN

For deeper networks, the obsession with image classification tasks seems to have also caused tutorials to appear on the more complex convolutional neural networks. This is great if you’re into that sort of thing, however, if someone is more interested in data with timeframes then recurrent neural networks (RNNs) come in handy.

Read the rest of the article at Mindboard’s Medium channel

Advantage function in Deep Reinforcement learning

Deep reinforcement learning involves building a deep learning model which enables function approximation between the input features and future discounted rewards values also called Q values. We have seen how we can effectively get these q values and create a map consisting of input features and corresponding set of q values in this article.

This map of input features and all possible q values at a given state enables the Reinforcement learning agent get an overall picture of environment which further helps the agent in choosing the optimal path.

Read the rest of the article at Mindboard’s Medium channel.

LSTM vs GRU: Experimental Comparison

A Recurrent Neural Network is a type of Artificial Neural Network that contains shared neuron layers between its inputs through time. This allows us to model temporal data such as video sequences, weather patterns or stock prices. There are many ways to design a recurrent cell, which controls the flow of information from one time-step to another. A recurrent cell can be designed to provide a functioning memory for the neural network. Two of the most popular recurrent cell designs are the Long Short-Term Memory cell (LSTM) and the Gated Recurrent Unit cell (GRU).

Read the rest of the article at Mindboard’s Medium channel.

LSTM for Time Series Prediction — Part I

A time series contains a sequence of data points observed at specific intervals over time. A time series prediction uses a model to predict future values based on previously observed values. The natural temporal order of time series data makes analysis of time series different from cross-sectional or spatial data analyses, neither of which depends on a time component.

Time series predictions can be useful in a variety of settings, from processing signal data streaming from a sensor at an industrial site to monitoring trends in a financial market or maintaining inventory in a commercial setting. In all these scenarios, recent data can be used to inform predictions about future goal values.

Read the rest of the article at Mindboard’s Medium channel.

Input Window Size for Deep Recurrent Reinforcement Learning

Deep Recurrent Reinforcement Learning makes use of a Recurrent Neural Network (RNN), such as Long Short-Term Memory (LSTM) or Gated Recurrent Unit (GRU) based networks, for learning a value function that maps environment states to action values. Recurrent Neural Networks are useful for modeling time-series data since the network maintains a memory, learning to retain useful information from inputs of prior model inferences. Every time the model is called, the memory is updated in correspondence with the current inputs.

Read the rest of the article at Mindboard’s Medium channel.

Scaling Reward Values for Improved Deep Reinforcement Learning

Deep Reinforcement Learning involves using a neural network as a universal function approximator to learn a value function that maps state-action pairs to their expected future reward given a particular reward function. This can be done many different ways. For example, a Monte Carlo based algorithm will observe total rewards following state-action pairs from a complete episode to make build training data for the neural network. Alternatively, a Temporal Difference approach would use incremental rewards from single time-steps and bootstrap off of predicted future rewards from the latest version of the value function model. However, no matter what approach is taken, it is important that the neural network is being efficiently fitted to the data in order to optimize the learning algorithm. There are many factors that determine a neural networks ability to fit to training data. In this post we will examine how scaling our outputs can affect our rate of convergence.

Read the rest of the article at Mindboard’s Medium channel.

Q Matrix Update to train Deep Recurrent Q Networks More Effectively

Deep Recurrent Q network, as discussed in previous article, can be very helpful in building smart agents that remember their learning from distant past. This feature makes a Deep Recurrent Q network a valuable function approximator in building AI agents for Deep Reinforcement Learning.

Read the rest of the article at Mindboard’s Medium channel.

A deep learning solution to detect and mask human faces in videos

The objective of the project is to develop a smart deep-learning based solution, which possesses the capability to detect human faces in images / videos and mask them. The solution discussed in this article comprises of a set of open source tools and combining them together to form a pipeline, which processes a given video and outputs another video with faces masked in them.

Read the rest of the article at Mindboard’s Medium channel.