Monte Carlo Simulation Explained

29 mins read Monte Carlo Methods: I Am Feeling (Un-)Lucky! In short, Monte Carlo methods refer to a series of statistical methods essentially […]

Python command-line interface with Click library

7 mins read Python click tutorial shows how to create command-line interfaces with the click module. Python click Python click module is used to create […]

REINFORCE Algorithm explained in Policy-Gradient based methods with Python Code

17 mins read Policy gradients Policy gradients is a family of algorithms for solving reinforcement learning problems by directly optimizing the policy in […]

Prune unused Docker objects to alleviate low disk space on the filesystem root issues

4 mins read You can alleviate low disk space on filesystem root issues by pruning redundant docker objects. Docker takes a conservative approach […]

Comparing Python Command-Line Parsing Libraries: Argparse, Docopt, and Click

23 mins read This article uses the following versions of the libraries: (Ignore invoke for now, it’s a special surprise for later!) Command-Line Example The […]

Deep Reinforcement Learning: Using policy-based methods to play Pong from pixels

34 mins read This is a long-overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can […]

Evolution Strategies as a Scalable Alternative to Reinforcement Learning

16 mins read Evolution strategies (ES) is an optimization technique that’s been known for decades, rivals the performance of standard reinforcement learning (RL) techniques on […]

Best storage formats to save Pandas dataframes

6 mins read When working on data analytical projects, I usually use Jupyter notebooks and a great pandas library to process and move my data around. It […]

Double DQN and Dueling DQN in Reinforcement Learning

9 mins read In this part, we will see two algorithms that improve upon DQN. These are named Double DQN and Dueling DQN. But first, let’s […]

SumTree data structure for Prioritized Experience Replay (PER) explained with Python Code

14 mins read Weighted sampling from a list-like collection is an important activity in many applications. Weighted sampling involves selecting samples randomly from […]

Shannon entropy and its properties

25 mins read Suppose you are talking with three patients in the waiting room of a doctor’s office. All three of them have […]

Principal Component Analysis (PCA) Explained

14 mins read What is PCA? Let’s say that you want to predict what the gross domestic product (GDP) of the United States will be […]

Understanding basic Trading Terminology

12 mins read This article is written for readers who want to understand the most common phrases and trading terminology that is used […]

What are eigenvectors and eigenvalues?

18 mins read Introduction Eigenvectors and eigenvalues have many important applications in computer vision and machine learning in general. Well-known examples are PCA (Principal […]

Automatic Differentiation Explained

8 mins read Introduction There are several methods to calculate gradients in computer programs: (1) Manual differentiation; (2) Symbolic differentiation; (3) Finite differences […]