2021-09-29

Comparing Python Command-Line Parsing Libraries: Argparse, Docopt, and Click

This article uses the following versions of the libraries: (Ignore invoke for now, it’s a special surprise for later!) Command-Line Example The […]
2021-09-24

Deep Reinforcement Learning: Using policy-based methods to play Pong from pixels

This is a long-overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can […]
2021-09-17

Evolution Strategies as a Scalable Alternative to Reinforcement Learning

Evolution strategies (ES) is an optimization technique that’s been known for decades, rivals the performance of standard reinforcement learning (RL) techniques on […]
2021-09-12

Best storage formats to save Pandas dataframes

When working on data analytical projects, I usually use Jupyter notebooks and a great pandas library to process and move my data around. It […]
2021-09-10

Double DQN and Dueling DQN in Reinforcement Learning

In this part, we will see two algorithms that improve upon DQN. These are named Double DQN and Dueling DQN. But first, let’s […]
2021-09-09

SumTree data structure for Prioritized Experience Replay (PER) explained with Python Code

Weighted sampling from a list-like collection is an important activity in many applications. Weighted sampling involves selecting samples randomly from […]
2021-09-06

Shannon entropy and its properties

Suppose you are talking with three patients in the waiting room of a doctor’s office. All three of them have […]
2021-08-07

Principal Component Analysis (PCA) Explained

What is PCA? Let’s say that you want to predict what the gross domestic product (GDP) of the United States will be […]