Blog - Amir Masoud Sefidian, Data Science, Machine Learning, Artificial Intelligence, Deep Learning, Data Analysis

2021-10-07

Monte Carlo Simulation Explained

29 mins read Monte Carlo Methods: I Am Feeling (Un-)Lucky! In short, Monte Carlo methods refer to a series of statistical methods essentially […]

2021-10-02

Python command-line interface with Click library

7 mins read Python click tutorial shows how to create command-line interfaces with the click module. Python click Python click module is used to create […]

2021-10-01

REINFORCE Algorithm explained in Policy-Gradient based methods with Python Code

17 mins read Policy gradients Policy gradients is a family of algorithms for solving reinforcement learning problems by directly optimizing the policy in […]

2021-09-30

Prune unused Docker objects to alleviate low disk space on the filesystem root issues

4 mins read You can alleviate low disk space on filesystem root issues by pruning redundant docker objects. Docker takes a conservative approach […]

2021-09-29

Comparing Python Command-Line Parsing Libraries: Argparse, Docopt, and Click

23 mins read This article uses the following versions of the libraries: (Ignore invoke for now, it’s a special surprise for later!) Command-Line Example The […]

2021-09-24

Deep Reinforcement Learning: Using policy-based methods to play Pong from pixels

34 mins read This is a long-overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can […]

2021-09-17

Evolution Strategies as a Scalable Alternative to Reinforcement Learning

16 mins read Evolution strategies (ES) is an optimization technique that’s been known for decades, rivals the performance of standard reinforcement learning (RL) techniques on […]

2021-09-12

Best storage formats to save Pandas dataframes

6 mins read When working on data analytical projects, I usually use Jupyter notebooks and a great pandas library to process and move my data around. It […]

2021-09-10

Double DQN and Dueling DQN in Reinforcement Learning

9 mins read In this part, we will see two algorithms that improve upon DQN. These are named Double DQN and Dueling DQN. But first, let’s […]

2021-09-09

SumTree data structure for Prioritized Experience Replay (PER) explained with Python Code

14 mins read Weighted sampling from a list-like collection is an important activity in many applications. Weighted sampling involves selecting samples randomly from […]

2021-09-06

Shannon entropy and its properties

25 mins read Suppose you are talking with three patients in the waiting room of a doctor’s office. All three of them have […]

2021-08-07

Principal Component Analysis (PCA) Explained

14 mins read What is PCA? Let’s say that you want to predict what the gross domestic product (GDP) of the United States will be […]

2021-08-06

Understanding basic Trading Terminology

12 mins read This article is written for readers who want to understand the most common phrases and trading terminology that is used […]

2021-08-06

What are eigenvectors and eigenvalues?

18 mins read Introduction Eigenvectors and eigenvalues have many important applications in computer vision and machine learning in general. Well-known examples are PCA (Principal […]

2021-08-06

Automatic Differentiation Explained

8 mins read Introduction There are several methods to calculate gradients in computer programs: (1) Manual differentiation; (2) Symbolic differentiation; (3) Finite differences […]