Basic Data Plotting with Matplotlib: Histograms

Getting Started with a simple example

In order to make a histogram, we need obviously need some data.  Rather than make canned data manually, like in the last section, we are going to use the power of the Numpy python numerical library.  If you don’t have Numpy installed, and run a Debian based distribution, just fire up the following command to install it on your machine:

sudo apt-get install python-numpy

What we will use for our data is 1000 random numbers, drawn from a Gaussian distribution.  This is the common “normal” distribution, or the “bell curve” that occurs so frequently in nature.  We will use a Gaussian centred about zero, with a standard deviation of 1.0 (this is the default for numpy.random.normal):

from numpy.random import normal
gaussian_numbers = normal(size=1000)

Now that we have something to plot, let’s do it!  The pyplot.hist() method is used for generating histograms, and will automatically select the appropriate range to bin our data. With axis labels, a title, and the show() method, our code will look like this:

import matplotlib.pyplot as plt

from numpy.random import normal

gaussian_numbers = normal(size=1000)

plt.hist(gaussian_numbers)

plt.title("Gaussian Histogram")

plt.xlabel("Value")

plt.ylabel("Frequency")

plt.show()

Matplotlib’s histogram will default to using 10 bins, as the figure below shows.

Formatting & Tweaking Our Histogram

We have 1000 points, so 10 bins is a bit small, and makes our histogram look pretty blocky.  Let’s up the resolution by forcing matplotlib to use 20 bins instead.

plt.hist(gaussian_numbers, bins=20)

Next, let’s try plotting things as a probability distribution instead of just frequency counts.  This will let have matplotlib integrate the total area of the histogram (this is just the total number in the array we feed matplotlib), and scale the values appropriately so that rather than showing how many numbers in each bin, we instead have a probability of finding a number in that bin.  The total area of the histogram in this curve will be 1.

plt.hist(gaussian_numbers, bins=20, normed=True)

Another task we might want to do is plot a cumulative distribution function.  This shows the probability of finding a number in a bin or any lower bin. Making this is as simple as throwing a single argument flag to hist(), just like making a probability distribution.

plt.hist(gaussian_numbers, bins=20, normed=True, cumulative=True)

Matplotlib will automatically compute appropriate bins for us, but often we need to know where our bins begin and end.  Matplotlib allows us to pass a sequence of values defining the edges of our bins.  Let’s see how many numbers are between -10 and -1, between -1 and 1, and between 1 and 10.

plt.hist(gaussian_numbers, bins=(-10,-1,1,10))

You also might want to change the look of the histogram. Let’s to plot an unfilled, stepped line rather than filled bars. I personally prefer the ‘stepfilled’ option for histtype, as it removes the ugly black lines between the bins.  Those lines can get rather crowded if you have more than a few hundred bins, and end up really wrecking the look of your plot.

plt.hist(gaussian_numbers, bins=20, histtype=’step’)

Like a line plot, we can also plot two sets of values on the same axis with a histogram.  In this case though, the plots will obscure each other if the histogram is filled.  We can fix this problem easily using matplotlib’s ability to handle alpha transparency.  Let’s make a histogram of uniformly distributed random numbers from -3 to 3 in red with 50% transparency over top the blue Gaussian.

import matplotlib.pyplot as plt

from numpy.random import normal, uniform

gaussian_numbers = normal(size=1000)

uniform_numbers = uniform(low=-3, high=3, size=1000)

plt.hist(gaussian_numbers, bins=20, histtype='stepfilled', normed=True, color='b', label='Gaussian')

plt.hist(uniform_numbers, bins=20, histtype='stepfilled', normed=True, color='r', alpha=0.5, label='Uniform')

plt.title("Gaussian/Uniform Histogram")

plt.xlabel("Value")

plt.ylabel("Probability")

plt.legend()

plt.show()

Well, there you have it.  You should be able to go out and make your own histograms using matplotlib, python, and numpy.  In the next post, I will introduce you to the power of matplotlib’s figure().