Get Python Package Download Statistics with Condastats

Avatar

Sophia Yang

5min

Hundreds of millions of Python packages are downloaded using Conda every month. That’s why we are excited to announce the release of condastats, a conda statistics API with Python interface and Command Line interface. Now anyone can use this tool to conduct research on usage statistics for Conda packages. This project is inspired by pypistats, which is a Python client and CLI for retrieving PyPI package statistics.

Data source

Since May 2019, we have published hourly summarized download data for all Conda packages, conda-forge channel, and a few other channels. The dataset starts in January 2017 and is uploaded once a month. Condastats is built on top of this public Anaconda package data and returns monthly package download statistics.

Installation

condastats is released on conda-forge. To install condastats, run this command in your terminal: conda install -c conda-forge condastats

Command-line interface

There are five sub-commands in the condastats command: overall, pkg_platform, data_source, pkg_version, and pkg_python. Run condastats --help in terminal or run !condastats --help in Jupyter Notebook to see all sub-commands:

In [1]:
!condastats --help
usage: condastats [-h]
 {overall,pkg_platform,data_source,pkg_version,pkg_python}
 ...

positional arguments:
 {overall,pkg_platform,data_source,pkg_version,pkg_python}

optional arguments:
 -h, --help show this help message and exit
 

overall

condastats overall returns overall download statistics for one or more packages for specific months and for specified package platform, python version, package version, and data source. Run condastats overall --help in terminal or run !condastats overall --help in Jupyter Notebook for details:

details:

In [2]:
!condastats overall --help
usage: condastats overall [-h] [--month MONTH] [--start_month START_MONTH]
 [--end_month END_MONTH] [--monthly]
 [--pkg_platform PKG_PLATFORM]
 [--pkg_python PKG_PYTHON]
 [--pkg_version PKG_VERSION]
 [--data_source DATA_SOURCE]
 package [package ...]

positional arguments:
 package package name(s)

optional arguments:
 -h, --help show this help message and exit
 --month MONTH month - YYYY-MM (defalt: None)
 --start_month START_MONTH
 start month - YYYY-MM (defalt: None)
 --end_month END_MONTH
 end month - YYYY-MM (defalt: None)
 --monthly return monthly values (defalt: False)
 --pkg_platform PKG_PLATFORM
 package platform e.g., win-64, linux-32, osx-64.
 (defalt: None)
 --pkg_python PKG_PYTHON
 Python version e.g., 3.7 (defalt: None)
 --pkg_version PKG_VERSION
 Python version e.g., 0.1.0 (defalt: None)
 --data_source DATA_SOURCE
 Data source e.g., anaconda, conda-forge (defalt: None)
 

The only required argument is package, which can be one or more packages. When only given package name(s), it will return the total package download number for all the available Anaconda public datasets, which is from 2017 through the end of last month. Here we show total package download statistics for one package (e.g., pandas), and for multiple packages (e.g., pandas, dask, and numpy).

In [3]:

!condastats overall pandas
pkg_name
pandas 24086379
Name: counts, dtype: int64
In [4]:
!condastats overall pandas dask numpy
pkg_name
dask 7958854
numpy 53752580
pandas 24086379
Name: counts, dtype: int64

We can also get package download statistics for specified month, package platform, data source, package version, and python version:

In [5]:
!condastats overall pandas --month 2019-01 --pkg_platform linux-32 --data_source anaconda \
--pkg_version 0.10.0 --pkg_python 2.6
pkg_name
pandas 12
Name: counts, dtype: int64

And finally, when we pass in the monthly argument, we will get monthly values.

In [6]:
!condastats overall pandas --start_month 2019-01 --end_month 2019-03 --monthly
pkg_name time 
pandas 2019-01 932443.0
 2019-02 1049595.0
 2019-03 1268802.0
Name: counts, dtype: float64
 

pkg_platform, data_source, pkg_version, and pkg_python

The other four subcommands have similar functions:

  • condastats pkg_platform returns package download counts by package platform.
  • condastats data_source returns package download counts by the data source.
  • condastats pkg_version returns package download counts by package version.
  • condastats pkg_python returns package download counts by python version.

The arguments and optional arguments are the same across the four subcommands. Let’s take a look at condastats pkg_platform --help and condastats data_source --help:

In [7]:
!condastats pkg_platform --help
usage: condastats pkg_platform [-h] [--month MONTH]
 [--start_month START_MONTH]
 [--end_month END_MONTH] [--monthly]
 package [package ...]

positional arguments:
 package package name(s)

optional arguments:
 -h, --help show this help message and exit
 --month MONTH month - YYYY-MM (defalt: None)
 --start_month START_MONTH
 start month - YYYY-MM (defalt: None)
 --end_month END_MONTH
 end month - YYYY-MM (defalt: None)
 --monthly return monthly values (defalt: False)
In [8]:
!condastats data_source --help
usage: condastats data_source [-h] [--month MONTH] [--start_month START_MONTH]
 [--end_month END_MONTH] [--monthly]
 package [package ...]

positional arguments:
 package package name(s)

optional arguments:
 -h, --help show this help message and exit
 --month MONTH month - YYYY-MM (defalt: None)
 --start_month START_MONTH
 start month - YYYY-MM (defalt: None)
 --end_month END_MONTH
 end month - YYYY-MM (defalt: None)
 --monthly return monthly values (defalt: False)

Same as condastats overall, we can specify a month, or provide the start month and the end month of the time period we are interested in. For example, we can see package download counts for each python version for pandas for a specific month.

In [9]:
!condastats pkg_python pandas --month 2019-01
pkg_name pkg_python
pandas 2.6 1466.0
 2.7 247949.0
 3.3 1119.0
 3.4 9251.0
 3.5 104445.0
 3.6 468838.0
 3.7 99375.0
Name: counts, dtype: float64

And we can see the monthly counts for each python version with the monthly flag.

In [10]:
!condastats pkg_python pandas --start_month 2019-01 --end_month 2019-02 --monthly
pkg_name time pkg_python
pandas 2019-01 2.6 1466.0
 2.7 247949.0
 3.3 1119.0
 3.4 9251.0
 3.5 104445.0
 3.6 468838.0
 3.7 99375.0
 2019-02 2.6 1542.0
 2.7 242518.0
 3.3 1227.0
 3.4 8134.0
 3.5 83393.0
 3.6 541670.0
 3.7 171111.0
Name: counts, dtype: float64
 

Python interface

To use the Python interface, we need to import the functions from the condastats package by running:

In [11]:
from condastats.cli import overall, pkg_platform, pkg_version, pkg_python, data_source

Here are the function signatures for these five functions:

In [12]:
help (overall)
Help on function overall in module condastats.cli:

overall(package, month=None, start_month=None, end_month=None, monthly=False, pkg_platform=None, data_source=None, pkg_version=None, pkg_python=None)
In [13]:
help(pkg_platform)
Help on function pkg_platform in module condastats.cli:

pkg_platform(package, month=None, start_month=None, end_month=None, monthly=False)
In [14]:
help(pkg_version)
Help on function pkg_version in module condastats.cli:

pkg_version(package, month=None, start_month=None, end_month=None, monthly=False)
In [15]:
help(pkg_python)
Help on function pkg_python in module condastats.cli:

pkg_python(package, month=None, start_month=None, end_month=None, monthly=False)
In [16]:
help(data_source)
Help on function data_source in module condastats.cli:

data_source(package, month=None, start_month=None, end_month=None, monthly=False)

Similar to command-line interface, we can get the total package download counts for all the available data since 2017, for a given month, or a given combination of specifications:

overall(['pandas','dask'])
Out[17]:
pkg_name
dask 7958854
pandas 24086379
Name: counts, dtype: int64
In [18]:
overall(['pandas','dask'], month='2019-01')
Out[18]:
pkg_name
dask 221200
pandas 932443
Name: counts, dtype: int64
In [19]:
overall('pandas',month='2019-01', pkg_platform='linux-32',data_source='anaconda',pkg_version='0.10.0',pkg_python=2.6)
Out[19]:
pkg_name
pandas 12
Name: counts, dtype: int64
 

Similarly, pkg_platform, pkg_version, pkg_python, and data_source functions will give us package counts for each package platform, package version, python version, and data source for a given package. Here are two examples with pkg_python:

In [20]:
pkg_python('pandas', month='2019-01')
Out[20]:
pkg_name pkg_python
pandas 2.6 1466.0
 2.7 247949.0
 3.3 1119.0
 3.4 9251.0
 3.5 104445.0
 3.6 468838.0
 3.7 99375.0
Name: counts, dtype: float64
In [21]:
pkg_python('pandas', start_month='2019-01', end_month='2019-02', monthly=True)
Out[21]:
pkg_name time pkg_python
pandas 2019-01 2.6 1466.0
 2.7 247949.0
 3.3 1119.0
 3.4 9251.0
 3.5 104445.0
 3.6 468838.0
 3.7 99375.0
 2019-02 2.6 1542.0
 2.7 242518.0
 3.3 1227.0
 3.4 8134.0
 3.5 83393.0
 3.6 541670.0
 3.7 171111.0
Name: counts, dtype: float64
 

We hope you find condastats useful! If you have any requests or issues, please open an issue or a pull request. If you have any questions regarding the Anaconda public dataset, please check out https://github.com/ContinuumIO/anaconda-package-data and open an issue there.

You Might Also Be Interested In

For Practitioners
Nov 11, 2021

How Data Visualization Improves Decision-Making
Anaconda Perspectives
May 18, 2022

Asian, American, SVP
For Practitioners
Oct 20, 2020

Behind the Code of Conda: Q&A with principal developer Cheng Lee

Talk to an Expert

Talk to one of our financial services and banking industry experts to find solutions for your AI journey.

Talk to an Expert