pandas Ecosystem

Increasingly, packages are being built on top of pandas to address specific needs in data preparation, analysis and visualization. This is encouraging because it means pandas is not only helping users to handle their data tasks but also that it provides a better starting point for developers to build powerful and more focused data tools. The creation of libraries that complement pandas’ functionality also allows pandas development to remain focused around it’s original requirements.

This is an inexhaustive list of projects that build on pandas in order to provide tools in the PyData space. For a list of projects that depend on pandas, see the usage page for pandasopen in new window or search pypi for pandasopen in new window.

We’d like to make it easier for users to find these projects, if you know of other substantial projects that you feel should be on this list, please let us know.

Statistics and Machine Learning

Statsmodelsopen in new window

Statsmodels is the prominent Python “statistics and econometrics library” and it has a long-standing special relationship with pandas. Statsmodels provides powerful statistics, econometrics, analysis and modeling functionality that is out of pandas’ scope. Statsmodels leverages pandas objects as the underlying data container for computation.

sklearn-pandasopen in new window

Use pandas DataFrames in your scikit-learnopen in new window ML pipeline.

Featuretoolsopen in new window

Featuretools is a Python library for automated feature engineering built on top of pandas. It excels at transforming temporal and relational datasets into feature matrices for machine learning using reusable feature engineering “primitives”. Users can contribute their own primitives in Python and share them with the rest of the community.


Altairopen in new window

Altair is a declarative statistical visualization library for Python. With Altair, you can spend more time understanding your data and its meaning. Altair’s API is simple, friendly and consistent and built on top of the powerful Vega-Lite JSON specification. This elegant simplicity produces beautiful and effective visualizations with a minimal amount of code. Altair works with Pandas DataFrames.

Bokehopen in new window

Bokeh is a Python interactive visualization library for large datasets that natively uses the latest web technologies. Its goal is to provide elegant, concise construction of novel graphics in the style of Protovis/D3, while delivering high-performance interactivity over large data to thin clients.

seabornopen in new window

Seaborn is a Python visualization library based on matplotlibopen in new window. It provides a high-level, dataset-oriented interface for creating attractive statistical graphics. The plotting functions in seaborn understand pandas objects and leverage pandas grouping operations internally to support concise specification of complex visualizations. Seaborn also goes beyond matplotlib and pandas with the option to perform statistical estimation while plotting, aggregating across observations and visualizing the fit of statistical models to emphasize patterns in a dataset.

yhat/ggpyopen in new window

Hadley Wickham’s ggplot2open in new window is a foundational exploratory visualization package for the R language. Based on “The Grammar of Graphics”open in new window it provides a powerful, declarative and extremely general way to generate bespoke plots of any kind of data. It’s really quite incredible. Various implementations to other languages are available, but a faithful implementation for Python users has long been missing. Although still young (as of Jan-2014), the yhat/ggpyopen in new window project has been progressing quickly in that direction.

IPython Vegaopen in new window

IPython Vegaopen in new window leverages Vegaopen in new window to create plots within Jupyter Notebook.

Plotlyopen in new window

Plotly’sopen in new window Python APIopen in new window enables interactive figures and web shareability. Maps, 2D, 3D, and live-streaming graphs are rendered with WebGL and D3.jsopen in new window. The library supports plotting directly from a pandas DataFrame and cloud-based collaboration. Users of matplotlib, ggplot for Python, and Seabornopen in new window can convert figures into interactive web-based plots. Plots can be drawn in IPython Notebooksopen in new window , edited with R or MATLAB, modified in a GUI, or embedded in apps and dashboards. Plotly is free for unlimited sharing, and has cloudopen in new window, offlineopen in new window, or on-premiseopen in new window accounts for private use.

QtPandasopen in new window

Spun off from the main pandas library, the qtpandasopen in new window library enables DataFrame visualization and manipulation in PyQt4 and PySide applications.


IPythonopen in new window

IPython is an interactive command shell and distributed computing environment. IPython tab completion works with Pandas methods and also attributes like DataFrame columns.

Jupyter Notebook / Jupyter Labopen in new window

Jupyter Notebook is a web application for creating Jupyter notebooks. A Jupyter notebook is a JSON document containing an ordered list of input/output cells which can contain code, text, mathematics, plots and rich media. Jupyter notebooks can be converted to a number of open standard output formats (HTML, HTML presentation slides, LaTeX, PDF, ReStructuredText, Markdown, Python) through ‘Download As’ in the web interface and jupyter convert in a shell.

Pandas DataFrames implement _repr_html_and _repr_latex methods which are utilized by Jupyter Notebook for displaying (abbreviated) HTML or LaTeX tables. LaTeX output is properly escaped. (Note: HTML tables may or may not be compatible with non-HTML Jupyter output formats.)

See Options and Settingsopen in new window and Available Optionsopen in new window for pandas display. settings.

quantopian/qgridopen in new window

qgrid is “an interactive grid for sorting and filtering DataFrames in IPython Notebook” built with SlickGrid.

Spyderopen in new window

Spyder is a cross-platform PyQt-based IDE combining the editing, analysis, debugging and profiling functionality of a software development tool with the data exploration, interactive execution, deep inspection and rich visualization capabilities of a scientific environment like MATLAB or Rstudio.

Its Variable Exploreropen in new window allows users to view, manipulate and edit pandas Index, Series, and DataFrame objects like a “spreadsheet”, including copying and modifying values, sorting, displaying a “heatmap”, converting data types and more. Pandas objects can also be renamed, duplicated, new columns added, copyed/pasted to/from the clipboard (as TSV), and saved/loaded to/from a file. Spyder can also import data from a variety of plain text and binary files or the clipboard into a new pandas DataFrame via a sophisticated import wizard.

Most pandas classes, methods and data attributes can be autocompleted in Spyder’s Editoropen in new window and IPython Consoleopen in new window, and Spyder’s Help paneopen in new window can retrieve and render Numpydoc documentation on pandas objects in rich text with Sphinx both automatically and on-demand.


pandas-datareaderopen in new window

pandas-datareader is a remote data access library for pandas (PyPI:pandas-datareader). It is based on functionality that was located in and but was split off in v0.19. See more in the pandas-datareader docsopen in new window:

The following data feeds are available:

  • Google Finance
  • Tiingo
  • Morningstar
  • IEX
  • Robinhood
  • Enigma
  • Quandl
  • FRED
  • Fama/French
  • World Bank
  • OECD
  • Eurostat
  • TSP Fund Data
  • Nasdaq Trader Symbol Definitions
  • Stooq Index Data
  • MOEX Data

quandl/Pythonopen in new window

Quandl API for Python wraps the Quandl REST API to return Pandas DataFrames with timeseries indexes.

pydatastreamopen in new window

PyDatastream is a Python interface to the Thomson Dataworks Enterprise (DWE/Datastream)open in new window SOAP API to return indexed Pandas DataFrames or Panels with financial data. This package requires valid credentials for this API (non free).

pandaSDMXopen in new window

pandaSDMX is a library to retrieve and acquire statistical data and metadata disseminated in SDMXopen in new window 2.1, an ISO-standard widely used by institutions such as statistics offices, central banks, and international organisations. pandaSDMX can expose datasets and related structural metadata including data flows, code-lists, and data structure definitions as pandas Series or MultiIndexed DataFrames.

fredapiopen in new window

fredapi is a Python interface to the Federal Reserve Economic Data (FRED)open in new window provided by the Federal Reserve Bank of St. Louis. It works with both the FRED database and ALFRED database that contains point-in-time data (i.e. historic data revisions). fredapi provides a wrapper in Python to the FRED HTTP API, and also provides several convenient methods for parsing and analyzing point-in-time data from ALFRED. fredapi makes use of pandas and returns data in a Series or DataFrame. This module requires a FRED API key that you can obtain for free on the FRED website.

Domain Specific

Geopandasopen in new window

Geopandas extends pandas data objects to include geographic information which support geometric operations. If your work entails maps and geographical coordinates, and you love pandas, you should take a close look at Geopandas.

xarrayopen in new window

xarray brings the labeled data power of pandas to the physical sciences by providing N-dimensional variants of the core pandas data structures. It aims to provide a pandas-like and pandas-compatible toolkit for analytics on multi- dimensional arrays, rather than the tabular data for which pandas excels.


Blazeopen in new window

Blaze provides a standard API for doing computations with various in-memory and on-disk backends: NumPy, Pandas, SQLAlchemy, MongoDB, PyTables, PySpark.

Daskopen in new window

Dask is a flexible parallel computing library for analytics. Dask provides a familiar DataFrame interface for out-of-core, parallel and distributed computing.

Dask-MLopen in new window

Dask-ML enables parallel and distributed machine learning using Dask alongside existing machine learning libraries like Scikit-Learn, XGBoost, and TensorFlow.

Odoopen in new window

Odo provides a uniform API for moving data between different formats. It uses pandas own read_csv for CSV IO and leverages many existing packages such as PyTables, h5py, and pymongo to move data between non pandas formats. Its graph based approach is also extensible by end users for custom formats that may be too specific for the core of odo.

Rayopen in new window

Pandas on Ray is an early stage DataFrame library that wraps Pandas and transparently distributes the data and computation. The user does not need to know how many cores their system has, nor do they need to specify how to distribute the data. In fact, users can continue using their previous Pandas notebooks while experiencing a considerable speedup from Pandas on Ray, even on a single machine. Only a modification of the import statement is needed, as we demonstrate below. Once you’ve changed your import statement, you’re ready to use Pandas on Ray just like you would Pandas.

# import pandas as pd
import ray.dataframe as pd

Vaexopen in new window

Increasingly, packages are being built on top of pandas to address specific needs in data preparation, analysis and visualization. Vaex is a python library for Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. It can calculate statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid up to a billion (109) objects/rows per second. Visualization is done using histograms, density plots and 3d volume rendering, allowing interactive exploration of big data. Vaex uses memory mapping, zero memory copy policy and lazy computations for best performance (no memory wasted).

  • vaex.from_pandas
  • vaex.to_pandas_df

Data validation

Engardeopen in new window

Engarde is a lightweight library used to explicitly state your assumptions about your datasets and check that they’re actually true.

Extension Data Types

Pandas provides an interface for defining extension typesopen in new window to extend NumPy’s type system. The following libraries implement that interface to provide types not found in NumPy or pandas, which work well with pandas’ data containers.

cyberpandasopen in new window

Cyberpandas provides an extension type for storing arrays of IP Addresses. These arrays can be stored inside pandas’ Series and DataFrame.


A directory of projects providing extension accessorsopen in new window. This is for users to discover new accessors and for library authors to coordinate on the namespace.

cyberpandasopen in new windowipSeries
pdvegaopen in new windowvgplotSeries, DataFrame