wware / bayesdb

A Bayesian database table for querying the probable implications of data as easily as SQL databases query the data itself

BayesDB

BayesDB, a Bayesian database, lets users query the probable implications of their data as easily as a SQL database lets them query the data itself. Using the built-in Bayesian Query Language (BQL), users with no statistics training can solve basic data science problems, such as detecting predictive relationships between variables, inferring missing values, simulating probable observations, and identifying statistically similar database entries.

BayesDB is suitable for analyzing complex, heterogeneous data tables with up to tens of thousands of rows and hundreds of variables. No preprocessing or parameter adjustment is required, though experts can override BayesDB's default assumptions when appropriate.

BayesDB's inferences are based in part on CrossCat, a new, nonparametric Bayesian machine learning method, that automatically estimates the full joint distribution behind arbitrary data tables.

Installation

Docker

BayesDB can also be accessed via a community-contributed Docker container. Install instructions for Docker can be found here.

Once docker has been installed and configured enter the following command in your terminal to download and install the Docker container (this will take a few minutes):

docker pull bayesdb/bayesdb

To run:

docker run -t -i bayesdb/bayesdb /bin/bash

Local

BayesDB depends on CrossCat, so first install CrossCat by following its local installation instructions here.

BayesDB can be installed locally with:

git clone https://github.com/mit-probabilistic-computing-project/BayesDB.git
cd BayesDB
sudo python setup.py install

If you have trouble with matplotlib, you should try switching to a different backend. Open a python prompt ($ python):

import matplotlib
matplotlib.matplotlib_fname()

Then, edit the file at the path that was outputted, changing 'backend' to another one of the available values, until the matplotlib errors go away. Good ones to try are GTKAgg and Agg.

Documentation

Website

Documentation

Example

run_dha_example.py (github) is a basic example of analysis using BayesDB. For a first test, run the following from inside the top level BayesDB dir

python examples/dha/run_dha_example.py

License

Apache License, Version 2.0