Coder Social home page Coder Social logo

dana-farber-aios / pathml Goto Github PK

View Code? Open in Web Editor NEW
378.0 13.0 81.0 222.87 MB

Tools for computational pathology

Home Page: https://pathml.org

License: GNU General Public License v2.0

Python 99.49% Dockerfile 0.51%
machine-learning digital-pathology computational-pathology biomedical-image-processing pathology histopathology spatial-transcriptomics image-analysis microscopy fluorescence-microscopy-imaging

pathml's Introduction

๐Ÿค–๐Ÿ”ฌ PathML: Tools for computational pathology

Downloads Documentation Status codecov Code style: black PyPI version tests dev-tests

โญ PathML objective is to lower the barrier to entry to digital pathology

Imaging datasets in cancer research are growing exponentially in both quantity and information density. These massive datasets may enable derivation of insights for cancer research and clinical care, but only if researchers are equipped with the tools to leverage advanced computational analysis approaches such as machine learning and artificial intelligence. In this work, we highlight three themes to guide development of such computational tools: scalability, standardization, and ease of use. We then apply these principles to develop PathML, a general-purpose research toolkit for computational pathology. We describe the design of the PathML framework and demonstrate applications in diverse use cases.

๐Ÿš€ The fastest way to get started?

docker pull pathml/pathml && docker run -it -p 8888:8888 pathml/pathml

done, what analyses can I write now? ๐Ÿ‘‰

This AI will:

  • ๐Ÿค– write digital pathology analyses for you
  • ๐Ÿ”ฌ walk you through the code, step-by-step
  • ๐ŸŽ“ be your teacher, as you embark on your digital pathology journey โค๏ธ

More usage examples here.

๐Ÿ“– Official PathML Documentation

View the official PathML Documentation on readthedocs

๐Ÿ”ฅ Examples! Examples! Examples!

โ†ด Jump to the gallery of examples below


1. Installation

There are several ways to install PathML:

  1. pip install from PyPI (recommended for users)
  2. Clone repo to local machine and install from source (recommended for developers/contributors)
  3. Use the PathML Docker container
  4. Install in Google Colab

Options (1), (2), and (4) require that you first install all external dependencies:

  • openslide
  • JDK 8

We recommend using conda for environment management. Download Miniconda here

1.1 Installation option 1: pip install

Create conda environment, this step is common to all platforms (Linux, Mac, Windows):

conda create --name pathml python=3.8
conda activate pathml

Install external dependencies (for Linux) with Apt:

sudo apt-get install openslide-tools g++ gcc libblas-dev liblapack-dev

Install external dependencies (for MacOS) with Brew:

brew install openslide

Install external dependencies (for Windows) with vcpkg:

vcpkg install openslide

Install OpenJDK 8, this step is common to all platforms (Linux, Mac, Windows):

conda install openjdk==8.0.152

Optionally install CUDA (instructions here)

Install PathML from PyPI:

pip install pathml

1.2 Installation option 2: clone repo and install from source

Clone repo:

git clone https://github.com/Dana-Farber-AIOS/pathml.git
cd pathml

Create conda environment:

conda env create -f environment.yml
conda activate pathml

Optionally install CUDA (instructions here)

Install PathML from source:

pip install -e .

1.3 Installation option 3: Docker

First, download or build the PathML Docker container:

pathml-docker-installation

  • Step 1: download PathML container from Docker Hub

    docker pull pathml/pathml:latest
    

    Optionally specify a tag for a particular version, e.g. docker pull pathml/pathml:2.0.2. To view possible tags, please refer to the PathML DockerHub page.

  • Alternative Step 1 if you have custom hardware: build docker container from source

    git clone https://github.com/Dana-Farber-AIOS/pathml.git
    cd pathml
    docker build -t pathml/pathml .
    
  • Step 2: Then connect to the container:

    docker run -it -p 8888:8888 pathml/pathml
    

The above command runs the container, which is configured to spin up a jupyter lab session and expose it on port 8888. The terminal should display a URL to the jupyter lab session starting with http://127.0.0.1:8888/lab?token=<.....>. Navigate to that page and you should connect to the jupyter lab session running on the container with the pathml environment fully configured. If a password is requested, copy the string of characters following the token= in the url.

Note that the docker container requires extra configurations to use with GPU.
Note that these instructions assume that there are no other processes using port 8888.

Please refer to the Docker run documentation for further instructions on accessing the container, e.g. for mounting volumes to access files on a local machine from within the container.

1.4 Installation option 4: Google Colab

To get PathML running in a Colab environment:

import os
!pip install openslide-python
!apt-get install openslide-tools
!apt-get install openjdk-8-jdk-headless -qq > /dev/null
os.environ["JAVA_HOME"] = "/usr/lib/jvm/java-8-openjdk-amd64"
!update-alternatives --set java /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
!java -version
!pip install pathml

PathML Tutorials we published in Google Colab

  1. PathML Tutorial Colab #1 - Load an SVS image in PathML and see the image descriptors
  2. Now that you have PathML installed, all our other examples would work too - Only make sure you select an appropriately sized backend or VM in CoLab (i.e., RAM, CPU, Disk, and GPU if necessary)

Thanks to all of our open-source collaborators for helping maintain these installation instructions!
Please open an issue for any bugs or other problems during installation process.

1.5 CUDA (optional)

To use GPU acceleration for model training or other tasks, you must install CUDA. This guide should work, but for the most up-to-date instructions, refer to the official PyTorch installation instructions.

Check the version of CUDA:

nvidia-smi

Install correct version of cudatoolkit:

# update this command with your CUDA version number
conda install cudatoolkit=11.0

After installing PyTorch, optionally verify successful PyTorch installation with CUDA support:

python -c "import torch; print(torch.cuda.is_available())"

2. Using with Jupyter (optional)

Jupyter notebooks are a convenient way to work interactively. To use PathML in Jupyter notebooks:

2.1 Set JAVA_HOME environment variable

PathML relies on Java to enable support for reading a wide range of file formats. Before using PathML in Jupyter, you may need to manually set the JAVA_HOME environment variable specifying the path to Java. To do so:

  1. Get the path to Java by running echo $JAVA_HOME in the terminal in your pathml conda environment (outside of Jupyter)
  2. Set that path as the JAVA_HOME environment variable in Jupyter:
    import os
    os.environ["JAVA_HOME"] = "/opt/conda/envs/pathml" # change path as needed
    

2.2 Register environment as an IPython kernel

conda activate pathml
conda install ipykernel
python -m ipykernel install --user --name=pathml

This makes the pathml environment available as a kernel in jupyter lab or notebook.

3. Examples

Now that you are all set with PathML installation, let's get started with some analyses you can easily replicate:

  1. Load over 160+ different types of pathology images using PathML
  2. H&E Stain Deconvolution and Color Normalization
  3. Brightfield imaging pipeline: load an image, preprocess it on a local cluster, and get it read for machine learning analyses in PyTorch
  4. Multiparametric Imaging: Quickstart & single-cell quantification
  5. Multiparametric Imaging: CODEX & nuclei quantization
  6. Train HoVer-Net model to perform nucleus detection and classification, using data from PanNuke dataset
  7. Gallery of PathML preprocessing and transformations

4. Citing & known uses

If you use PathML please cite:

So far, PathML was referenced in 20+ manuscripts:

5. Users

This is where in the world our most enthusiastic supporters are located:

and this is where they work:

Source: https://ossinsight.io/analyze/Dana-Farber-AIOS/pathml#people

6. Contributing

PathML is an open source project. Consider contributing to benefit the entire community!

There are many ways to contribute to PathML, including:

  • Submitting bug reports
  • Submitting feature requests
  • Writing documentation and examples
  • Fixing bugs
  • Writing code for new features
  • Sharing workflows
  • Sharing trained model parameters
  • Sharing PathML with colleagues, students, etc.

See contributing for more details.

7. License

The GNU GPL v2 version of PathML is made available via Open Source licensing. The user is free to use, modify, and distribute under the terms of the GNU General Public License version 2.

Commercial license options are available also.

8. Contact

Questions? Comments? Suggestions? Get in touch!

[email protected]

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.