juliatrustworthyai / taijaparallel.jl

Adds support for parallelization for Taija packages.

TaijaParallel

This package adds custom support for parallelization for certain Taija packages.

Installation

The stable version of this package can be installed as follows:

using Pkg
Pkg.add("TaijaParallel.jl")

The development version can be installed like so:

using Pkg
Pkg.add("https://github.com/JuliaTrustworthyAI/TaijaParallel.jl")

Usage

Since this package extends the functionality of other Taija packages, it should be used in combination with those packages. For example, see this tutorial to see how TaijaParallel.jl can be used with CounterfactualExplanations.jl.

taijaparallel.jl's Issues

Stop relying on CE for functionality

I think that without noticing the package has so far simply relied on CE.jl for the MPI functionality which had not yet been removed.

Macro is not exported

Add support for `ConformalPrediction.jl`

Reallocation of `parallelization` and `traits` folders

Reallocating the parallelization and traits folders from the CounterfactualExplanations.jl package to the newly created TAIJA parallel package.

• Create TaijaParallel sub-package
• Move the parallelization and traits folders to the newly created package (both source-code and tests)
• Remove the extensions and traits folders from this package
• Update the src/deprecated.jl file
• Update the documentation

Bug: Can't use DecisionThresholdConvergence object

When I try to run the generate_counterfactual function in parallel as shown in the image below, I get an error about the Convergence object.

Code:

Error:

When I follow the stacktrace of the error it leads me to the get_convergence_type function in the Convergence module in the CounterfactualExplanations package. This function has 2 versions: one with AbstractConvergence as input and one with Symbol as input (see image below)

In my case, because I have created my own DecisionThresholdConvergence object, I would expect the first function to be called. However, for reason currently unknown to me, when the @with_parallelizer macro is used the function with the Symbol as input is being called. I've tested the same code without the macro and this works how it is supposed to.

@pat-alt is this enough information for someone to look into? If more details are necessary, please let me know. Solving this issue would really help me out :)

TagBot trigger issue

This issue is used to trigger TagBot; feel free to unsubscribe.

If you haven't already, you should update your TagBot.yml to include issue comment triggers.
Please see this post on Discourse for instructions and more details.

If you'd like for me to do this for you, comment TagBot fix on this issue.
I'll open a PR within a few hours, please be patient!