Comments (3)
Resolved in 0de5e1b. Only accepts custom metrics through creating your own Metric. I will probably keep it that way. Before closing this issue it needs to be decided if this is the way custom metrics will be supported. If so, an example needs to be added to the documentation before this issue gets closed.
from gama.
The score
function needs to be adapted to return multiple scores if more than one optimization score was given, or needs to clearly state it will only return one.
from gama.
With mixed metrics, currently only predict_proba
is called, and the class predictions it taken to be the class with highest probability. Instead, predict
should also be called and those predictions should be used for class-label metrics.
from gama.
Related Issues (20)
- Better warm starting with automatically converting pipeline or pipeline string to gama individual string HOT 6
- package is incompatible. HOT 2
- Make it easier to access model evaluation results
- KeyError: 'ignore' when running example HOT 1
- Add link to license in readme HOT 1
- Hyperparameter check HOT 2
- Gama re-evaluates already evaluated pipelines HOT 4
- Evaluating individuals after deadline HOT 2
- [Researcher] Developing a new AutoML system around GAMA as outer wrapper? HOT 6
- Using `numpy` arrays as data source may lead to errors if inferred encoding is used
- `Changelog` always post message, even if it already sent it before
- Unable to warm-start AsyncEA HOT 7
- [Implementation] Developing a Custom Auto-ML System Variant with GAMA: Questions & Concerns HOT 3
- Issue with Pickling Local Object in Custom Gama Classifier Implementation HOT 12
- AttributeError in Ensemble Class when Accessing 'validation_score'
- Addition of a new search algorithm for GAMA HOT 2
- [Feature Proposal] Bayesian Optimisation Implementation HOT 12
- ValueError while warm-starting with higher number of cores HOT 4
- [FEATURE PROPOSAL] Integration of ConfigSpace for Search Space Creation in GAMA: Challenges and Proposals HOT 5
- What happened to OAML? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gama.