Comments (1)
@israelwei thanks for the suggestion, I guess the problem is how will trains know what the target epochs/batch/steps are?
That said, I can offer here a quick hack:
Assuming you are training for args.epoch
epochs and each one is of args.epoch_size
mini-batches.
Now, consider a for-loop with i
as the increasing counter of batches (iterations/steps), we could do:
from trains import Logger
Logger.current_logger().report_scalar(title="progress", series="progress", iteration=i, value=round(100.0*i/(args.epoch_size*args.epoch), 1))
Now we have a graph of our progress (i.e. a number between 0 to 100, that represents our progress).
In order to view it in the experiment table we can add a custom column based on the metric we just added 'progress.progress'
Details and screenshots on custom columns can be found here
from clearml.
Related Issues (20)
- Task creation failed!Always searching for this project? But I don't have it! HOT 1
- Support Megatron-LM training job on k8s cluster HOT 4
- Model.get_local_copy with specific download path. HOT 1
- "413 Request Entity Too Large" when uploading files to ClearML HOT 4
- legend titles broken in experiment comparison HOT 1
- Preview text files HOT 1
- Registering models from lightning not working (different than pytorch-lightning) HOT 2
- GPU monitoring failed getting GPU reading, switching off GPU monitoring HOT 6
- async variant of get_mutable_local_copy HOT 2
- Light theme for the dashboard HOT 1
- Plot comparison in a single figure not working for plots other than barplots HOT 3
- API calls fail for model with deleted parent task. HOT 1
- Scalar logging bug with Fire HOT 6
- multilanguage support HOT 1
- is it possible to upload bytes object instead files? HOT 1
- Add retries and chunking parameters to upload_folder HOT 2
- Add_external_files for Hyperdatsets HOT 1
- Add Progress Bar for downloading (and maybe uploading) artifacts HOT 2
- [ERROR] [CLEARML.auth] Error getting token - FileServer HOT 1
- Many ClearML Dataset functions and parameters not available for Hyperdatasets, also it would be clearer to change name of allegroai Dataset to Hyperdataset HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clearml.