Comments (11)
@pl-marasco Obviously the save-re-read approached was never intended to remain, it was only to check what was going on
I will try what you suggested
from foss4g-2022.
Do we still need this issue? Can we close it?
from foss4g-2022.
@pl-marasco Which infrastructure was that on?
from foss4g-2022.
@pl-marasco Which infrastructure was that on?
I followed the link in the setup page.
That is pointing to :
https://pangeo-foss4g.vm.fedcloud.eu/jupyterhub/hub/user-redirect/git-pull?repo=https%3A//github.com/pangeo-data/foss4g-2022&urlpath=lab/tree/foss4g-2022/tutorial/pangeo101/&branch=main
from foss4g-2022.
@pl-marasco There is currently 1 daskhub running on pangeo-foss and another one pending
I guess that all the resources available are being used.
from foss4g-2022.
I'm not too familiar with the daskGatway but there should be a way to use the cluster that is running. Am I right?
In any case, I would add a note in the notebook to let attendees to know how to act in case this happens.
Right now I'm not even able to get access to the infrastructure for lack of resources; may be there is an on going refractory.
@j34ni the issue you mention in your merge request is related to the .plot() method or the .hvmethod ?
from foss4g-2022.
@pl-marasco It is probably better if each user use their own cluster
Will try to use the new VM flavor with 16 vCPUs and 64GB RAM
from foss4g-2022.
Menwhile
@j34ni meanwhile I'll be able to reconnect to the cluster, can you give me a little bit more info regarding the problem you are facing? maybe I have a solution as I was struggling for a few days with the hvplot in the same exact point.
from foss4g-2022.
@pl-marasco The issue was that the VCI plot was not done straight away in the same notebook, however I was able to save the data as a netCDF file and then plot it with a different notebook. Also VCI values were not in the range of 0 to 100 (or thereabout) but something like -4000 to +4000. So I started by reducing the time range to the months for which NDVI existed (instead of the whole year), and then may be would it make sense to update the NDVI min & max taking into account 2022 values? What did you get with hvplot?
from foss4g-2022.
@j34ni
In my case, the hvplot fails to render once selecting a different date.
To solve the issue a filter is needed to remove the +/- np.inf values (is the same if you limit values in an acceptable range) and force the x and y axis definition.
VCS.hvplot(x='lon', y='lat', groupby='time' ...
regarding time slicing, even if you have a point on this (especially in the vision of reducing the memory needs), the intention was to talk about/demonstrate the automatic alignment of datasets.
IMHO we should avoid the two steps approach (save/re-read in another notebook) unless there is a note explicating the fact that's a workaround.
from foss4g-2022.
Infrastructure is now working and the visualization component will be updated soon to allow hvplot to work properly.
from foss4g-2022.
Related Issues (20)
- What can I do to help? HOT 5
- Citation packages
- Contributors HOT 32
- Adding a Docker image build that we could use on EOSC or any other place HOT 9
- How to run the tutorial or notebooks from this repo HOT 9
- Where should the Notebooks go? HOT 7
- Update the content of chunking_introduction.ipynb HOT 5
- Do we need a Setup chapter in the tutorial notebooks? HOT 6
- Update content of dask_introduction.ipynb HOT 3
- Change to JupyterLab
- Add other Pangeo related events/talks FOSS4G HOT 1
- Add compression level in episode 1 and remove compression in episode 4 HOT 1
- Timeline HOT 1
- update setup to include EGI binder
- split data access and discovery sections HOT 1
- Resources in BEYOND THE WORKSHOP HOT 3
- cross-reference Pangeo Forge and previous FOSS4G material HOT 1
- intro slides HOT 1
- fix hyperlinks to open a new tab HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from foss4g-2022.