Comments (4)
Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! π€
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively.
You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! π
Welcome to the Jupyter community! π
from jupyter-scheduler.
Hi @fabiopedrosa. Thank you for creating this issue.
I'm not entirely sure if this is to be expected,
but when I create a schedule for an input file, it uses a copy of that file, and any changes I make to the original file aren't reflected in the schedule file.
So that means every time I need to change something in the notebook, I need to delete the scheduled job and recreate it?
Yes, that is correct. Inputs are immutable: every time you create a schedule for an input file (job definition), jupyter scheduler server creates a snapshot of your input file and then runs it / creates jobs from the snapshot accordingly to the schedule. Therefore mutation of the original input notebook would not propagate, new job / job definition needs to be created based on the mutated notebook.
Closing this issue as answered, please feel free to ask follow-up questions if needed.
from jupyter-scheduler.
@andrii-i Isn't it weird how that is not mentioned anywhere in the documentation?
It even says the opposite:
When the scheduler runs your notebook, it makes a copy of the input file
in https://jupyter-scheduler.readthedocs.io/en/latest/users/index.html
from jupyter-scheduler.
@fabiopedrosa thank you for pointing this out. I can see how that sentence does not give enough information about what exactly happens with a notebook during the job lifecycle and how it could be interpreted in a way that implies that every scheduled execution makes a copy of the input file notebook including mutations.
I've created issue #505 to track this documentation improvement opportunity. If you have ideas on which wording would work well / if wording proposed in the issue description works well, please feel free to comment in the issue.
from jupyter-scheduler.
Related Issues (20)
- Inconsistent "Input file" column naming in the jobs table
- Ensure that notebook is ran only once HOT 1
- Update Publishing Workflows HOT 5
- Empty "Section Navigation" in user docs
- PostgreSql Database Configuration HOT 4
- Add a link to Jupyter Server config documentation to Schedulerβs "Server configuration" docs section
- Create Job Input File Not Working HOT 4
- Clarify input file immutability in the docs, explain what happens with a notebook during job or job definition lifecycle
- JupyterLab 3, Jupyter Scheduler v1 branch β May 15, 2024 end of maintenance
- Prefer fixtures over hard-coded paths in tests
- Support of scheduling multiple notebooks with dependencies HOT 2
- Migration scripts? `no such column: jobs.package_input_folder` HOT 4
- Can't Update Job Definition Parameters
- Input file auto-update HOT 6
- Document how to update input file snapshot
- Delete job output folder and downloaded job files on job deletion (auto-delete) HOT 1
- Scheduled Jobs No Longer Running - Status "Stopped" HOT 12
- Is it possible to query the list of jobs via terminal/API? HOT 4
- Explicitly support Python 3.12
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jupyter-scheduler.