[ISSUE] databricks sdk jobs. how to create dependency task /lineage using python about databricks-sdk-py

[tanmay-db]

Hi @shivatharun, the lineage isn't supported in the SDK currently, however you could update the job with different parameters for example: https://github.com/databricks/databricks-sdk-py/blob/main/examples/jobs/update_jobs_api_full_integration.py where you could use a different JobSetting, does this seem to work for your use case?

[shivatharun]

Hi @tanmay-db - May I know how tasks can run parallel within job, without any dependency, is there any limitation number ?

created_job = w.jobs.create(name=f'sdk-{time.time_ns()}',
                            tasks=[ task1,task2,task3,........]))