something wrong with repack/express workflows created by Tier0Feeder about t0

[hufnagel]

hufnagel: Could this be related to the fact that the WMWorkloadURL uses a relative instead of an absolute path ? The workload files are created in the Tier0Feeder component directory, with a relative path the JobCreator likely can't find them.

How do I fix this ? I have to create the workload files in another component, there is no way around that. But maybe I can pass an absolute path to the JobCreator somehow ?

[hufnagel]

hufnagel: Code in Tier0Feeder:

taskName = "Express"
wmSpec = expressWorkload("TestWorkload", getExpressArguments())
wmSpec.setSpecUrl("somespec")
wmSpec.setOwnerDetails("[email protected]", "T0",
{ 'vogroup': 'DEFAULT', 'vorole': 'DEFAULT' } )
wmbsHelper = WMBSHelper(wmSpec, taskName)
wmbsHelper.createSubscription(wmSpec.getTask(taskName), fileset)

How can I have JobCreator pick this up correctly ?

[DMWMBot]

mnorman: Here are the two conditions that have to be met for JobCreator to work with your workload.

1. The workload must have an actual full task path - that is the "task" column in wmbs_workload must contain the full path (although who puts that there is irrelevant)

2. The workload must contain a valid spec url. That is the "spec" column in wmbs_workload must point to a location that can be loaded by the WMWorkloadHelper (a class in WMSpec.WMWorkload) load function. Ideally this is an absolute path, but it could allow relative paths if so equipped, and could even allow couch loading.

Now, the code you're running should provide both of those values, because it should pick them up from the wmSpec, but can you look into the WMBS database and tell me what's in the task and spec columns for this workflow?

[hufnagel]

hufnagel: After Tier0Feeder creates the workflow, a dump of wmbs_workflow

[(1, './TestWorkload/WMSandbox/WMWorkload.pkl', 'TestWorkload', '/TestWorkload/Repack', 'tie0, 1, '0'), (2, './TestWorkload/WMSandbox/WMWorkload.pkl', 'TestWorkload', '/TestWorkload/Repack/LogCollect', 'tie0, 1, '0')]

[hufnagel]

hufnagel: Problem was that WMBSHelper uses . as default for the cachepath (root path for where it stores the workload files). I just need to configure this with an absolute path instead. Will add a configuration option for the Tier0Feeder component and test again.

[hufnagel]

hufnagel: Fix this problem and a couple other small issues that prevented the jobs from making it through the JobCreator.

Please review (both RunConfig and Tier0Feeder unit tests).

[DMWMBot]

mnorman: Works for me with both unittests.

[hufnagel]

hufnagel: (In 4144825) Change directory for repack/express workloads, fixes #3053

Signed-off-by: Dirk Hufnagel [email protected]