Error Installing Oozie about initialization-actions

[chimerasaurus]

When I try it, I get this.

sudo: /usr/lib/oozie/bin/ooziedb.sh: command not found
  ./oozie.sh: line 44:   <property>
    <name>hadoop.proxyuser.oozie.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.oozie.groups</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.${user.name}.hosts</name>
    <value>*</value>
  </property>
...

I do not have time to look @ this right at the moment but looks like something broke with an Oozie update.

[staylebait]

After a few more hours of working on this and investigating I have discovered it appears to be the Ubuntu apt-get repository hosted inside Google Cloud. Some update to Oozie must have broken it as you said which is what it appears to me as well.

With that said I was able to force an install to work by running the following commands:
sudo apt-get download oozie
sudo dpkg --force-all -i oozie_4.2.0-1_all.deb
sudo apt-get download oozie-client
sudo dpkg --force-all -i oozie-client_4.2.0-1_all.deb

After that I had to manually do some stuff with libext to get the UI running, but that appears to be normal for this so I am not including those commands.

[chimerasaurus]

@pmkc FYI

I am short on time so I cannot investigate this fully. Looks like a Bigtop issue or Oozie version issue.

[rkparkjr]

Any update on this? I am running into exactly the same issue described above.

[pmkc]

Sorry about that. Our packages got upstream updates from Apache Bigtop, and I'll update the initialization actions for the new bits.

[revanwabale]

I am getting exactly same issue. is this fixed ?

[manojpatil05]

Getting same problem. I had opened new issue but i am closing that and following this one.

[jgogstad]

Forcing installation with dpkg works (version is 4.3.0 now), but the install script runs into problems in the here document ending up in "bad substitution":

~$ gsutil cat gs://dataproc-guid-us/google-cloud-dataproc-metainfo/other-guid/oozie-test-m/dataproc-initialization-script-0_output
[snip]
+ cat
/etc/google-dataproc/startup-scripts/dataproc-initialization-script-0: line 51:   <property>
    <name>hadoop.proxyuser.oozie.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.oozie.groups</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.${user.name}.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.${user.name}.groups</name>
        <value>*</value>
  </property>
: bad substitution

Which is of course because bash sees the variable references in the here document and try to resolve them. Replacing this line with cat > core-site-patch.xml <<'EOF' fixes that. Now the cluster script runs fine, but the gcloud command fails with a generic master node failure and no logs:

gcloud dataproc clusters create oozie-test --initialization-actions gs://mybucket/oozie.sh
Waiting on operation [projects/myproject/regions/global/operations/GUID].
Waiting for cluster creation operation...done.
ERROR: (gcloud.dataproc.clusters.create) Operation [projects/myproject/regions/global/operations/GUID] failed: Failed to initialize node oozie-test-m.