generate-prod: docfx-ruby-google-cloud-datastore-v2.7.0.tar.gz failed about doc-pipeline

[dazuma]

I'm investigating now. It looks like there was a crash during YAML generation, resulting in incomplete YAML. However, the release script didn't detect the crash and proceeded to upload the tarball of the incomplete YAML, resulting in the errors above. So there are two issues here: the crash itself, and the fact that the script didn't handle the crash correctly. I'll look at these over the next day or two. More info in the internal issue b/277880368. Note that, as we haven't had a successful release of this library since this incident, it's very possible the same issue will resurface with the next release unless it gets addressed.

[dandhlee]

After some debugging with this specific blob, it seems like there are a lot more references than actual items included in the YAML file for Google-Cloud-Datastore.yml.

In the references, it expects all of these entries:

- uid: Google::Cloud::Datastore
- uid: Google::Cloud::Datastore.configure(class)
- uid: Google::Cloud::Datastore.new(class)
- uid: Google::Cloud::Datastore::VERSION
- uid: Google::Cloud::Datastore::Key
- uid: Google::Cloud::Datastore::Query
- uid: Google::Cloud::Datastore::Commit
- uid: Google::Cloud::Datastore::Cursor
- uid: Google::Cloud::Datastore::Entity
- uid: Google::Cloud::Datastore::KeyError
- uid: Google::Cloud::Datastore::PropertyError
- uid: Google::Cloud::Datastore::TransactionError
- uid: Google::Cloud::Datastore::Filter
- uid: Google::Cloud::Datastore::Dataset
- uid: Google::Cloud::Datastore::GqlQuery
- uid: Google::Cloud::Datastore::Properties
- uid: Google::Cloud::Datastore::Credentials
- uid: Google::Cloud::Datastore::Transaction
- uid: Google::Cloud::Datastore::AggregateQuery
- uid: Google::Cloud::Datastore::ReadOnlyTransaction

The following are defined within the YAML file:

- uid: Google::Cloud::Datastore
- uid: Google::Cloud::Datastore.configure(class)
- uid: Google::Cloud::Datastore.new(class)
- uid: Google::Cloud::Datastore::VERSION

The following are referenced and exist as a separate file within the blob:

- uid: Google::Cloud::Datastore::Key
- uid: Google::Cloud::Datastore::Query
- uid: Google::Cloud::Datastore::Commit
- uid: Google::Cloud::Datastore::Cursor
- uid: Google::Cloud::Datastore::Entity
- uid: Google::Cloud::Datastore::KeyError
- uid: Google::Cloud::Datastore::PropertyError
- uid: Google::Cloud::Datastore::TransactionError

The following are referenced but do not exist as a separate YAML file or entry within the blob:

- uid: Google::Cloud::Datastore::Filter
- uid: Google::Cloud::Datastore::Dataset
- uid: Google::Cloud::Datastore::GqlQuery
- uid: Google::Cloud::Datastore::Properties
- uid: Google::Cloud::Datastore::Credentials
- uid: Google::Cloud::Datastore::Transaction
- uid: Google::Cloud::Datastore::AggregateQuery
- uid: Google::Cloud::Datastore::ReadOnlyTransaction

@dazuma, can you take a look to see where the missing references might be? I'll remove the problematic blob for now.