YouTube: Some fields not found when run from translation-server about translators

[dstillman]

The YouTube translator uses scraping for some fields because of this:

translators/YouTube.js

Lines 101 to 103 in 7837c42

	/* YouTube won't update the meta tags for the user,
	* if they open e.g. a suggested video in the same tab.
	* Thus we scrape them from screen instead.

But when run from translation-server we only have the JSON-LD. So maybe we need to check whether the page is actually built and fall back to JSON-LD for all fields if not.

[geofferb]

@dstillman Upon further testing, I've found that the translation-server can only get the useless BreadcrumbList JSON-LD and not the VideoObject one the translator uses. However, it seems to get <meta> tags fine; could those be used as a fallback?

Also, is there a way to see the HTML retrieved by translation-server? It would make debugging this much easier.

[dstillman]

Probably, but we would have to make sure it was only using the meta tags for over-the-wire saves and never using them for Connector-based saves, due to the problem explained in the comment. So we'd have to make sure we were detecting that properly.

Also, is there a way to see the HTML retrieved by translation-server?

Yes, you can add Zotero.debug(doc.documentElement.innerHTML) or similar. (But it's likely just the same as you'd get with curl.)