Coder Social home page Coder Social logo

hot-this-week's Issues

Investigate: Issues moving Docker build to Alpine

To improve size-efficiency I attempted to migrate the Docker image to Alpine. This worked well for AMD64, but appears to have a strange issue on ARM64. In both local tests and on GH Actions, the build takes ^10 mins to finish on ARM64. Aware that this is via QEMU, but this still appears to be incredibly slow.

The Dockerfile is:

FROM python:3-alpine

WORKDIR /opt/app

COPY htw                htw
COPY assets             assets
COPY requirements.txt   requirements.txt

RUN apk add python3-dev libc-dev zlib-dev jpeg-dev freetype-dev gcc \
	libxml2-dev libxslt-dev

RUN pip install --no-cache-dir -r requirements.txt

ENTRYPOINT [ "python", "-m", "htw" ]

Testing this on genuine ARM hardware should hopefully reveal what the true nature of the issue is.

When run from Docker - Fatal error: Uncaught Intervention\Image\Exception\NotReadableException: Unable to init from given binary data

When you run the Docker image, you get hit with the following:

Attaching to lastfm-twitter_bot_1
bot_1  | - Scraping from last.fm...
bot_1  | - Generating collage...
bot_1  | 
bot_1  | Fatal error: Uncaught Intervention\Image\Exception\NotReadableException: Unable to init from given binary data. in /opt/tbot/vendor/intervention/image/src/Intervention/Image/Gd/Decoder.php:131
bot_1  | Stack trace:
bot_1  | #0 /opt/tbot/vendor/intervention/image/src/Intervention/Image/AbstractDecoder.php(82): Intervention\Image\Gd\Decoder->initFromBinary('\xFF\xD8\xFF\xE0\x00\x10JFIF\x00\x01\x01\x00\x00...')
bot_1  | #1 /opt/tbot/vendor/intervention/image/src/Intervention/Image/AbstractDecoder.php(335): Intervention\Image\AbstractDecoder->initFromUrl('https://lastfm....')
bot_1  | #2 /opt/tbot/vendor/intervention/image/src/Intervention/Image/AbstractDriver.php(66): Intervention\Image\AbstractDecoder->init('https://lastfm....')
bot_1  | #3 /opt/tbot/vendor/intervention/image/src/Intervention/Image/ImageManager.php(54): Intervention\Image\AbstractDriver->init('https://lastfm....')
bot_1  | #4 /opt/tbot/vendor/intervention/image/src/Intervention/Image/ImageManagerStatic.php(58): Intervention\Image\ImageManager->make('https://lastfm....')
bot_1  | #5 /opt/tbot/vendor/tzsk/collage/src/Con in /opt/tbot/vendor/intervention/image/src/Intervention/Image/Gd/Decoder.php on line 131
lastfm-twitter_bot_1 exited with code 255

Presumably this is coming from the fact the Collage process is fed image URLs, rather than a local system or binary collection. Might need to rejig the import handler to see why this doesn't work. When tried on a local system running Kubuntu 20.04, it works fine.

Possibly related: Intervention/image#634

Main/latest container failing - Edge is fine

server:/$ /usr/bin/docker run -v <redacted>:/opt/app/config.json ghcr.io/soup-bowl/hot-this-week:latest
Processing soup-bowl
- Scraping from last.fm...
- Generating collage...
- Composing tweet...
- Posting to Twitter...
PHP Fatal error:  Uncaught Error: Class 'HotThisWeek\TwitterOAuth' not found in /opt/app/src/TwitterAPI.php:68
Stack trace:
#0 /opt/app/src/CLI.php(100): HotThisWeek\TwitterAPI->postToTwitter()
#1 /opt/app/main.php(89): HotThisWeek\CLI->main()
#2 {main}
  thrown in /opt/app/src/TwitterAPI.php on line 68

Looks like the mainline image isn't grabbing Composer dependencies. Edge container appears to be fine.

Passing invalid configurations (last.fm and Twitter, consumer and app).

As of writing this ticket, unknown to author what transpires when missing or incorrect information is fed to last.fm/Twitter API. Assuming an uncaught exception.

  • last.fm - no key.
  • last.fm - Invalid key.
  • last.fm - User specified incorrect Lfm name.
  • Twitter - no application identity.
  • Twitter - Invalid app ID.
  • Twitter - Client auth keys are incorrect.

Discogs Integration?

Discogs provides a general API for collecting artist information, which could be good as a way of genuinely collecting artist images.

Needs further investigation - so far my quick tests have given me blank artist image URLs. Perhaps they have taken the Last.fm approach of rejecting providing resources. This appears to be my inproper testing, FAQ specifies that image URLs are signed.

Hardening

This has been built in an expected format, but I'd like to take a preventative approach to try and catch some bugs that are inevitably lurking about.

  • #7
  • last.fm user data does not return 5 (can happen if the client is new or clears their data).
  • last.fm artist has no image?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.