An AI assistant about scratchaddons

[Joeclinton1]

I've thought about integrating LLMs with Scratch alot actually, and I have the knowledge to do it, but it is a research level project. It will obviously cost money that someone has to pay and this is not for ScratchAddons to do. This is more for Scratch themselves or a startup. You should abandon the idea before you waste any more time on futile thinking.

[BroJac5246]

-snip-
Maybe our's can be to answer questions about SA?

But who wants that? It just detracts from the focus on coding.

Maybe we can add it to our website if unable to make the code one on scratch? It would still be pretty cool!

Everyone's sick of pointless AI right now. If one really wants to ask AI about Scratch Addons then they can just open Gemini or ChatGPT and ask there.

[Secret-chest]

It does need some work...

[BroJac5246]

Hmm, it looks like this already exists! https://tabnine.com

Not open source, requires server, Scratch is hard to autocomplete, not possible in JS.

Also, LLMs are ginormous. Even a 2B parameter LLM (I have some that I run locally on my phone) is more than a gigabyte, and the performance isn't even that good at that size.

[Secret-chest]

Hmm, it looks like this already exists! https://tabnine.com

Not open source, requires server, Scratch is hard to autocomplete, not possible in JS.

[Secret-chest]

How would we even give the scripts to the LLM? Like, what format? We need to invent Large Coding Block Models or something.

[Chiroyce1]

Unless the user provides their own API key and we feed the LLM custom data on how the Scratch editor, blocks, costumes, clones, etc work - this shouldn't be considered, it'll be way too inaccurate.

Fun fact: Griffpatch Academy has an AI chatbot (I think it's called GriffBot?) that you can ask for help with Scratch and coding.

That is very likely to be trained with the video captions - so it'll be able to answer everything related to the video and similar concepts, but I don't think it can handle any other doubts or bugs.

[BroJac5246]

Unless the user provides their own API key and we feed the LLM custom data on how the Scratch editor, blocks, costumes, clones, etc work - this shouldn't be considered, it'll be way too inaccurate.

Fun fact: Griffpatch Academy has an AI chatbot (I think it's called GriffBot?) that you can ask for help with Scratch and coding.

That is very likely to be trained with the video captions - so it'll be able to answer everything related to the video and similar concepts, but I don't think it can handle any other doubts or bugs.

Maybe our's can be to answer questions about SA?

But who wants that? It just detracts from the focus on coding.

[BroJac5246]

Where would we get API keys? Unless someone wants to donate their 4090, this would wind up being crazy expensive over time.

[Secret-chest]

Not to mention GPT hardly knows Scratch.

[BroJac5246]

Not to mention GPT hardly knows Scratch.

I've been impressed with how much ChatGPT and Gemini know, so I actually do think they could figure it out as long as they're provided good context.

[DNin01]

it's possible that in the future this will be possible on-device.

Hmm, it looks like this already exists! https://tabnine.com

[DNin01]

It does need some work...

It might be better at answering simpler questions like "what does the 'next costume' block do?"

But still, it'd probably be a hundred times better if we or someone were able to train a model to answer Scratch-related questions and code.

[mybearworld]

How would we even give the scripts to the LLM? Like, what format? We need to invent Large Coding Block Models or something.

scratchblocks? That might make it make up blocks, though.

[DNin01]

I have been thinking, this may be better as a non-Scratch Addons project.

[DNin01]

I don't think this is going to catch on at this point in time. It might be worth for us to revisit once LLMs become efficient and portable enough. However, it's a great idea and I could see it becoming its own project.