keytoyze / mug-diffusion

High-quality and controllable charting AI for rhythm games, modifed from stable diffusion

mug-diffusion's Issues

能否加入malody格式

想要malody格式!

Setting Weights for Different Instruments in Music

I am not a programmer. I have just learned some Python and I'm not able to contribute to the project's development yet. However, as a rhythm game enthusiast, I believe accuracy is crucial in AI-generated music game charts. It would be great to have the ability to adjust the emphasis of different instruments at specific rhythmic points. For example, utilizing Demucs to separate audio and set weights for each instrument, allowing for the generation of charts that lean more towards vocals or drums. This would be highly beneficial for creating game charts for different types of music.

后期会有训练出作图模型的功能吗

单纯想问下 那样的话更方便做出带有某个谱师风格的图 还可以自主选择

[Feature Request] Respect Ranking Criteria option

I noticed the map it generate doesn't really respect the Ranking Criteria

would be cool to add an option to strictly follow the ranking criteria for mania
https://osu.ppy.sh/wiki/en/Ranking_Criteria/osu%21mania

example: dont have more than 5x 1/2 consecutive note for easy (180 bpm reference)

another issue i noticed is unsnapped note, theres like continuous sounds but it ends up being 1/16 snap when it should be clearly 1/1
https://i.imgur.com/qreajGT.png

from this song: https://osu.ppy.sh/beatmapsets/1486330#mania/3047658

another issue is the sudden and unatural break in flow for easy difficulty, (1.25 SR), not sure if its learning from std mode breaks.

Intent to showcase more results and/or stats?

Hello there!

I was made aware of this cool project, good stuff. Quick question, I know you said that it's mostly a project to satisfy your curiosity, but do you plan on showcasing more output from the tool? As a software engineer I'd be curious to examine the output you get before diving into understanding the codebase. Having like 10+ varied chart output that you consider representative of this tool's capabilities, and maybe also some stats on its performance along with what metrics it's evaluated on would be super appreciated.

I understand if it's not something you planned though :)

Good luck with continuing this neat project!

Charts queing?

Sometimes I want to create charts in a row for various difficulties or songs. Would it be possible to add a queue function to make it easier to create charts more efficiently?

Question about the training data

I'm going to try really hard not to be the fun-police.

When you say "Thank all the Charters / Mappers in the community. It's you who endowed MuG Diffusion with intelligence.", the worst case I can imagine is that you just downloaded several thousand Stepmania sm's and mp3's and used that to train the model.

Could I trouble you to explain more specifically what data you used, where you got it from, and under what permissions you used them?

子弹的定义可能有点问题

这个ai做的面谱，对间隔小的面条似乎不会识别成子弹，然后就导致高bpm的面条子弹。。。

Some piano sounds are not correctly snapped (missing or appear unreasonably)

gradio version?

Platform : 5.11.0-37-generic #41~20.04.2-Ubuntu SMP x86_64 GNU/Linux
following the setup instruction in readme, I get error running python webui.py, and the traceback all show gradio's version incompatible. the latest version of gradio is 4, but the code looks like using some version 3 code.

Error while generating

Platform MacOS Big Sur 11.7.6
running from source
requirements installed, except

After clicked "Start Generation" in webui for a while, I got this:

Following the instructions "use via API" in webui footer, I made a little python script but also got the same error while generating:
main.py.txt

It seems like an webui error. Is there configuration mistake or something else?

Any way to build MinaCalc on arm64(mac)?

Sorry to bother you. If this is not mean to be solved. Feel free to close.

Building wheels for collected packages: MinaCalc
  Building wheel for MinaCalc (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /Library/Developer/CommandLineTools/usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/rr/9z6j7fc16q9grp79wl03sts80000gn/T/pip-req-build-izrdvzn1/setup.py'"'"'; __file__='"'"'/private/var/folders/rr/9z6j7fc16q9grp79wl03sts80000gn/T/pip-req-build-izrdvzn1/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/rr/9z6j7fc16q9grp79wl03sts80000gn/T/pip-wheel-um26pfkd
       cwd: /private/var/folders/rr/9z6j7fc16q9grp79wl03sts80000gn/T/pip-req-build-izrdvzn1/
  Complete output (92 lines):
  running bdist_wheel
  running build
  running build_ext
  building 'minacalc' extension
  creating build
  creating build/temp.macosx-10.9-universal2-3.9
  creating build/temp.macosx-10.9-universal2-3.9/MinaCalc
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -Wno-error=unreachable-code -UNDEBUG -I/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/include/python3.9 -c MinaCalc/MinaCalc.cpp -o build/temp.macosx-10.9-universal2-3.9/MinaCalc/MinaCalc.o -std=c++17
  In file included from MinaCalc/MinaCalc.cpp:2:
  In file included from MinaCalc/Ulbu.h:9:
  In file included from MinaCalc/Agnostic/HA_PatternMods/Stream.h:2:
  In file included from MinaCalc/Agnostic/HA_PatternMods/../../PatternModHelpers.h:6:
  /Library/Developer/CommandLineTools/usr/lib/clang/14.0.3/include/xmmintrin.h:14:2: error: "This header is only meant to be used on x86 and x64 architecture"
  #error "This header is only meant to be used on x86 and x64 architecture"
   ^