benherbst / dalaix

Easy installer for Dalai: LLaMA on your local machine

Creator, Founder and Manager of Devs4Devs https://www.devsfordevs.com/

Checkout my website: https://www.benherbst.net/

Gdscript, Java, Kotlin, D, C, Python, HTML, CSS, JavaScript, SCSS, TypeScript, Dart

Godot, Javafx, Vue.js, Tornadofx, Gtk, Tkinter, Bootstrap, Flask, Mysql, Docker, Vscode, Intellij IDEA Ultimate, SQLite, Zenkit, Electron, Git, Ubuntu Server, Axios, Eclipse, Nuxt.js, Firebase, LibAdwaita, GdUnit, Git LFS, Vuetify, DoomEmacs, SpaceMacs, Neovim

I am currently with Nuxt, Tailwind, Flutter mostly

My stats ( About public repos only )

https://skyline.github.com/BenHerbst/2023

https://resume.github.io/?BenHerbst

Tools I use

I use VS Code and IntelliJ IDEA Ultimate.

I do all WebDev etc. in IntelliJ, but I sometimes use VS Code too, mostly with code spaces. Furthermore, I also used Neovim in past but switched to something more powerful out of the box and IDE as IntelliJ IDEA Ultimate 🔥 is, with also great database features etc. build in. I also used both Scratch and Eclipse in the past. I used GitHub Copilot in past I also recommend using Termius as SSH and SFTP client, it's a beautiful software! I also use Postman for rest apis and Zenkit for project managmenet. Diagrams.net and PlantUML for UML and visualation. As version control, I use Git. For Gamedev I primarily used Godot with Gdscript. I am learning Flutter

Used Fontforge in past to create own fonts. Gimp and Inkscape for design, Aseprite for Pixel Art, some Blender for 3D. Virtual Box as VM.

Support me ( PayPal )

Donate

If you donate something, it is going to be used mainly for hosting costs and other stuff I have to buy for coding.

Project Managment

I like using Kanban boards like Zenkit, Trello, Asana etc. Also like using Todoist

Administration / Devops

I know some stuff like Postfix, Ubuntu Server, Fedora, a bit of Rocky Linux, Nextcloud, Keepass and some more Also having experience with Windows Administration

I like using Docker.

The web servers and reverse proxies that I use are Nginx and Apache HTTPD. I have experience with Hetzner Cloud and Cloudflare, Mailgun, OneSignal

Linux

I know Linux Mint, Ubuntu, Arch Linux, WSL 2, Pop!_OS, KDE Neon

Herbstluft VM, Gnome, KDE, XFCE

I know a ton about Linux Desktop, you can ask me anything about it.

Other

I do art and music too, using Ableton, Krita and Inkscape. Created some stuff for my games with it.

FUQQ

The creator of the FUQQ Community https://discord.gg/6hGvuW2fKy

New feature here on this readme ( Copied from https://github.com/f11y11 ):

dalaix's Issues

Drive Selection

Got it to work on my laptop, however I need to move it from C drive to D Drive. Is the an option to select drives?
Would be #handy./
Cheers

Wont let me select a model

it downloads and launches just fine it just wont let me select a model and wont respond to prompts

Gpt4all

Would love to see this added!

https://github.com/nomic-ai/gpt4all

Thanks a bunch.

Will it work with Vicuna model?

I tried most models that are coming in the recent days and this is the best one to run locally, fater than gpt4all and way more accurate.
ggml-vicuna-7b-4bit-rev1.bin

Support Mac, Support other models.

Support for Mac, and other models, such as Chinese-LLaMA-Alpaca

Install doesnt complete

The base structure appears, but nothing more.

I have the models already, and can put them in place manually.
But where should they go? And would that be enough?

No response after using Start dalai

System win10, python3.10, nodejs 18, vs2019, git+git lfs

after installing model prompts in Dalaix successfully, running Start Dalai without any prompts and reactions

Installer hangs at Choco install

Installer hangs:

Installing Choco
ReferenceError [Error]: alert is not defined
at setupEntries (C:\Users\IronMan\AppData\Local\Programs\dalaix\resources\app.asar\out\main\installWorker-acd0c3c3.js:60:7)
at run (C:\Users\IronMan\AppData\Local\Programs\dalaix\resources\app.asar\out\main\installWorker-acd0c3c3.js:24:9)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)

Install completed - localhost:3000 never comes up

Ok so everything seemed to install smooth.
I click on Start and it asks me if I want to start the server and I hit the ok button. then nothing seems to happen.
How long should I be waiting before I try localhost:3000
(btw is there a place I can change that url?)

Install fails TypeError: Cannot assign to read only property cflags of objective #<object>

Hello. I hope this helps you debug, and thank you for the efforts. I get the same error when I try your regular commandline installer too.

---

C:\Dalai>cd C:\Dalai\dalai && PowerShell -Command "Add-Type -AssemblyName PresentationFramework;[System.Windows.MessageBox]::Show('Starting Dalai server ...', 'Dalaix by Ben Herbst')" && npx dalai serve
OK
gyp ERR! UNCAUGHT EXCEPTION
gyp ERR! stack TypeError: Cannot assign to read only property 'cflags' of object '#'
gyp ERR! stack at createConfigFile (C:\Users\XXX\AppData\Roaming\npm\node_modules\npm\node_modules\node-gyp\lib\configure.js:118:21)
gyp ERR! stack at process.processTicksAndRejections (node:internal/process/task_queues:77:11)
gyp ERR! System Windows_NT 10.0.19044
gyp ERR! command "C:\Program Files\nodejs\node.exe" "C:\Users\XXX\AppData\Roaming\npm\node_modules\npm\node_modules\node-gyp\bin\node-gyp.js" "rebuild"
gyp ERR! cwd C:\Users\XXX\AppData\Roaming\npm-cache_npx\40384\node_modules\dalai\node_modules\node-pty
gyp ERR! node -v v19.8.1
gyp ERR! node-gyp -v v5.1.0
gyp ERR! This is a bug in node-gyp.
gyp ERR! Try to update node-gyp and file an Issue if it does not help:
gyp ERR! https://github.com/nodejs/node-gyp/issues
npm ERR! code ELIFECYCLE
npm ERR! errno 7
npm ERR! [email protected] install: node scripts/install.js
npm ERR! Exit status 7
npm ERR!
npm ERR! Failed at the [email protected] install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR! C:\Users\XXX\AppData\Roaming\npm-cache_logs\2023-04-01T08_27_01_277Z-debug.log
Install for [ 'dalai@latest' ] failed with code 7

C:\Dalai\dalai>

api

will it support api?

Install ok but weird results

Hi, i tried to install dalaix after failing to make work dalai. In both case, install is ok, i have no errors. But when i try the interface, i got weird results like this:

I'm not sure but isn't that debug results ? Cause i only get that, no matter what the prompt is and debug isn't checked (got same thing if it's checked)

'dalai' is not recognized

Ran the setup from the release, installed alpaca 7B, tried to run start.bat in an admin powershell. This is what I got out:

C:\Dalai>cd C:\Dalai\dalai   && PowerShell -Command "Add-Type -AssemblyName PresentationFramework;[System.Windows.MessageBox]::Show('Starting Dalai server ...', 'Dalaix by Ben Herbst')"   && npx dalai serve
OK
'dalai' is not recognized as an internal or external command,
operable program or batch file.