Comments (8)
shengkaixuan
commented on May 22, 2024
`
┌───────────────────────────────────────────────────┐
│ Fiber v2.42.0 │
│ http://127.0.0.1:8080 │
│ (bound on host 0.0.0.0 and port 8080) │
│ │
│ Handlers ............ 10 Processes ........... 1 │
│ Prefork ....... Disabled PID ................. 1 │
└───────────────────────────────────────────────────┘
llama.cpp: loading model from /models/koala-7B-4bit-128g.bin
SIGILL: illegal instruction
PC=0x90ce7d m=5 sigcode=2
signal arrived during cgo execution
instruction bytes: 0x62 0xf2 0xf5 0x8 0x3f 0xc0 0xc4 0xe1 0xf9 0x7e 0xc2 0x48 0x1 0xd0 0xf 0x92
goroutine 7 [syscall]:
runtime.cgocall(0x89c220, 0xc00024b268)
/usr/local/go/src/runtime/cgocall.go:157 +0x5c fp=0xc00024b240 sp=0xc00024b208 pc=0x4204bc
github.com/go-skynet/go-llama%2ecpp._Cfunc_load_model(0x7f1c14000b60, 0x200, 0x0, 0x0, 0x0, 0x0)
_cgo_gotypes.go:160 +0x4d fp=0xc00024b268 sp=0xc00024b240 pc=0x5c0b2d
github.com/go-skynet/go-llama%2ecpp.New({0xc0000308c0, 0x1e}, {0xc000014468, 0x1, 0xd?})
/build/go-llama/llama.go:21 +0x117 fp=0xc00024b2f8 sp=0xc00024b268 pc=0x5c0e37
github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).LoadLLaMAModel(0xc000080c40, {0xc00002ed08, 0x16}, {0xc000014468, 0x1, 0x1})
/build/pkg/model/loader.go:262 +0x34f fp=0xc00024b408 sp=0xc00024b2f8 pc=0x5c3a0f
github.com/go-skynet/LocalAI/api.openAIEndpoint.func1(0x98a500?)
/build/api/api.go:142 +0x518 fp=0xc00024b8c8 sp=0xc00024b408 pc=0x8495f8
github.com/gofiber/fiber/v2.(*App).next(0xc0002ac480, 0xc0000c6840)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:134 +0x1b6 fp=0xc00024b970 sp=0xc00024b8c8 pc=0x8424b6
github.com/gofiber/fiber/v2.(*Ctx).Next(0xc000257b30?)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/ctx.go:964 +0x53 fp=0xc00024b990 sp=0xc00024b970 pc=0x82e733
github.com/gofiber/fiber/v2/middleware/cors.New.func1(0xc0000c6840)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/middleware/cors/cors.go:140 +0x385 fp=0xc00024ba98 sp=0xc00024b990 pc=0x848185
github.com/gofiber/fiber/v2.(*Ctx).Next(0xf?)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/ctx.go:961 +0x43 fp=0xc00024bab8 sp=0xc00024ba98 pc=0x82e723
github.com/gofiber/fiber/v2/middleware/recover.New.func1(0x98a500?)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/middleware/recover/recover.go:43 +0xcb fp=0xc00024bb30 sp=0xc00024bab8 pc=0x848dab
github.com/gofiber/fiber/v2.(*App).next(0xc0002ac480, 0xc0000c6840)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:134 +0x1b6 fp=0xc00024bbd8 sp=0xc00024bb30 pc=0x8424b6
github.com/gofiber/fiber/v2.(*App).handler(0xc0002ac480, 0x4a4697?)
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:160 +0x87 fp=0xc00024bc38 sp=0xc00024bbd8 pc=0x8426e7
github.com/gofiber/fiber/v2.(*App).handler-fm(0xc000257800?)
:1 +0x2c fp=0xc00024bc58 sp=0xc00024bc38 pc=0x84786c
github.com/valyala/fasthttp.(*Server).serveConn(0xc0002be000, {0xab69c0?, 0xc0000143c0})
/go/pkg/mod/github.com/valyala/[email protected]/server.go:2372 +0x11d3 fp=0xc00024bec8 sp=0xc00024bc58 pc=0x7c9393
github.com/valyala/fasthttp.(*Server).serveConn-fm({0xab69c0?, 0xc0000143c0?})
:1 +0x39 fp=0xc00024bef0 sp=0xc00024bec8 pc=0x7d8a59
github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc0000ad860, 0xc0002a9400)
/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:224 +0xa9 fp=0xc00024bfa0 sp=0xc00024bef0 pc=0x7d4d29
github.com/valyala/fasthttp.(*workerPool).getCh.func1()
/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:196 +0x38 fp=0xc00024bfe0 sp=0xc00024bfa0 pc=0x7d4a98
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00024bfe8 sp=0xc00024bfe0 pc=0x482821
created by github.com/valyala/fasthttp.(*workerPool).getCh
/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:195 +0x1b0
goroutine 1 [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc0002774a0 sp=0xc000277480 pc=0x453eb6
runtime.netpollblock(0x7f1c51145648?, 0x41fb4f?, 0x0?)
/usr/local/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0002774d8 sp=0xc0002774a0 pc=0x44c8b7
internal/poll.runtime_pollWait(0x7f1c28576980, 0x72)
/usr/local/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0002774f8 sp=0xc0002774d8 pc=0x47d529
internal/poll.(*pollDesc).wait(0xc0000fac80?, 0x4?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000277520 sp=0xc0002774f8 pc=0x4b9552
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0000fac80)
/usr/local/go/src/internal/poll/fd_unix.go:614 +0x2bd fp=0xc0002775c8 sp=0xc000277520 pc=0x4bee5d
net.(*netFD).accept(0xc0000fac80)
/usr/local/go/src/net/fd_unix.go:172 +0x35 fp=0xc000277680 sp=0xc0002775c8 pc=0x585e95
net.(*TCPListener).accept(0xc000012708)
/usr/local/go/src/net/tcpsock_posix.go:148 +0x25 fp=0xc0002776a8 sp=0xc000277680 pc=0x59c105
net.(*TCPListener).Accept(0xc000012708)
/usr/local/go/src/net/tcpsock.go:297 +0x3d fp=0xc0002776d8 sp=0xc0002776a8 pc=0x59b1fd
github.com/valyala/fasthttp.acceptConn(0xc0002be000, {0xab40c0, 0xc000012708}, 0xc0002778d0)
/go/pkg/mod/github.com/valyala/[email protected]/server.go:1931 +0x62 fp=0xc0002777b8 sp=0xc0002776d8 pc=0x7c7822
github.com/valyala/fasthttp.(*Server).Serve(0xc0002be000, {0xab40c0?, 0xc000012708})
/go/pkg/mod/github.com/valyala/[email protected]/server.go:1824 +0x4f4 fp=0xc000277900 sp=0xc0002777b8 pc=0x7c6e34
github.com/gofiber/fiber/v2.(*App).Listen(0xc0002ac480, {0x9f6919?, 0x7?})
/go/pkg/mod/github.com/gofiber/fiber/[email protected]/listen.go:82 +0x110 fp=0xc000277960 sp=0xc000277900 pc=0x839cb0
main.main.func1(0xc000026420?)
/build/main.go:83 +0x1f5 fp=0xc0002779f8 sp=0xc000277960 pc=0x885c75
github.com/urfave/cli/v2.(*Command).Run(0xc000026420, 0xc000080a00, {0xc000024220, 0x1, 0x1})
/go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:274 +0x9eb fp=0xc000277c98 sp=0xc0002779f8 pc=0x873eeb
github.com/urfave/cli/v2.(*App).RunContext(0xc0002ae000, {0xab43d8?, 0xc00002c070}, {0xc000024220, 0x1, 0x1})
/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:332 +0x616 fp=0xc000277d08 sp=0xc000277c98 pc=0x870cf6
github.com/urfave/cli/v2.(*App).Run(...)
/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:309
main.main()
/build/main.go:87 +0x8c9 fp=0xc000277f80 sp=0xc000277d08 pc=0x8859a9
runtime.main()
/usr/local/go/src/runtime/proc.go:250 +0x207 fp=0xc000277fe0 sp=0xc000277f80 pc=0x453a87
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000277fe8 sp=0xc000277fe0 pc=0x482821
goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000056fb0 sp=0xc000056f90 pc=0x453eb6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:387
runtime.forcegchelper()
/usr/local/go/src/runtime/proc.go:305 +0xb0 fp=0xc000056fe0 sp=0xc000056fb0 pc=0x453cf0
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000056fe8 sp=0xc000056fe0 pc=0x482821
created by runtime.init.6
/usr/local/go/src/runtime/proc.go:293 +0x25
goroutine 3 [GC sweep wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000057780 sp=0xc000057760 pc=0x453eb6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:387
runtime.bgsweep(0x0?)
/usr/local/go/src/runtime/mgcsweep.go:278 +0x8e fp=0xc0000577c8 sp=0xc000057780 pc=0x44018e
runtime.gcenable.func1()
/usr/local/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000577e0 sp=0xc0000577c8 pc=0x435466
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000577e8 sp=0xc0000577e0 pc=0x482821
created by runtime.gcenable
/usr/local/go/src/runtime/mgc.go:178 +0x6b
goroutine 4 [GC scavenge wait]:
runtime.gopark(0xc00007e000?, 0xaacfb8?, 0x1?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000057f70 sp=0xc000057f50 pc=0x453eb6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:387
runtime.(*scavengerState).park(0xe36bc0)
/usr/local/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc000057fa0 sp=0xc000057f70 pc=0x43e0d3
runtime.bgscavenge(0x0?)
/usr/local/go/src/runtime/mgcscavenge.go:628 +0x45 fp=0xc000057fc8 sp=0xc000057fa0 pc=0x43e6a5
runtime.gcenable.func2()
/usr/local/go/src/runtime/mgc.go:179 +0x26 fp=0xc000057fe0 sp=0xc000057fc8 pc=0x435406
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000057fe8 sp=0xc000057fe0 pc=0x482821
created by runtime.gcenable
/usr/local/go/src/runtime/mgc.go:179 +0xaa
goroutine 5 [finalizer wait]:
runtime.gopark(0x1a0?, 0xe378a0?, 0x60?, 0x78?, 0xc000056770?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000056628 sp=0xc000056608 pc=0x453eb6
runtime.runfinq()
/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000567e0 sp=0xc000056628 pc=0x4344a7
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000567e8 sp=0xc0000567e0 pc=0x482821
created by runtime.createfing
/usr/local/go/src/runtime/mfinal.go:163 +0x45
goroutine 6 [sleep]:
runtime.gopark(0x225088554ff92?, 0xc000058788?, 0xc5?, 0x37?, 0xc0000ad890?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000058758 sp=0xc000058738 pc=0x453eb6
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc000058798 sp=0xc000058758 pc=0x47f695
github.com/valyala/fasthttp.(*workerPool).Start.func2()
/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:67 +0x56 fp=0xc0000587e0 sp=0xc000058798 pc=0x7d41f6
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000587e8 sp=0xc0000587e0 pc=0x482821
created by github.com/valyala/fasthttp.(*workerPool).Start
/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:59 +0xdd
rax 0x0
rbx 0x7f1c14002340
rcx 0x7f1c1bffd610
rdx 0x6db6db6db6db6db7
rdi 0x7f1c140022c8
rsi 0x124924924924924
rbp 0x0
rsp 0x7f1c1bffd530
r8 0x6fd4cad7b15a7234
r9 0x7f1c141f7fc0
r10 0x60
r11 0x0
r12 0x0
r13 0x1
r14 0x189c4ba4c266dc80
r15 0x7f1c140022c8
rip 0x90ce7d
rflags 0x10293
cs 0x33
fs 0x0
gs 0x0
`
got the same problem, anyone can help???
from localai.
mudler
commented on May 22, 2024
this looks like to me you don't have AVX, did you built the image locally or pulled it?
See also #88
from localai.
shengkaixuan
commented on May 22, 2024
I pulled the latest image, the host which runs the image suppor avx
[root@local ~]# lscpu | grep avx Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d arch_capabilities
from localai.
kentative
commented on May 22, 2024
I am also having the same issue --strange thing was, it was working last Friday.
2023-05-01 16:40:17 localai-api-1 |
2023-05-01 16:40:17 localai-api-1 | ┌───────────────────────────────────────────────────┐
2023-05-01 16:40:17 localai-api-1 | │ Fiber v2.44.0 │
2023-05-01 16:40:17 localai-api-1 | │ http://127.0.0.1:8080 │
2023-05-01 16:40:17 localai-api-1 | │ (bound on host 0.0.0.0 and port 8080) │
2023-05-01 16:40:17 localai-api-1 | │ │
2023-05-01 16:40:17 localai-api-1 | │ Handlers ............ 12 Processes ........... 1 │
2023-05-01 16:40:17 localai-api-1 | │ Prefork ....... Disabled PID ................. 1 │
2023-05-01 16:40:17 localai-api-1 | └───────────────────────────────────────────────────┘
2023-05-01 16:40:17 localai-api-1 |
2023-05-01 16:40:22 localai-api-1 | llama.cpp: loading model from /models/ggml-gpt4all-j-v1.3-groovy.bin
2023-05-01 16:40:28 localai-api-1 | error loading model: unexpectedly reached end of file
2023-05-01 16:40:28 localai-api-1 | llama_init_from_file: failed to load model
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: loading model from '/models/ggml-gpt4all-j-v1.3-groovy.bin' - please wait ...
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_vocab = 50400
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_ctx = 2048
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_embd = 4096
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_head = 16
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_layer = 28
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_rot = 64
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: f16 = 2
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: ggml ctx size = 5401.45 MB
2023-05-01 16:40:29 localai-api-1 | gptj_model_load: memory_size = 1792.00 MB, n_mem = 57344
2023-05-01 16:40:33 localai-api-1 | gptj_model_load: ................................... done
2023-05-01 16:40:33 localai-api-1 | gptj_model_load: model size = 3609.38 MB / num tensors = 285
2023-05-01 16:40:33 localai-api-1 | fatal error: unexpected signal during runtime execution
2023-05-01 16:40:33 localai-api-1 | [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x7fe4c943b2f2]
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | runtime stack:
2023-05-01 16:40:33 localai-api-1 | runtime.throw({0xa33a54?, 0x2000?})
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/panic.go:1047 +0x5d fp=0x7fe4a0f3c9f8 sp=0x7fe4a0f3c9c8 pc=0x4524dd
2023-05-01 16:40:33 localai-api-1 | runtime.sigpanic()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/signal_unix.go:821 +0x3e9 fp=0x7fe4a0f3ca58 sp=0x7fe4a0f3c9f8 pc=0x468569
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 18 [syscall]:
2023-05-01 16:40:33 localai-api-1 | runtime.cgocall(0x8cf120, 0xc000286ef8)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/cgocall.go:157 +0x5c fp=0xc000286ed0 sp=0xc000286e98 pc=0x42175c
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/go-gpt4all-j%2ecpp._Cfunc_binding_model_prompt(0x7fe4907c6d90, 0x7fe490002800, 0xc0000b8600, 0xa, 0x3f99999a, 0x400, 0x200, 0x50, 0x3f333333, 0x3f666666, ...)
2023-05-01 16:40:33 localai-api-1 | _cgo_gotypes.go:113 +0x45 fp=0xc000286ef8 sp=0xc000286ed0 pc=0x5c0c85
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/go-gpt4all-j%2ecpp.(*GPTJ).Predict.func1(0xc0002870e8?, 0x5c525e?, {0xc0000b8600, 0xc000283170?, 0xc00010e0a0?}, {0x400, 0xa, 0x200, 0x50, 0x1, ...})
2023-05-01 16:40:33 localai-api-1 | /build/go-gpt4all-j/gptj.go:52 +0x185 fp=0xc000286fa0 sp=0xc000286ef8 pc=0x5c16c5
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/go-gpt4all-j%2ecpp.(*GPTJ).Predict(0xc0000a3ba0?, {0x0, 0x0}, {0xc0002871a8, 0x4, 0x7fe4c92a0728?})
2023-05-01 16:40:33 localai-api-1 | /build/go-gpt4all-j/gptj.go:52 +0x225 fp=0xc000287100 sp=0xc000286fa0 pc=0x5c1345
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.ModelInference.func3()
2023-05-01 16:40:33 localai-api-1 | /build/api/prediction.go:117 +0x23b fp=0xc0002871d8 sp=0xc000287100 pc=0x8852db
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.ModelInference.func5()
2023-05-01 16:40:33 localai-api-1 | /build/api/prediction.go:183 +0x184 fp=0xc000287270 sp=0xc0002871d8 pc=0x884684
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.ComputeChoices({0x0, 0x0}, 0xc000136000, 0xc000156180, 0xc00011c270?, 0xc000287858)
2023-05-01 16:40:33 localai-api-1 | /build/api/prediction.go:203 +0x224 fp=0xc000287728 sp=0xc000287270 pc=0x885f04
2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.chatEndpoint.func1(0xc000134000)
2023-05-01 16:40:33 localai-api-1 | /build/api/openai.go:315 +0x605 fp=0xc0002878b8 sp=0xc000287728 pc=0x882aa5
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).next(0xc0002f7b00, 0xc000134000)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:144 +0x1bf fp=0xc000287960 sp=0xc0002878b8 pc=0x84551f
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*Ctx).Next(0xc000122330?)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/ctx.go:913 +0x53 fp=0xc000287980 sp=0xc000287960 pc=0x830b13
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2/middleware/cors.New.func1(0xc000134000)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/middleware/cors/cors.go:162 +0x3a6 fp=0xc000287a98 sp=0xc000287980 pc=0x84b2e6
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*Ctx).Next(0x14?)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/ctx.go:910 +0x43 fp=0xc000287ab8 sp=0xc000287a98 pc=0x830b03
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2/middleware/recover.New.func1(0x9a6ca0?)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/middleware/recover/recover.go:43 +0xcb fp=0xc000287b30 sp=0xc000287ab8 pc=0x84bf0b
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).next(0xc0002f7b00, 0xc000134000)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:144 +0x1bf fp=0xc000287bd8 sp=0xc000287b30 pc=0x84551f
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).handler(0xc0002f7b00, 0x4a59f7?)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:171 +0x87 fp=0xc000287c38 sp=0xc000287bd8 pc=0x845767
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).handler-fm(0xc000122000?)
2023-05-01 16:40:33 localai-api-1 | <autogenerated>:1 +0x2c fp=0xc000287c58 sp=0xc000287c38 pc=0x84a98c
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*Server).serveConn(0xc00030c000, {0xadd600?, 0xc000114000})
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/server.go:2365 +0x11d3 fp=0xc000287ec8 sp=0xc000287c58 pc=0x7cb893
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*Server).serveConn-fm({0xadd600?, 0xc000114000?})
2023-05-01 16:40:33 localai-api-1 | <autogenerated>:1 +0x39 fp=0xc000287ef0 sp=0xc000287ec8 pc=0x7db159
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc0000b5b80, 0xc00011e000)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:224 +0xa9 fp=0xc000287fa0 sp=0xc000287ef0 pc=0x7d7389
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*workerPool).getCh.func1()
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:196 +0x38 fp=0xc000287fe0 sp=0xc000287fa0 pc=0x7d70f8
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000287fe8 sp=0xc000287fe0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 | created by github.com/valyala/fasthttp.(*workerPool).getCh
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:195 +0x1b0
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 1 [IO wait]:
2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc0002b3478 sp=0xc0002b3458 pc=0x4551f6
2023-05-01 16:40:33 localai-api-1 | runtime.netpollblock(0xc0002b34c0?, 0x420def?, 0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0002b34b0 sp=0xc0002b3478 pc=0x44db57
2023-05-01 16:40:33 localai-api-1 | internal/poll.runtime_pollWait(0x7fe4a06d21c0, 0x72)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0002b34d0 sp=0xc0002b34b0 pc=0x47e869
2023-05-01 16:40:33 localai-api-1 | internal/poll.(*pollDesc).wait(0xc00002ee80?, 0x4445a0?, 0x0)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0002b34f8 sp=0xc0002b34d0 pc=0x4ba8b2
2023-05-01 16:40:33 localai-api-1 | internal/poll.(*pollDesc).waitRead(...)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/internal/poll/fd_poll_runtime.go:89
2023-05-01 16:40:33 localai-api-1 | internal/poll.(*FD).Accept(0xc00002ee80)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/internal/poll/fd_unix.go:614 +0x2bd fp=0xc0002b35a0 sp=0xc0002b34f8 pc=0x4c01bd
2023-05-01 16:40:33 localai-api-1 | net.(*netFD).accept(0xc00002ee80)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/net/fd_unix.go:172 +0x35 fp=0xc0002b3658 sp=0xc0002b35a0 pc=0x56fe55
2023-05-01 16:40:33 localai-api-1 | net.(*TCPListener).accept(0xc000012840)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/net/tcpsock_posix.go:148 +0x25 fp=0xc0002b3680 sp=0xc0002b3658 pc=0x5860c5
2023-05-01 16:40:33 localai-api-1 | net.(*TCPListener).Accept(0xc000012840)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/net/tcpsock.go:297 +0x3d fp=0xc0002b36b0 sp=0xc0002b3680 pc=0x5851bd
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.acceptConn(0xc00030c000, {0xadad40, 0xc000012840}, 0xc0002b38a8)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/server.go:1930 +0x62 fp=0xc0002b3790 sp=0xc0002b36b0 pc=0x7c9d62
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*Server).Serve(0xc00030c000, {0xadad40?, 0xc000012840})
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/server.go:1823 +0x4f4 fp=0xc0002b38d8 sp=0xc0002b3790 pc=0x7c9374
2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).Listen(0xc0002f7b00, {0xa1706e?, 0x7?})
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/listen.go:82 +0x110 fp=0xc0002b3938 sp=0xc0002b38d8 pc=0x83c630
2023-05-01 16:40:33 localai-api-1 | main.main.func1(0xc0002b3c00?)
2023-05-01 16:40:33 localai-api-1 | /build/main.go:88 +0x245 fp=0xc0002b39f0 sp=0xc0002b3938 pc=0x8c01c5
2023-05-01 16:40:33 localai-api-1 | github.com/urfave/cli/v2.(*Command).Run(0xc0002a2160, 0xc000026bc0, {0xc000024040, 0x2, 0x2})
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:274 +0x9eb fp=0xc0002b3c90 sp=0xc0002b39f0 pc=0x8ae32b
2023-05-01 16:40:33 localai-api-1 | github.com/urfave/cli/v2.(*App).RunContext(0xc00029e000, {0xadb088?, 0xc00002c030}, {0xc000024040, 0x2, 0x2})
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:332 +0x616 fp=0xc0002b3d00 sp=0xc0002b3c90 pc=0x8ab136
2023-05-01 16:40:33 localai-api-1 | github.com/urfave/cli/v2.(*App).Run(...)
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:309
2023-05-01 16:40:33 localai-api-1 | main.main()
2023-05-01 16:40:33 localai-api-1 | /build/main.go:92 +0x997 fp=0xc0002b3f80 sp=0xc0002b3d00 pc=0x8bfeb7
2023-05-01 16:40:33 localai-api-1 | runtime.main()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:250 +0x207 fp=0xc0002b3fe0 sp=0xc0002b3f80 pc=0x454dc7
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0002b3fe8 sp=0xc0002b3fe0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 2 [force gc (idle)]:
2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060fb0 sp=0xc000060f90 pc=0x4551f6
2023-05-01 16:40:33 localai-api-1 | runtime.goparkunlock(...)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:387
2023-05-01 16:40:33 localai-api-1 | runtime.forcegchelper()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:305 +0xb0 fp=0xc000060fe0 sp=0xc000060fb0 pc=0x455030
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000060fe8 sp=0xc000060fe0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 | created by runtime.init.6
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:293 +0x25
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 3 [GC sweep wait]:
2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061780 sp=0xc000061760 pc=0x4551f6
2023-05-01 16:40:33 localai-api-1 | runtime.goparkunlock(...)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:387
2023-05-01 16:40:33 localai-api-1 | runtime.bgsweep(0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgcsweep.go:278 +0x8e fp=0xc0000617c8 sp=0xc000061780 pc=0x44142e
2023-05-01 16:40:33 localai-api-1 | runtime.gcenable.func1()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000617e0 sp=0xc0000617c8 pc=0x436706
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000617e8 sp=0xc0000617e0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 | created by runtime.gcenable
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:178 +0x6b
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 4 [GC scavenge wait]:
2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0xc000088000?, 0xad3ad0?, 0x1?, 0x0?, 0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061f70 sp=0xc000061f50 pc=0x4551f6
2023-05-01 16:40:33 localai-api-1 | runtime.goparkunlock(...)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:387
2023-05-01 16:40:33 localai-api-1 | runtime.(*scavengerState).park(0xe76c40)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc000061fa0 sp=0xc000061f70 pc=0x43f373
2023-05-01 16:40:33 localai-api-1 | runtime.bgscavenge(0x0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgcscavenge.go:628 +0x45 fp=0xc000061fc8 sp=0xc000061fa0 pc=0x43f945
2023-05-01 16:40:33 localai-api-1 | runtime.gcenable.func2()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:179 +0x26 fp=0xc000061fe0 sp=0xc000061fc8 pc=0x4366a6
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000061fe8 sp=0xc000061fe0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 | created by runtime.gcenable
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:179 +0xaa
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 5 [finalizer wait]:
2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x1a0?, 0xe77920?, 0x60?, 0x78?, 0xc000060770?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060628 sp=0xc000060608 pc=0x4551f6
2023-05-01 16:40:33 localai-api-1 | runtime.runfinq()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000607e0 sp=0xc000060628 pc=0x435747
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000607e8 sp=0xc0000607e0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 | created by runtime.createfing
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mfinal.go:163 +0x45
2023-05-01 16:40:33 localai-api-1 |
2023-05-01 16:40:33 localai-api-1 | goroutine 6 [sleep]:
2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x27643e32506?, 0xc000062788?, 0x65?, 0x4a?, 0xc0000b5bb0?)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000062758 sp=0xc000062738 pc=0x4551f6
2023-05-01 16:40:33 localai-api-1 | time.Sleep(0x2540be400)
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc000062798 sp=0xc000062758 pc=0x4809d5
2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*workerPool).Start.func2()
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:67 +0x56 fp=0xc0000627e0 sp=0xc000062798 pc=0x7d6856
2023-05-01 16:40:33 localai-api-1 | runtime.goexit()
2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x483b61
2023-05-01 16:40:33 localai-api-1 | created by github.com/valyala/fasthttp.(*workerPool).Start
2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:59 +0xdd
1969-12-31 16:00:00 localai-api-1 exited with code 2
1969-12-31 16:00:00
from localai.
mudler
commented on May 22, 2024
I am also having the same issue --strange thing was, it was working last Friday.
2023-05-01 16:40:17 localai-api-1 | 2023-05-01 16:40:17 localai-api-1 | ┌───────────────────────────────────────────────────┐ 2023-05-01 16:40:17 localai-api-1 | │ Fiber v2.44.0 │ 2023-05-01 16:40:17 localai-api-1 | │ http://127.0.0.1:8080 │ 2023-05-01 16:40:17 localai-api-1 | │ (bound on host 0.0.0.0 and port 8080) │ 2023-05-01 16:40:17 localai-api-1 | │ │ 2023-05-01 16:40:17 localai-api-1 | │ Handlers ............ 12 Processes ........... 1 │ 2023-05-01 16:40:17 localai-api-1 | │ Prefork ....... Disabled PID ................. 1 │ 2023-05-01 16:40:17 localai-api-1 | └───────────────────────────────────────────────────┘ 2023-05-01 16:40:17 localai-api-1 | 2023-05-01 16:40:22 localai-api-1 | llama.cpp: loading model from /models/ggml-gpt4all-j-v1.3-groovy.bin 2023-05-01 16:40:28 localai-api-1 | error loading model: unexpectedly reached end of file 2023-05-01 16:40:28 localai-api-1 | llama_init_from_file: failed to load model 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: loading model from '/models/ggml-gpt4all-j-v1.3-groovy.bin' - please wait ... 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_vocab = 50400 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_ctx = 2048 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_embd = 4096 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_head = 16 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_layer = 28 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: n_rot = 64 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: f16 = 2 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: ggml ctx size = 5401.45 MB 2023-05-01 16:40:29 localai-api-1 | gptj_model_load: memory_size = 1792.00 MB, n_mem = 57344 2023-05-01 16:40:33 localai-api-1 | gptj_model_load: ................................... done 2023-05-01 16:40:33 localai-api-1 | gptj_model_load: model size = 3609.38 MB / num tensors = 285 2023-05-01 16:40:33 localai-api-1 | fatal error: unexpected signal during runtime execution 2023-05-01 16:40:33 localai-api-1 | [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x7fe4c943b2f2] 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | runtime stack: 2023-05-01 16:40:33 localai-api-1 | runtime.throw({0xa33a54?, 0x2000?}) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/panic.go:1047 +0x5d fp=0x7fe4a0f3c9f8 sp=0x7fe4a0f3c9c8 pc=0x4524dd 2023-05-01 16:40:33 localai-api-1 | runtime.sigpanic() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/signal_unix.go:821 +0x3e9 fp=0x7fe4a0f3ca58 sp=0x7fe4a0f3c9f8 pc=0x468569 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 18 [syscall]: 2023-05-01 16:40:33 localai-api-1 | runtime.cgocall(0x8cf120, 0xc000286ef8) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/cgocall.go:157 +0x5c fp=0xc000286ed0 sp=0xc000286e98 pc=0x42175c 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/go-gpt4all-j%2ecpp._Cfunc_binding_model_prompt(0x7fe4907c6d90, 0x7fe490002800, 0xc0000b8600, 0xa, 0x3f99999a, 0x400, 0x200, 0x50, 0x3f333333, 0x3f666666, ...) 2023-05-01 16:40:33 localai-api-1 | _cgo_gotypes.go:113 +0x45 fp=0xc000286ef8 sp=0xc000286ed0 pc=0x5c0c85 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/go-gpt4all-j%2ecpp.(*GPTJ).Predict.func1(0xc0002870e8?, 0x5c525e?, {0xc0000b8600, 0xc000283170?, 0xc00010e0a0?}, {0x400, 0xa, 0x200, 0x50, 0x1, ...}) 2023-05-01 16:40:33 localai-api-1 | /build/go-gpt4all-j/gptj.go:52 +0x185 fp=0xc000286fa0 sp=0xc000286ef8 pc=0x5c16c5 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/go-gpt4all-j%2ecpp.(*GPTJ).Predict(0xc0000a3ba0?, {0x0, 0x0}, {0xc0002871a8, 0x4, 0x7fe4c92a0728?}) 2023-05-01 16:40:33 localai-api-1 | /build/go-gpt4all-j/gptj.go:52 +0x225 fp=0xc000287100 sp=0xc000286fa0 pc=0x5c1345 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.ModelInference.func3() 2023-05-01 16:40:33 localai-api-1 | /build/api/prediction.go:117 +0x23b fp=0xc0002871d8 sp=0xc000287100 pc=0x8852db 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.ModelInference.func5() 2023-05-01 16:40:33 localai-api-1 | /build/api/prediction.go:183 +0x184 fp=0xc000287270 sp=0xc0002871d8 pc=0x884684 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.ComputeChoices({0x0, 0x0}, 0xc000136000, 0xc000156180, 0xc00011c270?, 0xc000287858) 2023-05-01 16:40:33 localai-api-1 | /build/api/prediction.go:203 +0x224 fp=0xc000287728 sp=0xc000287270 pc=0x885f04 2023-05-01 16:40:33 localai-api-1 | github.com/go-skynet/LocalAI/api.chatEndpoint.func1(0xc000134000) 2023-05-01 16:40:33 localai-api-1 | /build/api/openai.go:315 +0x605 fp=0xc0002878b8 sp=0xc000287728 pc=0x882aa5 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).next(0xc0002f7b00, 0xc000134000) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:144 +0x1bf fp=0xc000287960 sp=0xc0002878b8 pc=0x84551f 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*Ctx).Next(0xc000122330?) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/ctx.go:913 +0x53 fp=0xc000287980 sp=0xc000287960 pc=0x830b13 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2/middleware/cors.New.func1(0xc000134000) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/middleware/cors/cors.go:162 +0x3a6 fp=0xc000287a98 sp=0xc000287980 pc=0x84b2e6 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*Ctx).Next(0x14?) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/ctx.go:910 +0x43 fp=0xc000287ab8 sp=0xc000287a98 pc=0x830b03 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2/middleware/recover.New.func1(0x9a6ca0?) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/middleware/recover/recover.go:43 +0xcb fp=0xc000287b30 sp=0xc000287ab8 pc=0x84bf0b 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).next(0xc0002f7b00, 0xc000134000) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:144 +0x1bf fp=0xc000287bd8 sp=0xc000287b30 pc=0x84551f 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).handler(0xc0002f7b00, 0x4a59f7?) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/router.go:171 +0x87 fp=0xc000287c38 sp=0xc000287bd8 pc=0x845767 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).handler-fm(0xc000122000?) 2023-05-01 16:40:33 localai-api-1 | <autogenerated>:1 +0x2c fp=0xc000287c58 sp=0xc000287c38 pc=0x84a98c 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*Server).serveConn(0xc00030c000, {0xadd600?, 0xc000114000}) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/server.go:2365 +0x11d3 fp=0xc000287ec8 sp=0xc000287c58 pc=0x7cb893 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*Server).serveConn-fm({0xadd600?, 0xc000114000?}) 2023-05-01 16:40:33 localai-api-1 | <autogenerated>:1 +0x39 fp=0xc000287ef0 sp=0xc000287ec8 pc=0x7db159 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc0000b5b80, 0xc00011e000) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:224 +0xa9 fp=0xc000287fa0 sp=0xc000287ef0 pc=0x7d7389 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*workerPool).getCh.func1() 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:196 +0x38 fp=0xc000287fe0 sp=0xc000287fa0 pc=0x7d70f8 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000287fe8 sp=0xc000287fe0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | created by github.com/valyala/fasthttp.(*workerPool).getCh 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:195 +0x1b0 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 1 [IO wait]: 2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc0002b3478 sp=0xc0002b3458 pc=0x4551f6 2023-05-01 16:40:33 localai-api-1 | runtime.netpollblock(0xc0002b34c0?, 0x420def?, 0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0002b34b0 sp=0xc0002b3478 pc=0x44db57 2023-05-01 16:40:33 localai-api-1 | internal/poll.runtime_pollWait(0x7fe4a06d21c0, 0x72) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0002b34d0 sp=0xc0002b34b0 pc=0x47e869 2023-05-01 16:40:33 localai-api-1 | internal/poll.(*pollDesc).wait(0xc00002ee80?, 0x4445a0?, 0x0) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0002b34f8 sp=0xc0002b34d0 pc=0x4ba8b2 2023-05-01 16:40:33 localai-api-1 | internal/poll.(*pollDesc).waitRead(...) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 2023-05-01 16:40:33 localai-api-1 | internal/poll.(*FD).Accept(0xc00002ee80) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/internal/poll/fd_unix.go:614 +0x2bd fp=0xc0002b35a0 sp=0xc0002b34f8 pc=0x4c01bd 2023-05-01 16:40:33 localai-api-1 | net.(*netFD).accept(0xc00002ee80) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/net/fd_unix.go:172 +0x35 fp=0xc0002b3658 sp=0xc0002b35a0 pc=0x56fe55 2023-05-01 16:40:33 localai-api-1 | net.(*TCPListener).accept(0xc000012840) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/net/tcpsock_posix.go:148 +0x25 fp=0xc0002b3680 sp=0xc0002b3658 pc=0x5860c5 2023-05-01 16:40:33 localai-api-1 | net.(*TCPListener).Accept(0xc000012840) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/net/tcpsock.go:297 +0x3d fp=0xc0002b36b0 sp=0xc0002b3680 pc=0x5851bd 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.acceptConn(0xc00030c000, {0xadad40, 0xc000012840}, 0xc0002b38a8) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/server.go:1930 +0x62 fp=0xc0002b3790 sp=0xc0002b36b0 pc=0x7c9d62 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*Server).Serve(0xc00030c000, {0xadad40?, 0xc000012840}) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/server.go:1823 +0x4f4 fp=0xc0002b38d8 sp=0xc0002b3790 pc=0x7c9374 2023-05-01 16:40:33 localai-api-1 | github.com/gofiber/fiber/v2.(*App).Listen(0xc0002f7b00, {0xa1706e?, 0x7?}) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/gofiber/fiber/[email protected]/listen.go:82 +0x110 fp=0xc0002b3938 sp=0xc0002b38d8 pc=0x83c630 2023-05-01 16:40:33 localai-api-1 | main.main.func1(0xc0002b3c00?) 2023-05-01 16:40:33 localai-api-1 | /build/main.go:88 +0x245 fp=0xc0002b39f0 sp=0xc0002b3938 pc=0x8c01c5 2023-05-01 16:40:33 localai-api-1 | github.com/urfave/cli/v2.(*Command).Run(0xc0002a2160, 0xc000026bc0, {0xc000024040, 0x2, 0x2}) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:274 +0x9eb fp=0xc0002b3c90 sp=0xc0002b39f0 pc=0x8ae32b 2023-05-01 16:40:33 localai-api-1 | github.com/urfave/cli/v2.(*App).RunContext(0xc00029e000, {0xadb088?, 0xc00002c030}, {0xc000024040, 0x2, 0x2}) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:332 +0x616 fp=0xc0002b3d00 sp=0xc0002b3c90 pc=0x8ab136 2023-05-01 16:40:33 localai-api-1 | github.com/urfave/cli/v2.(*App).Run(...) 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:309 2023-05-01 16:40:33 localai-api-1 | main.main() 2023-05-01 16:40:33 localai-api-1 | /build/main.go:92 +0x997 fp=0xc0002b3f80 sp=0xc0002b3d00 pc=0x8bfeb7 2023-05-01 16:40:33 localai-api-1 | runtime.main() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:250 +0x207 fp=0xc0002b3fe0 sp=0xc0002b3f80 pc=0x454dc7 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0002b3fe8 sp=0xc0002b3fe0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 2 [force gc (idle)]: 2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060fb0 sp=0xc000060f90 pc=0x4551f6 2023-05-01 16:40:33 localai-api-1 | runtime.goparkunlock(...) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:387 2023-05-01 16:40:33 localai-api-1 | runtime.forcegchelper() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:305 +0xb0 fp=0xc000060fe0 sp=0xc000060fb0 pc=0x455030 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000060fe8 sp=0xc000060fe0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | created by runtime.init.6 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:293 +0x25 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 3 [GC sweep wait]: 2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061780 sp=0xc000061760 pc=0x4551f6 2023-05-01 16:40:33 localai-api-1 | runtime.goparkunlock(...) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:387 2023-05-01 16:40:33 localai-api-1 | runtime.bgsweep(0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgcsweep.go:278 +0x8e fp=0xc0000617c8 sp=0xc000061780 pc=0x44142e 2023-05-01 16:40:33 localai-api-1 | runtime.gcenable.func1() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000617e0 sp=0xc0000617c8 pc=0x436706 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000617e8 sp=0xc0000617e0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | created by runtime.gcenable 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:178 +0x6b 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 4 [GC scavenge wait]: 2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0xc000088000?, 0xad3ad0?, 0x1?, 0x0?, 0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061f70 sp=0xc000061f50 pc=0x4551f6 2023-05-01 16:40:33 localai-api-1 | runtime.goparkunlock(...) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:387 2023-05-01 16:40:33 localai-api-1 | runtime.(*scavengerState).park(0xe76c40) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc000061fa0 sp=0xc000061f70 pc=0x43f373 2023-05-01 16:40:33 localai-api-1 | runtime.bgscavenge(0x0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgcscavenge.go:628 +0x45 fp=0xc000061fc8 sp=0xc000061fa0 pc=0x43f945 2023-05-01 16:40:33 localai-api-1 | runtime.gcenable.func2() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:179 +0x26 fp=0xc000061fe0 sp=0xc000061fc8 pc=0x4366a6 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000061fe8 sp=0xc000061fe0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | created by runtime.gcenable 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mgc.go:179 +0xaa 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 5 [finalizer wait]: 2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x1a0?, 0xe77920?, 0x60?, 0x78?, 0xc000060770?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060628 sp=0xc000060608 pc=0x4551f6 2023-05-01 16:40:33 localai-api-1 | runtime.runfinq() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000607e0 sp=0xc000060628 pc=0x435747 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000607e8 sp=0xc0000607e0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | created by runtime.createfing 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/mfinal.go:163 +0x45 2023-05-01 16:40:33 localai-api-1 | 2023-05-01 16:40:33 localai-api-1 | goroutine 6 [sleep]: 2023-05-01 16:40:33 localai-api-1 | runtime.gopark(0x27643e32506?, 0xc000062788?, 0x65?, 0x4a?, 0xc0000b5bb0?) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000062758 sp=0xc000062738 pc=0x4551f6 2023-05-01 16:40:33 localai-api-1 | time.Sleep(0x2540be400) 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/time.go:195 +0x135 fp=0xc000062798 sp=0xc000062758 pc=0x4809d5 2023-05-01 16:40:33 localai-api-1 | github.com/valyala/fasthttp.(*workerPool).Start.func2() 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:67 +0x56 fp=0xc0000627e0 sp=0xc000062798 pc=0x7d6856 2023-05-01 16:40:33 localai-api-1 | runtime.goexit() 2023-05-01 16:40:33 localai-api-1 | /usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x483b61 2023-05-01 16:40:33 localai-api-1 | created by github.com/valyala/fasthttp.(*workerPool).Start 2023-05-01 16:40:33 localai-api-1 | /go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:59 +0xdd 1969-12-31 16:00:00 localai-api-1 exited with code 2 1969-12-31 16:00:00
Can you file a separate issue for this? I've just cleared up code in the bindings so it's sitting much closer with upstream, that might be a regression.
Are you using a build from master? where did you find the model so I can test here?
from localai.
mudler
commented on May 22, 2024
I pulled the latest image, the host which runs the image suppor avx
[root@local ~]# lscpu | grep avx Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d arch_capabilities
can you try the images from master?
from localai.
localai-bot
commented on May 22, 2024
⚠️ ⚠️ ⚠️ ⚠️ ⚠️
Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!
but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.
Don't engage in conversation with me,
I don't support (yet) replying!
⚠️ ⚠️ ⚠️ ⚠️ ⚠️
It seems like there might be an issue with the implementation of the backend server for the TTS endpoint. It might be worth checking the code for that handler to make sure it is correctly implemented and that the required dependencies are installed. Additionally, it may be helpful to check the logs from the container to see if there are any additional error messages or stack traces that could provide more information about the issue.
Sources:
- https://github.com/go-skynet/LocalAI/tree/master/api/openai/completion.go
- https://localai.io/basics/getting_started/index.html
- https://github.com/go-skynet/LocalAI/tree/master/pkg/grpc/proto/backend_grpc.pb.go
from localai.
mudler
commented on May 22, 2024
Missing logs here from the OP. Please provide more logs with DEBUG=true or --debug.
See also: https://localai.io/faq/#everything-is-slow-how-come
Closing the issue now due to inactivity. Reopen if necessary.
from localai.
Related Issues (20)
- Loading UI produces an error on M3 MBP HOT 3
- Mode tts, gpt4 or vision frozes from time to time without timeout HOT 5
- New `gpt-4-vision-preview` is pretty bad compared with older versions HOT 1
- Go versioning HOT 1
- Error running transcriptions on M2 MacBook Pro HOT 1
- Image Generation: ModuleNotFoundError: No module named 'PIL' HOT 4
- Watchdog does not kill and idle sentencetransformer backend HOT 3
- Manual Model Execution Error: Troubleshooting GPU Acceleration HOT 4
- ERROR: stderr update_slots : failed to find free space in the KV cache HOT 4
- Is there a template configuration that supports Llama3-ChatQA-1.5-70B? HOT 1
- OpenVINO libraries not installed in docker image after #2215
- Function calling results in bad state for all LLM models HOT 5
- image generation endpoint `response_format` does not match OpenAI spec HOT 2
- openvoice v1 and v2 now MIT licensed, let local ai support them HOT 1
- hipblass make: *** [Makefile:250: replace] Erro 127
- feat(multimodal): Video understanding
- Models page doesn't list anything HOT 4
- Distributed inference with llama.cpp HOT 2
- can not load ggml-large-v2-q5_0.bin at quay.io/go-skynet/local-ai:master-cublas-cuda12-ffmpeg HOT 1
- Can not load tts_models/multilingual TTS models HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from localai.