weaviate-tutorials / next-multimodal-search-demo

a Weaviate multimodal search demo

This is a Multimodal Search demo built with Weaviate, ImageBind and Next.js

👨🏾‍🍳 Blogpost - Building Multimodal AI in TypeScript

🐥 Getting Started

First, clone the project with the command below

git clone https://github.com/malgamves/next-multimodal-search-demo

The repository lets us do three things

1. Run the Next.js Web App.
2. Run an instance of Weaviate.
3. Import images, audio and videos into your Weaviate database.

🏗️ Running Weaviate

Note that the first time you run it, Docker will download ~4.8GB multi2vec-bind Weaviate module, which contains the ImageBind model.

To start the Weaviate instance, run the following command, which will use the docker-compose.yml file.

docker compose up -d

📩 Importing Data

Before you can import data, add any files to their respective media type in the public/ folder.

With your data in the right folder, run yarn install to install all project dependencies and to import your data into Weaviate and initialise a collection, run:

yarn run import

this may take a minute or two.

🚀 Running your Next.js Application.

Make sure you have your Weaviate instance running with data imported before starting your Next.js Web App.

To run the Web App

yarn dev

... and you can search away!!

📚 Resources

Learn more about multimodal applications

• Multimodal Retrieval Augmented Generation(RAG)
• Multimodal Embedding Models

🤷🏾‍♂️ Troubleshooting

• Check out the Weaviate Docs
• Open an Issue

Some credit goes to Steven for his Spirals template

next-multimodal-search-demo's Issues

error yarn run import

Hi when running

$ yarn run import 

I got the following error:

next-multimodal-search-demo/node_modules/rimraf/dist/esm/bin.mjs:2
import { readFile } from 'fs/promises';
^^^^^^

SyntaxError: Unexpected token import
    at createScript (vm.js:80:10)
    at Object.runInThisContext (vm.js:139:10)
    at Module._compile (module.js:616:28)
    at Object.Module._extensions..js (module.js:663:10)
    at Module.load (module.js:565:32)
    at tryModuleLoad (module.js:505:12)
    at Function.Module._load (module.js:497:3)
    at Function.Module.runMain (module.js:693:10)
    at startup (bootstrap_node.js:188:16)
    at bootstrap_node.js:609:3
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Any solution?. Thank you very much

error Found incompatible module.

Hi when running yarn install. I got the following error:

error [email protected]: The engine "node" is incompatible with this module. Expected version "^12.22.0 || ^14.16.0 || ^16.0.0 || >=17.0.0". Got "8.10.0"
error Found incompatible module.

any solutions? thank you very much