darlene-naz / relai

Spend less time managing your schedules, meetings and more time enjoying it. Automate your meeting notes, audio-videos, summarization, schedules on the go with the help of RelAi!

RelAi

Spend less time managing your schedules, meetings and more time enjoying it. Automate your meeting notes, audio-videos, summarization, schedules on the go with the help of RelAi!

Inspiration

Our inspiration came from trying out different virtual meeting platforms ever since most of the world went remote due to Covid-19 and noting down unique features each one hand and what we could add to make meetings a lot more easier. We discovered that instead of having someone watch a whole meet recording, they could choose to read it or just get an idea of what they missed out or if someone is busy with other activities, they can just use voice commands and run meetings.

What it does

• With the help of RelAi, a user can upload the meeting data to get a quick summary of the meeting with the help of Expert.ai.
• The data can be in any form i.e Video, Audio or Text Documents.
• The user can also use the interactive chatbot on the website to schedule an event or view upcoming events.

How we built it

• We have built our dashboard using ReactJS.
• The user can firstly participate or organize a virtual meeting.
• Once the user ends a meet, a video file is generated.
• This generated file can be used to perform analysis on.
• The user can upload a file in any format i.e. text documents, audio, video, etc.
• The file is then sent to our backend server which is created using Node.js.
• If the file is a text file, we extract the text from the text file and perform summarization on it using the API of Expert.ai.
• If the file is a audio file, we extract the text from the audio(.wav) file using our hosted Python scripts and the Houndify API. We then perform summarization on it using the API of Expert.ai.
• If the file is a video file, we extract the text from the audio(.mp4) file using our hosted Python scripts and moviepy python package. We then perform summarization on it using the API of Expert.ai.
• The user can also use the Chatbot present on the dashboard for creating and retrieving events.
• The user has to authenticate himself/herself using Google OAuth and then the backend server can access the Google calendar of the user when a request is made through the chatbot to create or retrieve the event.
• The user can then view his events in the calendar section on the dashboard.

Challenges we ran into

• Creating the meet section. Working with WebRTC and ReactJS was challenging.
• Working with Socket.io.
• It was challenging to run Python files on our Node.js backend server.
• Conversion of video files to text files was challenging.

Accomplishments that we're proud of

• Learning and understanding how to incorporate WebRTC in the project for the meet section.
• Learning how to run Python files on our Node.js backend server.
• Understanding how to use Expert.ai's API for text summarization and analysis.

What we learned

• We learned how to extract key notes from a text using the API of Expert.ai.
• We also learned how to create a video conferencing section from scratch using Socket.io and WebRTC.

What's next for RelAi

• Use better Speech-to-text API's like Google's Speech-to-text API to enhance performance.
• Deploy the app for public usage.

Demo video

To watch the app demo on YouTube Click here.

Team Members

• Darlene Nazareth
• Sherwyn D'souza

License

MIT License Link

relai's Issues

undefine port and .env file

hi,There....i try to run the script but found error..... at server : siad "running on undefined port , and when i look at the code, found like this : import 'dotenv/config';
import app from './app';

app.listen(process.env.PORT, () => {
console.log(Server up on port ${process.env.PORT}!);
}); at index.js

Can You please share the .env file ? ..... thanks a lot