Spring 2022 Project
Main :
Project-Milestone1:
develop :
- UI/Frontend
- Microservice_A/Auth-service
- Microservice_B/Cache
- Microservice_C/Data-Ingestor
Wiki link : https://github.com/airavata-courses/DSDummies/wiki
Spring 2022 Project
Spring 2022 Project
Main :
Project-Milestone1:
develop :
Wiki link : https://github.com/airavata-courses/DSDummies/wiki
Hello,
Me and my team were trying to review your project. But we came across few issues while setting-up the project.
We are looking forward to hear from you in order to run your project successfully.
Best,
Team Ampersand
Create a YAML file for the Data Ingestor microservice to spawn replicas of this service in form of pods.
Added common yml file using GitHub/workflows.
This branch will test Cache service in terms of CI.
The cache service is broken as a result of which the connection of mongodb doesn't happens. This needs to be fixed,
validate request coming from client and response coming from Data investor service
Added docker file for this microservice
Overall, the one-liner start.sh file looks really awesome.
Team Zilean 🦄
This commit should involve the UI enhancements. This would include the CSS and PlotPage.js changes.
Paths need to be updated in the Dockerfile and Makefile app names to be fixed.
JUnit test case for checking storing and fetching of data from database.
Would need to commit Dockerfile, .dockerignore and Makefile for dockerizing this authentication server application.
The docker build is taking more than 15 minutes. Exits with the error -
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.feed_queue: Pending: set()
compose.parallel.parallel_execute_iter: Failed: ServiceName(project='dsdummies', service='react-app', number=1)
compose.parallel.feed_queue: Pending: set()
ERROR: for dsdummies_react-app_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
compose.parallel.parallel_execute_iter: Failed: <Service: react-app>
compose.parallel.feed_queue: Pending: set()
ERROR: for react-app UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
ERROR: compose.cli.errors.log_timeout_error: An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
If you encounter this issue regular
This issue would be used to commit the front end code in React.js
Documentation for Cache service with details on setup, usage etc.
Suggestions:
You could add the below line in your documentation.
Replace #!/bin/bash/ to #!/bin/bash in your bash script
chmod 755 start.sh
Thanks for the constructive feedback. We have made some changes to fix this and updated our wiki accordingly. Really appreciate it . Updated wiki : https://github.com/airavata-courses/DSDummies/wiki
Team Zilean 🦄
There could have been a hashing structure for repetitive input queries to reduce the computational load on the Data Ingestor.
we need to add an input box for taking station code from user
add the Kubernetes flask URL in cache app, while calling for plots
This is a single file that shall be used to dockerize and bring up the containers for all the images, namely for React-app(Frontend), Nodejs-app(Auth-service), Cache(Springboot) and Data Ingestor(Flask App).
The structure of the project seems simple enough to understand. But, from the Data flow Diagram there seems to be no connection between authentication and the spring boot service, what if the request is from an outside source it goes straight to the cache service.
Every connection seems to be Synchronous call, which is good for small scale application. But will not be able to hold a heavy workload.
Talking about Caching instead of caching the whole data file, you could have cached the result of the preprocessor keeping the params of the input from user as keys, and the result as the key. That could have saved a lot of storage, and load up time.
added loading screen and validation for user inputs
This commit shall involve both the changes for dockerization of the complete application and fixes an issue listed in the wiki https://github.com/airavata-courses/DSDummies/wiki#note--step-6-doesnt-works-yet-on-docker-but-the-complete-functionality-works-end-to-end-perfectly-on-local-were-in-the-process-of-fixing-it-but-until-that-time-for-grading--please-refer-to-the-local-setup.
This shall also include the CI changes .
This service is being used for two purposes-
added FFmpeg to environment.yml file
validating request from client and validating response from Data ingestor
This wiki lists down the documentation for the Frontend.
We want to organize the frontend commit into specific directories so as to properly organize our code.
This commit shall be used to commit the changes for Dockerizing the frontend.
This branch is used for testing CI for python flasks service (data ingestor).
This issue shall be used to commit the code changes for the authentication service provider.
This branch will be used to test CI for Auth Service.
Add template for bugs and features.
create auth microservice and mongo YAML files for deploying to Kubernetes.
This is a Flask service that interacts with the S3 server to fetch weather data. Then it plots that data using Pyart and other plotting libraries.
I tried following the steps on the wiki page. I am unable to find any steps to checkout branches. It is unclear on how to change directory or run the bash command given on the wiki page. We need to pull and checkout the branch in order to run any commands. Could you please provide a little more detailed steps on how to go about that?
Team Orion
Changing response status for handling edge cases at cache microservice
Using this script only, we can run the entire application.
sorting out login and logout for the frontend app.
Hi Team,
Thank you for fixing the errors which I mentioned in the previous issue(#52). I will definitely try and setup the project some time in future.
On a side note, to run 'chmod' and 'make' command one requires a Linux based machine. I have a Windows machine hence was facing the issues.
Best,
Team Ampersand
For testing CI on UI using jest.
removed text from div.
made changes for docker files
Initial Whiteboard diagram
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.