Repository to hold a study with implementation related to data intensive apps.
The data-intensive application I am refering to are those applications where there are near or more than 1 TB of data stored, and it is necessary to perform fast queries to reply to the user, less than 500ms.
This kind of challenge is growing with some specific types of business working online, such as social media, online banking, etc. These type of business have to usually store a lots os user information, either for fraud analisys, data analysis, or to allow the user to navigate through anytime on the history, such as old social media posts, all banking statements, previous purchages online on the online store.
The idea of this repository is to gather and apply some best practices related to data-intensive applications, addressing some common problems when dealing with data-intensive apps such as caching, pagination, indexes, concurrency, etc.
The data-intensive app use case that will be developed on this repository will only consider some software layers to be able to contain more reproducable scenarios. So layers such as infrastructure, cloud, specific cloud provider technology will not be considered.
Also some implementation not related with the intensive-data goal will not be considered, such as authentication & authorization, payment methods, UX, well designed front end.
News. The use case will be based on News inserted on the data layer. List of use cases below.
- Domain Driven Design
- Clean Architecture
Backend
- App
- NET 6
- C# 10
- Dapper
- gRPC & REST
- Storage
- redis
- mySQL - TBD
- MongoDB - TBD
- Performan Tests
- Locust
- Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems (2017) written by
Martin Kleppmann - Clean Architecture: A Craftsman's Guide to Software Structure and Design (2017) by
Robert C. Martin(Uncle Bob) - Clean Architecture with .NET Core & React+Redux (Open Source Software) by
Ivan Paulovichand contributors
- VS Code
- VS Code Drawio Extension https://marketplace.visualstudio.com/items?itemName=hediet.vscode-drawio
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent