Comments (9)
https://duckdb.org/2022/07/27/art-storage.html
from databend.
cc @dantengsky I think we need to support it in soon.
from databend.
We can investigate how snowflake implement this (data unique constraint), and I have a question: is ART Tree suitable for object storage ?
from databend.
well, in fact, snowflake has a unique store (https://www.snowflake.com/en/data-cloud/workloads/unistore/). They are developing it, but we can't get the source code and design details. But we can still find out some metarials like https://www.areto.de/wp-content/uploads/snowflake-unistore-Solution-Brief.pdf. By the way, I choose art-tree index for databend, because we have a good reference in open-source product and there are good metariels for us. However, this is not decided, this issue is just a temporary decision, we need to do more surveys and I'm preparing the ArtTree design details for databend.
from databend.
We can investigate how snowflake implement this (data unique constraint), and I have a question: is ART Tree suitable for object storage ?
for now, they don't support.
from databend.
Is ART Tree suitable for object storage ? I think this question is very important, because Databend is not a memory or disk oriented database.
from databend.
We can investigate how snowflake implement this (data unique constraint), and I have a question: is ART Tree suitable for object storage ?
for now, they don't support.
Snowflake already supported it, you can see: https://docs.snowflake.com/en/sql-reference/sql/create-table-constraint?utm_source=snowscope&utm_medium=serp&utm_term=primary+key
from databend.
We can investigate how snowflake implement this (data unique constraint), and I have a question: is ART Tree suitable for object storage ?
for now, they don't support.
Snowflake already supported it, you can see: https://docs.snowflake.com/en/sql-reference/sql/create-table-constraint?utm_source=snowscope&utm_medium=serp&utm_term=primary+key
well, I think you can see this https://docs.snowflake.com/en/sql-reference/constraints, they just support it as definition, they don't support it.
from databend.
Is ART Tree suitable for object storage ? I think this question is very important, because Databend is not a memory or disk oriented database.
good question, give a initial judge:
- for s3 storage, it does't support update-in-place, the good news is that we can do append-only spilled ArtTree.
- Transaction ACID, well, we can treat it as a mutation operation.
This issue is just an initial way to solve our unique key problem, and by importing a new index, we can give optimizer more info to speed query and mutation operations. So I need to do more research and give detailed docs for this design. This maybe take a long time to do.
from databend.
Related Issues (20)
- Feature: show grants need to be more readable HOT 1
- Feature: Further improvement on configure user
- Tracking issue: RBAC improvement plan in 2024 Q1
- Feature: add state column in `system.clusters` table.
- Loading hits data failed
- Feature: add create or replace agg index support
- feat: enables the bloom runtime filter to be turned on adaptively
- Feature: add create or replace virtual column support
- Link Checker Report
- Feature: create or replace password policy
- Feature: create or replace masking policy
- Feature: create or replace network policy
- Feature: create or replace share endpoint
- CREATE [ OR REPLACE ] WAREHOUSE|TASK/PIPE HOT 1
- Feature: 创建表的时候 带有 unsigned HOT 2
- bug: Resolving DNS error at Databend startup In OpenEuler HOT 1
- Databend startup failed with list timeout HOT 4
- Feature: Dot Notation support in querying variant & tuple values
- bug: unnest Array<Variant>
- flaky ci 09_0035_merge_into_separate_pipeline_without_distributed_enable
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from databend.