Comments (4)
This would require two things:
- Allow merging of schemas with complex types (with dynamic columns).
- Extend conversion of complex (by complex I mean arbitrarily deeply nested struct and repeated types) parquet types to arrow types.
1 should be slightly easier now since parquet-go
now implements conversions, which happens to perfectly suit the dynamic columns use-case: https://github.com/segmentio/parquet-go#evolving-parquet-schemas-parquetconvert. 1 can also be implemented before 2 without breaking anything existing.
from frostdb.
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
from frostdb.
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
from frostdb.
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
from frostdb.
Related Issues (20)
- records.Build can be moved out of internal packages, so that we can use it to directly build arrow.record? HOT 6
- unsupport aggregation specific dynamic column HOT 1
- Move prehash function to happen before write to WAL
- unsupport avg on a single dynamic column HOT 1
- OrderedAggregate leaks memory HOT 1
- What is the state of schema v1alpha2 ? HOT 18
- memory leak for PredicateFilter HOT 1
- panic: Duplicate registration HOT 1
- `Test_Table_ReadIsolation` flaky
- MergeRecords can support array.Float64 sort? HOT 4
- Proper transaction support HOT 4
- Snapshot refactor
- index: block rotation deadlock due to not releasing parts
- snapshot: two snapshots at the same txn causes data loss
- Add renovate to keep our dependencies up-to-date HOT 1
- There is an issue with the combination of readOnlyTable and ValidateTableScan HOT 2
- arrowutils.mergeRecords function has an assertion error HOT 4
- The problem of combining aggregation function with custom runtime.GOMAXPROCS(1) HOT 1
- Access is denied HOT 4
- Several Issues on Iceberg HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from frostdb.