Comments (4)
danny0405
commented on June 21, 2024
It shows the shaded hudi google guava jar is missing.
from hudi.
Jetiaime
commented on June 21, 2024
It shows the shaded hudi google guava jar is missing.
Yes, And I compiled again without -Pspark-bundle-shade-hive, and it worked fine so far. I'm comfused by this profile, why it should be added in flink like-Pflink-bundle-shade-hive3, but not in spark ?
from hudi.
danny0405
commented on June 21, 2024
flink use it for avoiding the jar conflicts with other Hive related jars, not sure whether Spark needs this.
from hudi.
ad1happy2go
commented on June 21, 2024
@Jetiaime Spark dont need it.
from hudi.
Related Issues (20)
- Critical and High vulnerabilities reported in hudi jar HOT 7
- [SUPPORT] Using BULK_INSERT mode multiple times writing causing a bug: Duplicate fileId 00000000-8651-4ae5-8f9e-4424fed2d181 from bucket 0 of partition found during the BucketStreamWriteFunction index bootstrap. HOT 1
- Nested object support in Hudi Table using Flink HOT 12
- [SUPPORT] Requesting Support for insert_overwrite in Delta Streamer HOT 12
- [SUPPORT] Occur bucketid multiple cannot write data to the wrong partition HOT 4
- [SUPPORT] Questions about LOG in Hudi source code HOT 2
- [SUPPORT] IllegalArgumentException at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:33) HOT 16
- [SUPPORT] The parquet files for the MOR table have been generated, but the RO table in Hive still cannot query the latest data in the parquet files. HOT 7
- [SUPPORT] Flink-Hudi - Upsert into the same Hudi table via two different Flink pipelines (stream and batch) HOT 2
- [SUPPORT] AWS Glue 4.0 taking to long to write to S3 HOT 3
- [SUPPORT] How to run org.apache.spark.sql.execution.benchmark.LSMTimelineReadBenchmark ？ HOT 6
- [SUPPORT] During the process of ingesting data from Kafka and persisting it into a Hudi MOR table, an Out of Memory exception was encountered HOT 3
- [SUPPORT] No way to clean `archived/` folder HOT 4
- [SUPPORT] Data duplicated in base file on updating record partition HOT 4
- [SUPPORT] Optimized code ComparableVersion HOT 3
- Data lose after writing HOT 4
- [SUPPORT] Avoid direct dependency on Flink Table Planner Jar HOT 2
- [SUGGEST] Can the community version be updated regularly and faster? The roadmap should also be updated regularly and synchronized. HOT 2
- [SUPPORT] Insert and Delete in a Single Operation. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hudi.