Comments (8)
请求头csv相关参数设置如下,其中f4为base64格式,所以包含\r\n:
columns: f1,f2,f3,f4,f5,f6
column_separator: ,
enclose: '
escape: \
数据格式如下,其中的\r\n为换行符非转义后的字符:
1,2,3,'line1\r\nline2\r\nline3\r\n...',5,6
1,2,3,'line1\r\nline2\r\nline3\r\n...',5,6
...
相同的一批数据,如果按每10条一批插入就没问题,按10000条左右(共64MB左右)批量插入就会报错,其中某行会从lineN被截断
from doris.
#34364 这个pr应该fix这个问题,你试下2.1.3版本看看的
from doris.
好的非常感谢,我试一下
from doris.
#34364 这个pr应该fix这个问题,你试下2.1.3版本看看的
我跟这个pr应该不是相同的问题,他的问题是必现的,跟数据量无关,我的是跟批量文件大小相关的,把大文件(64MB左右)拆分为小几个文件再执行就不会报错
from doris.
@heartdance 试了新版还是不行吗?那个bug大文件容易触发到
from doris.
@heartdance 试了新版还是不行吗?那个bug大文件容易触发到
是的,还是有同样的问题
from doris.
我看了下be日志,有如下报错:
stream_load.cpp:349] append body content failed, errmsg=[INTERNAL_ERROR]cancelled: closed, id=...
stream_load_executor.cpp:100] fragment execute failed, err_msg=[DATA_QUALITY_ERROR]too many filtered rows, id=...
from doris.
please add my wechat: Faith_xzc
from doris.
Related Issues (20)
- [Bug] COM_STMT_PREPARE_OK should be at least 12 bytes for MySQL 5.7 clients HOT 1
- [Feature] Doris support GWP-ASan
- [Bug] In function can not filter null data
- mysql_ssl功能不生效
- Release Note 2.0.13
- [Bug] UNIQUE table uses substantially (2x +) more storage than DUPLICATE
- [Bug] be必须要关闭swap才能运行,我这边是在自己的笔记本上跑,无法提供大内存 HOT 1
- [Bug] 通过mysql JDBC 删除记录,删除成功了,但是返回影响记录数为0
- [Feature] 期望支持webui,用来分析日志
- [Feature](test)Using Awaitility for Asynchronous Testing
- [Bug] 根据官网教程run-docker-cluster,构建2.1.4的fe镜像,启动报错standard_init_linux.go:211: exec user process caused "no such file or directory" HOT 1
- [Bug] doris query hudi hudi_table_name_rt .NoSuchMethodError HOT 1
- [Bug] doris正常移除节点后,在添加回去,在show backends中无法发现节点
- [Bug] HOT 1
- [Enhancement] LakeSoul Catalog support Filter Pushdown & Cdc data handling & S3 data access
- [Feature] ranger audit support
- [Bug] query result's column name becomes value HOT 3
- [Bug] MySQL protocol cannot obtain decimal precision when SSL is enabled HOT 1
- [Bug] Doris create catalog fail with error setting certificate verify locations HOT 1
- [Bug] rename column with inverted index throw error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from doris.