Behaviour of error in sql_raw output about benthos

[mihaitodor]

Hey @mwindmark, I believe this is a duplicate of #1677. If you only need a simple query, in your case I think it should be possible to use sql_insert and that one has the desired semantics. With sql_raw it's a bit difficult, because what you need is this query INSERT INTO table_x(id, a, b) VALUES('1_2', '1', '2'), ('2_2', '2', '2') and the number of tuples after VALUES depends on the batch size, which makes it extra-annoying. One can use Bloblang to craft such a query dynamically and set unsafe_dynamic_query: true to achieve the desired behaviour, but it's a bit cumbersome. Alternatively, at least some SQL drivers should support passing an array of values to each tuple element when calling db.ExecContext(...), but it requires some investigation to have it work similarly to sql_insert.

LE: I shared a bloblang-based workaround in a comment under #1677.

LLE: Here's a Postgres-specific approach which uses arrays: https://klotzandrew.com/blog/postgres-passing-65535-parameter-limit

[mihaitodor]

Closing in favour of #1677.