Comments (4)
@gunnarmorling wal2json sets OUTPUT_PLUGIN_TEXTUAL_OUTPUT
, so AFAIK it's in the server's encoding.
#40 discusses a couple of other quirks.
from wal2json.
@gunnarmorling From the PostgreSQL manual:
PostgreSQL allows only one character set encoding per database. It is therefore not possible for the JSON types to conform rigidly to the JSON specification unless the database encoding is UTF8. Attempts to directly include characters that cannot be represented in the database encoding will fail; conversely, characters that can be represented in the database encoding but not in UTF8 will be allowed.
from wal2json.
@eulerto, that text above applies to JSONB-typed columns, right? So unless I'm mistaken, the wal2json plug-in could still use any other encoding? As per @rcoup, it's the server's encoding. So I suppose we can query the server for that and use the server encoding when parsing incoming messages.
We'll have to see though how that works with Jackson which we use as a parser; I'm not sure whether it supports any encodings other than UTF-8/16/32.
from wal2json.
@eulerto, that text above applies to JSONB-typed columns, right? So unless I'm mistaken, the wal2json plug-in could still use any other encoding? As per @rcoup, it's the server's encoding. So I suppose we can query the server for that and use the server encoding when parsing incoming messages.
That is not limited to JSONB. It is valid for JSON data types. I said that because we use the same API/rules as JSON data types. Hence, this difference in the encoding between JSON standard and Postgres is also valid for wal2json.
We'll have to see though how that works with Jackson which we use as a parser; I'm not sure whether it supports any encodings other than UTF-8/16/32.
server_encoding is available while establishing a connection.
from wal2json.
Related Issues (20)
- wal2json.c:461:11: error: no member named 'has_catalog_changes' in 'struct ReorderBufferTXN'
- PostgreSQL 15 support HOT 1
- wal2json limitation HOT 2
- Can't enable truncation for format-version 1 HOT 1
- WAL2JSON Format-1 not including Current lsn HOT 3
- When attempting logical decoding : /usr/lib64/pgsql/wal2json.so: undefined symbol: elog_finish HOT 2
- Change data not captured properly while operating with partition tables HOT 1
- Getting table name in double Quotes HOT 2
- Segmentation fault HOT 1
- ERROR: could not load library "C:/Program Files/PostgreSQL/9.5/lib/wal2json.dll": The specified module could not be found. HOT 1
- START_REPLICATION command does not work with wal2json options HOT 1
- NaN values are received as "null" for NUMERIC type while capturing change data HOT 4
- Invalid JSON with non-transactional message HOT 5
- WAL record received in different formats when the table name contains the single quote HOT 1
- Add support for update_replication_progress introduced in pg15
- Install failed on Alpine 15 HOT 2
- ProgramLimitExceeded plugin wal2json HOT 2
- include-pk can't work with identity full? HOT 2
- Official instructions to build from source for production use HOT 1
- Change data not captured HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wal2json.