End-of-line comments causes syntax errors. about dbmigrations

[jtdaugherty]

I added some test cases to cover the two behaviors you mentioned, but it turns out neither is a bug. Both arise from how the underlying YAML parser treats the input data.

The first issue, that of inline comments causing trouble, is due to the fact that YAML parsers do "scalar folding" of values, converting newlines to spaces, unless explicitly told that values are to be treated as literals. The reason is that in YAML, indentation indicates an increase in structure depth, and the content at that depth is the interpreted as a YAML tree, and a literal is usually not what the subsequent tree value is intended to represent. So to fix this, you have to put a pipe following the key name and colon. It also turns out the old me that wrote this code knew about this confusion and even added a note to the README about it. So an example is

foo: |
  bar
  baz

and in that example, the newline in between bar and baz will be preserved. For dbmigrations, this is almost always what you want.

As for the second behavior, since YAML uses colons as delimiters to separate keys and values, and because dashes have special meaning to denote the beginning of a node in a list, the parser interpretes "-- foo:" as YAML. Again, this arises from the lack of a pipe specifying that the value is a literal. If you add that, the problem goes away.

The other advantage to doing this in both cases is that the structure of the SQL is preserved, and that will prevent the lack of newlines from confusing the SQL parser in the database engine.

[jtdaugherty]

I also updated the migration serialization to emit ASCII literal markings by default in 9692cc9, so that should reduce the chance of this being bothersome.

[creswick]

whoa! That's a somewhat unfortunate confluence of features, and an interesting problem to think about...