@transform and @where (maybe more) are broken on v0.7 about dataframesmeta.jl

[nalimilan]

Got an explanation on the Julia issue. #91 should fix it.

[nalimilan]

@bramtayl saved us last time by porting the macros to 0.6, maybe he has ideas? It would also be interesting to try reproducing the bug directly with where, i.e. without macros.

[bramtayl]

I dont think theres a macro issue here:

julia> MacroTools.prettify(@macroexpand @transform(dd, d = (:b ./ :c)))
:(transform(dd, d=(barracuda->begin
                  function echidna(lion, dinosaur)
                      dinosaur ./ lion
                  end
                  echidna(barracuda[:c], barracuda[:b])
              end)))

julia> MacroTools.prettify(@macroexpand @where(dd, :b .>= 0.2, :a .>= Date(1998)))
:(where(dd, (barracuda->begin
              function echidna(lion, dinosaur)
                  (dinosaur .>= 0.2) .& (lion .>= Date(1998))
              end
              echidna(barracuda[:b], barracuda[:a])
          end)))

Both seem reasonable to me, meaning the issues are in transform and where

[bramtayl]

Oh wait the argument order is backwards for where...

[bramtayl]

Ok so here's what I'm getting:

The order of the arguments for the "ecdina" function come in a random/inconsistent order. These arguments are the keys of the membernames Dict. Aren't keys and values are supposed to return items in a consistent order?

This behavior only appears when with_helper is nested within other functions. That is, this is working consistently for me:

:($d -> $(DataFramesMeta.with_helper(d, body))) |> MacroTools.prettify

But this is not:

DataFramesMeta.with_anonymous(body) |> MacroTools.prettify

[nalimilan]

Good catch! AFAIK entries in a dictionary are unordered, but it's guaranteed that keys and values use the same order. So maybe something has been broken in Base. It would help if we could identify the commit which broke this code. If it still works on the outdated Windows nightlies, we should be able to find it without too much work. Do you confirm that?

[bramtayl]

No it doesn't work on the current Windows nightly. I'm not sure how to figure out when the last time it was working...

[nalimilan]

I've found a MWE, filed in Julia as JuliaLang/julia#26359.