BUG: joining dataframes with multi-index and None index label results in AssertionError about pandas

[rhshadrach]

@SiddheshBangar - this raises an AssertionError - those shouldn't be exposed to the user (only things like ValueError, TypeError, etc). So this definitely looks like a bug. Also, if you replace None with "Y", then the operation is successful.

[SiddheshBangar]

Hey @nemausus, I just looked into your issue and the problem that i found is that the join method is trying to align the MultiIndex levels of the two DataFrames, but the names of the index levels are not aligned correctly.

>>> df1
     A
X     
3 3  1
>>> df2
     B
  X   
3 3  1

• df1 has a MultiIndex with names ["X", None]
• df2 has a MultiIndex with names [None, "X"]

So it gets confused because the index levels names do not match, even though the structure of the indices is the same.

So if the Data frames have the same names for their multiindex levels this issue can be fixed is what I think, as I tried to test it this is what I found:

>>> df2 = pd.DataFrame({"B": [1]}, index=pd.MultiIndex.from_tuples([(3, 3)], names=[None, "X"]))
>>> df1 = pd.DataFrame({"A": [1]}, index=pd.MultiIndex.from_tuples([(3, 3)], names=[None, "X"]))
>>> df1.join(df2)
     A  B
  X      
3 3  1  1

Let me know if this solves your issue or I can look more further into it, thanks.

[SiddheshBangar]

Hey @rhshadrach, so you mean to say that the error message should not be prompt or either error message can be fixed somehow and replace it with assertion error message.

[rhshadrach]

At a glance, it seems to me that this should not raise an error. If implementation difficulties make that difficult, then perhaps we can look into other possibilities. Further investigations are welcome!