Window indexing algorithm about recordlinkage

[kevohagan]

@J535D165 would you have maybe an idea on how to do this? :/ thanks!

[J535D165]

hello @kevohagan

You are looking for an Adaptive Sorted Neighbourhood Indexing method. This is not implemented, but in your case, you can easily get very similar results with the Sorted Neighbourhood Indexing method.

# Convert the start day to a number. 
df_a['start_unix'] = (df_a['start'] - pd.datetime(1970, 1, 1)).days
df_b['start_unix'] = (df_b['start'] - pd.datetime(1970, 1, 1)).days - 1

# SNI indexer
indexer = recordlinkage.SortedNeighbourhoodIndex(left_on='start_unix', right_on='start_unix', window=3) 
indexer.index(df_a, df_b)

Or do your own merge (check the source code of BlockIndex and SNI) for details.

Hope it helps. I will take a look at how we can support an algorithm like this.

[kevohagan]

Okay thank you for the hint! I'll have a try and let you know :)