StringencyIndexForDisplay data missing/NaN for last 2 days for over 100 countries about covid-policy-tracker

[TobyPhillips]

Thanks for flagging this. We seem to have an issue with the way we pull forward data internally. It is fine for days up to 31 May (I think), but breaks after that. We have identified the cause and just figuring out the best way to fix it.

[TobyPhillips]

I think we have this fixed now; let me know if you still see an issue.
-Toby

[KlausGPaul]

Thanks, Toby,
will check and get back to you tomorrow. If you find it useful, here is my code snippet I use to pad the data which also prints could country ISO3's and number of days missing.

dfOxCGRT = pd.read_csv("./OxCGRT_latest.csv")[["CountryCode","Date","StringencyIndexForDisplay"]]
dfOxCGRT.rename(columns={'StringencyIndexForDisplay':'string_idx'},inplace=True)

dfOxCGRT["date"] = pd.to_datetime(dfOxCGRT.Date,format="%Y%m%d")
del dfOxCGRT["Date"]

alldf = []

for country_code in dfOxCGRT.CountryCode.unique():
    ddf = dfOxCGRT[(dfOxCGRT.CountryCode == country_code)&(dfOxCGRT.string_idx>=0)]
    if len(ddf)<= 0:
        continue
    last_entry = ddf.date.max()
    age = pd.to_datetime(datetime.date.today()-datetime.timedelta(days=1))-last_entry
    age_days = int(age.total_seconds()/86400)
    if age_days > 1:
        string_idx = ddf[ddf.date == last_entry].string_idx.values[0]
        print("{} {} ({})".format(country_code,age_days,string_idx),end="..")
        alldata = []
        for i in range(age_days+1):
            newdate = last_entry+datetime.timedelta(days=i)#).date()
            alldata.append({"CountryCode":country_code,
                            "string_idx":string_idx,
                            "date":newdate})
        alldf.append(ddf.append(pd.DataFrame(alldata)))
    else:
        print("{} OK".format(country_code),end="..")
        alldf.append(ddf)
        
dfOxCGRT_padded = pd.DataFrame().append(alldf)
dfOxCGRT_padded.reset_index(inplace=True)
del dfOxCGRT_padded["index"]
dfOxCGRT_padded.to_parquet("./OxCGRT_timeseries_all.parquet")

[KlausGPaul]

StringencyIndexForDisplay now is padded as intended, issue is closed.
Thanks for your help!
Klaus