load might support a cache mechanism about queryverse.jl

[oxinabox]

Using DataDeps with this should be trivial.

something like (not tested so maybe has typos)

using DataDeps

function __init__()
    register(DataDep("Queryverse Tests", 
        "Testing data for queryverse", 
        "https://raw.githubusercontent.com/davidanthoff/CSVFiles.jl/master/test/data.csv"
    ))
end

df = load(datadep"Queryverse Tests/data.csv") |> DataFrame

In fact,
one of the examples on my blog
is using DataDeps with ExcelFiles.jl which is part of queryverse right?

[oxinabox]

I guess I am missing why this wants to actually be part of queryverse, or FileIO.jl

Queryverses in built functionality to work directly on URL is just a convenience for when it is convenient (small data, or single use scripts).
Beyond that the user can just use other packages for external cached fetching,
and such packages are going to address a wider range of surrounding issues than trying to capture this functionality as an extension to the existing convenience functionality.

To be clear,
Is it just a docs thing?
to improve discoverability across the Julia ecosystem?

[femtotrader]

Yes I think for DataDeps a doc effort is required into Queryverse to give it some highlight.

[femtotrader]

But I think some parameters of DataDep (such as Message) should be optional

[femtotrader]

With RemoteFiles.jl, it can be achieved using

using Queryverse
using RemoteFiles
data = RemoteFile("https://raw.githubusercontent.com/davidanthoff/CSVFiles.jl/master/test/data.csv")
download(data)
df = load(path(data)) |> DataFrame

but maybe a better API should be defined.

julia> load(RemoteFile("https://raw.githubusercontent.com/davidanthoff/CSVFiles.jl/master/test/data.csv")) |> DataFrame
ERROR:
MethodError: no method matching load(::RemoteFiles.RemoteFile)
Closest candidates are:
  load(::Union{AbstractString, IO}, ::Any...; options...) at /Users/femto/.julia/v0.6/FileIO/src/loadsave.jl:113
  load(::FileIO.Formatted{F}, ::Any...; options...) where F at /Users/femto/.julia/v0.6/FileIO/src/loadsave.jl:167

maybe load function should be defined
see helgee/RemoteFiles.jl#3