Comments (4)
I see from the linked PR that you don't think this should be supported. Curious to hear your reasons why before anyone works on it.
I linked this there bc the expectation that this would already work bc the only difference is in how the DatetimeIndex is "backed" is incorrect (the Index in question is not a DatetimeIndex at all). I think part of that incorrect expectation is linked to the term "backend" and hope that using a more accurate term might avoid misconceptions.
As to the actual behavior, I'd be fine with it, though I expect the implementation would be very messy to the point where saying "convert to a DatetimeIndex" might be easier.
from pandas.
@WillAyd Can I work on this issue? I did not know arrow is supposed to work with pandas....
from pandas.
@jbrockmendel I see from the linked PR that you don't think this should be supported. Curious to hear your reasons why before anyone works on it.
pa.timestamp and pd.Timestamp share a lot of the same architecture (save missing value handling) so I think converting from one to another should be seamless. I'm definitely sympathetic to not trying to make everything they do the same, although indexing like this feels useful. I do think part of the confusion here could stem from the fact that we do not have a logical "timestamp" type, only physical
I came across this reading a CSV file with the pyarrow backend, which was great for strings but then didn't help me at all with timestamps.
from pandas.
Looks like this is actually a duplicate of #53154 - closing to keep the discussion there
from pandas.
Related Issues (20)
- BUG: pd.DataFrame.set_index() detects "label" input instead of "iterator" when keys argument is a list
- BUILD: 3rd party licenses are missing from pandas binary wheels distributed on pypi HOT 1
- BUG: `read_parquet` doesn't convert categories to `pd.CategoricalDtype` when `dtype_backend="pyarrow"`
- BUG: Unable to open Stata 118 or 119 files saved in big-endian format that contain strL data
- BUG: RangeIndex.searchsorted() when using a negative step HOT 3
- BUG: inconsistent behavior of pandas.api.types.pandas_dtype HOT 2
- BUG: DataFrame.groupby returns invalid value when dropna=False HOT 2
- ENH: Add paramenter `index` to `drop_duplicates` to drop duplicate indices
- Potential regression induced by "BUG: Use large_string in string array consistently" HOT 1
- Mac (with M2 chip) install of pandas with Poetry HOT 1
- REF/API: make construct_array_type a non-classmethod
- BUG: DatetimeIndex.is_year_start breaks on custom business days frequencies bigger then `1C`
- DEPR: Deprecate method argument of reindex_like HOT 4
- Potential regression induced by "CLN: Simplify map_infer_mask (#58483)" HOT 1
- Potential regression induced by "CLN: Enforce read_csv(keep_date_col, parse_dates) deprecations (#58622)"
- ENH: Also apply formatters to the index in `to_latex` HOT 3
- BUG: In `main`, using `resample().interpolate(inplace=True)` raises an exception HOT 7
- BUG: edge case when masking "null[pyarrow]" pd.Series
- BUG: .max() raises exception on Series with object dtype and mixture of Timestamp and NaT: TypeError: '>=' not supported between instances of 'Timestamp' and 'float' HOT 1
- BUG: numerical inconsistency in calculating rolling kurtosis HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pandas.