Showing content from https://github.com/pandas-dev/pandas/issues/55564 below:
resolution inference in vectorized datetime parsing · Issue #55564 · pandas-dev/pandas · GitHub
I'm in the process of implementing resolution inference for vectorized datetime parsing in array_to_datetime. This issue is to track and discuss design issues.
- Should we implement this as a breaking change in 3.0 or bugfix in 2.x? We changed the scalar behavior in 2.0.
- What to do when mixed resolutions are detected? e.g.
pd.to_datetime(["2016-01-01", "2016-01-01T02:03:04.050607"])? ATM in the branch I have going I get the resolution from the first non-NaT entry and apply that everywhere.
i) Are we OK with that value-dependent behavior?
ii) What if we see a np.datetime64("nat", "s") i.e. it has a reso attached. should we infer "s" from that?
- What resolution to infer for "today" or "now"? ATM the Timestamp constructor gives "ns", but bc it goes through the stdlib datetime.now, I'm thinking "us" might be more appropriate. (i also don't care that much)
- ATM i only handle array_to_datetime, also need to handle array_strptime.
- Need to do the same for the timedelta64 paths.
ATM 1455 tests are failing locally. Hopefully these are mostly bc they hard-code ns in "expected".
cc @MarcoGorelli
Issues that I think implementing this will address
RetroSearch is an open source project built by @garambo
| Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4