JSON Lines format allow appending to an existing file in a easy way (new line with valid JSON string). Historically DataFrame().to_json didn't allowmode="a" because It would introduce complications of reading/parsing/changing pure JSON strings. But for JSON lines It's done in an elegant way, as easy as a CSV files.
The pandas way of using JSON lines is setting orient='records' together with lines=True, but It lacks a mode="a" for append mode. My feature proposal (PR already done, just need review) is simple: include the capability of append mode (mode="a") on to_json IF orient='records' and lines=True
The PR: #35832
If I got It right, the solution is simple:
mode: str = "w"on to_json this will NOT break anything as the default behavior continues as write modemode="a", checking if orient='records' and lines=True, raising an Exception otherwisemode="a" and the file already exists and is not empty, then add a new line to the JSON string (s = convert_to_line_delimits(s)) before sending to handlerget_handle(path_or_buf, mode, compression=compression) instead of the hardcoded get_handle(path_or_buf, "w", compression=compression) )RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4