ENH: Include df.attrs metadata in to_csv output
#53740
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Given other discussions around df.attrs #52166 this implementation does not use or depend on |
canthonyscott
changed the title
df.attrs metadata in to_csv output
removed testing file removed testing file removed testing file cleaned up comments modified docstring
Grammatical error corrected.
* testing example in template * Added max example * Added groupby examples * Updated code_checks * Corrected alignment
…in Numpy 1.25 (pandas-dev#53548) * DEBUG: npdev build * Address tests where sorting changed * Adjust more tests * Undo everything, even nanargsort * xfail the relevant tests * Add xfail to test_sort_column_level_and_index_label
fixed missing return type hint fixed failing docstring ci tests
…ndle quotes on the write line yet. Need to test how it handles on the reads
…uts to prevnt downstream parsing errors
* Example for pct_change * Added examples for groupby sem, shift, size * Updated code_checks * Corrected error on groupby size
Added examples
* TST: Use more fixtures * Use more fixtures in test_indexing_slow * Move addition compression_to_extension * Use more fixture in sparse test_indexing * fixturize libsparse
* Examples Timestamp.time, timetuple, timetz, to_datetime64, toordinal * Added tests and updated code_checks.sh * Corrected time and timetz * Corrected Timestamp.time and timetz
* Adding implementation for deprecation and entry in whatsnew file * Updating unit tests to account for deprecating of series.last() and DataFrame.last() * Added deprecation message in doc string * Adding PR number to new unit test * Removing duplicate "Parameters" docstring header * Adding doctest skip for call to last()
…evels" (pandas-dev#53760) Revert "BUG: DataFrame.stack with sort=True and unsorted MultiIndex levels (pandas-dev#53637)" This reverts commit 5edc2cc.
* TST: refactor data path for xml tests * fix style * fix typo
* TST: Reduce memory pressure of plotting tests * Trigger ci * Remove gc call
* note pytest bump * update install.rst
COMPAT: Remove np.comat
* Added suggested new line to fix doc code example * Removed the newline * Done
* TST: Make test_complibs deterministic * Make sure files are unique? * Try unique key * Just xfail test * Check what is taking long * Remove -v * Filter warning
* Cleanup single used method * Clean plotting test * Improve test_series_groupby_nunique * Address more slow tests * Undo changes
…v#53794) TYP: type pytest.MarkDecorator
TST/CLN: use fixture path for all xml tests
…dev#53792) * BUG: combine_first ignoring others columns if other is empty * Fix
* BUG: bad display for complex series with nan * added comments * added more test cases
* CLN: assorted * revert pivot edits * revert np.float128 check
* examples TimedeltaArray, Period.asfreq * Examples for categoricals * Exampl Categorical.codes and .__array__, edited code_checks * Corrected TimedeltaArray and wording to categorical * remove multiline --------- Co-authored-by: MarcoGorelli <33491632+MarcoGorelli@users.noreply.github.com>
* Update governance.md Misspelling of Subcommittee * Update web/pandas/about/governance.md --------- Co-authored-by: Marco Edward Gorelli <marcogorelli@protonmail.com>
canthonyscott
force-pushed
the
csv-write-comments
branch
from
93b0e97 to
b865253
Compare
canthonyscott
requested review from
rhshadrach,
MarcoGorelli,
WillAyd,
datapythonista and
mroeschke
as code owners
|
Closing to cleanup my forked branch. Will re-open as a new PR |
5 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
doc/source/whatsnew/vX.X.X.rstfile if fixing a bug or adding a new feature.This new functionality writes DataFrame metadata stored in
df.attrsas header/comment lines at the top of a CSV file.to_csv()method had acommentparam added to its call, matching theread_csv()method signature[comment][key]:[value]