pandas-dev/pandas issues and pull requests

#62542 - BUG: make `read_csv` be able to read large floating numbers into float

Pull Request - State: closed - Opened by Alvaro-Kothe about 2 months ago - 5 comments
Labels: IO CSV

#62053 - BUG: read_csv with engine=pyarrow and numpy-nullable dtype

Pull Request - State: closed - Opened by jbrockmendel 4 months ago - 7 comments
Labels: IO CSV

#61837 - BUG: read_csv() on_bad_lines callable does not raise ParserWarning when index_col is set

Issue - State: closed - Opened by matthewgottlieb 4 months ago - 2 comments
Labels: Bug, IO CSV

#61832 - REF: separate out helpers in libparser

Pull Request - State: closed - Opened by jbrockmendel 4 months ago - 1 comment
Labels: IO CSV

#61825 - PERF: Brainstorming read_csv perf improvements

Issue - State: open - Opened by jbrockmendel 4 months ago - 3 comments
Labels: Performance, IO CSV, Needs Discussion

#61813 - ENH: Add Polars engine to read_csv

Issue - State: open - Opened by datapythonista 4 months ago
Labels: IO CSV, good first issue

#61785 - REF: remove unreachable, stronger typing in parsers.pyx

Pull Request - State: closed - Opened by jbrockmendel 5 months ago - 1 comment
Labels: IO CSV

#61785 - REF: remove unreachable, stronger typing in parsers.pyx

Pull Request - State: closed - Opened by jbrockmendel 5 months ago
Labels: IO CSV

#61730 - BUG: `read_csv()` : inconsistent dtype and content parsing.

Issue - State: closed - Opened by 945fc41467 5 months ago - 3 comments
Labels: Bug, IO CSV, Needs Triage

#61700 - ENH: When read_csv reports an error, include the column name and row number

Issue - State: open - Opened by johann-petrak 5 months ago - 1 comment
Labels: Enhancement, Error Reporting, IO CSV, Needs Triage

#61692 - ENH: Add `excel_sep_hint` parameter to `to_csv` for Excel compatibility

Issue - State: open - Opened by EwoutH 5 months ago - 1 comment
Labels: Enhancement, IO CSV, Needs Triage

#61650 - feature #49580: support new-style float_format string in to_csv

Pull Request - State: closed - Opened by pedromfdiogo 5 months ago - 2 comments
Labels: Enhancement, IO CSV

#61650 - feature #49580: support new-style float_format string in to_csv

Pull Request - State: closed - Opened by pedromfdiogo 5 months ago - 5 comments
Labels: Enhancement, IO CSV

#61617 - BUG: numpy_nullable NaNs do not round-trip through CSV

Issue - State: open - Opened by jbrockmendel 5 months ago - 2 comments
Labels: Bug, IO CSV, PDEP missing values

#61538 - usecols investigation for various I/O functions

Issue - State: closed - Opened by eicchen 6 months ago - 1 comment
Labels: IO CSV, Needs Discussion

#61535 - ENH: read_csv tz option

Issue - State: open - Opened by hasandiwan 6 months ago - 1 comment
Labels: Enhancement, IO CSV, Needs Triage, Closing Candidate

#61514 - BUGFIX: escape `quotechar` when `escapechar` is not None (even if quoting=csv.QUOTE_NONE)

Pull Request - State: closed - Opened by KevsterAmp 6 months ago - 1 comment
Labels: IO CSV

#61514 - BUGFIX: escape `quotechar` when `escapechar` is not None (even if quoting=csv.QUOTE_NONE)

Pull Request - State: closed - Opened by KevsterAmp 6 months ago - 2 comments
Labels: IO CSV

#61496 - BUG: Passing string[pyarrow] to the dtype parameter of e.g. csv_read() does produce a string type Series

Issue - State: open - Opened by ClauPet 6 months ago - 3 comments
Labels: Dtype Conversions, IO CSV, Strings, Needs Discussion, Arrow

#61275 - [WIP] ENH: support reading directory in read_csv

Pull Request - State: open - Opened by fangchenli 7 months ago
Labels: IO CSV

#61275 - [WIP] ENH: support reading directory in read_csv

Pull Request - State: open - Opened by fangchenli 7 months ago - 4 comments
Labels: IO CSV

#61157 - Preserve Complex Data Types for to_csv

Pull Request - State: closed - Opened by Jaspvr 8 months ago - 4 comments
Labels: Enhancement, IO CSV, Complex, Needs Discussion

#61145 - BUG: Inconsistent index type when using read_csv with string[pyarrow] dtype

Issue - State: open - Opened by ptth222 8 months ago - 4 comments
Labels: Bug, IO CSV, Needs Discussion, API - Consistency

#61046 - perf: improve membership check performance in column filtering

Pull Request - State: closed - Opened by allrob23 9 months ago - 6 comments
Labels: Performance, IO CSV

#61046 - perf: improve membership check performance in column filtering

Pull Request - State: closed - Opened by allrob23 9 months ago - 7 comments
Labels: Performance, IO CSV

#61045 - PERF: Optimize membership check in column filtering for better performance

Issue - State: closed - Opened by allrob23 9 months ago
Labels: Performance, IO CSV

#60895 - Support for Storing and Retrieving Complex Data Types (e.g., Embeddings) in Pandas DataFrames

Issue - State: closed - Opened by ashishjaimongeorge 9 months ago - 5 comments
Labels: Enhancement, IO CSV, Complex

#60779 - BUG: pd.read_csv Incorrect Checksum validation for COMPOSITE Checksum

Issue - State: closed - Opened by munch9 10 months ago - 2 comments
Labels: Bug, IO CSV, IO Network, Needs Triage

#60689 - PERF: Fix ASV CSV benchmarks

Pull Request - State: closed - Opened by rhshadrach 10 months ago - 1 comment
Labels: Performance, IO CSV

#60689 - PERF: Fix ASV CSV benchmarks

Pull Request - State: closed - Opened by rhshadrach 10 months ago - 1 comment
Labels: Performance, IO CSV

#60683 - TST(string dtype): Resolve xfails in test_to_csv

Pull Request - State: closed - Opened by rhshadrach 10 months ago
Labels: Testing, IO CSV, Strings

#60683 - TST(string dtype): Resolve xfails in test_to_csv

Pull Request - State: closed - Opened by rhshadrach 10 months ago - 3 comments
Labels: Testing, IO CSV, Strings

#60672 - BUG: read_csv: Columns Silently Forced into Multi Index

Issue - State: closed - Opened by cdelisle95 11 months ago - 2 comments
Labels: Bug, IO CSV

#60363 - DOC: Add examples for float_format in to_csv documentation

Issue - State: closed - Opened by felicijo about 1 year ago - 1 comment
Labels: Docs, IO CSV

#60321 - TST (string dtype): resolve all xfails in IO parser tests

Pull Request - State: closed - Opened by jorisvandenbossche about 1 year ago
Labels: IO CSV, Strings

#60321 - TST (string dtype): resolve all xfails in IO parser tests

Pull Request - State: closed - Opened by jorisvandenbossche about 1 year ago - 3 comments
Labels: IO CSV, Strings

#60286 - TST: Add test for `pd.read_csv` date parsing not working with `dtype_backend="pyarrow"` and missing values

Pull Request - State: closed - Opened by KevsterAmp about 1 year ago - 2 comments
Labels: Testing, Missing-data, IO CSV, Arrow

#60286 - TST: Add test for `pd.read_csv` date parsing not working with `dtype_backend="pyarrow"` and missing values

Pull Request - State: closed - Opened by KevsterAmp about 1 year ago - 1 comment
Labels: Testing, Missing-data, IO CSV, Arrow

#60100 - BUG: `read_csv` with chained fsspec TAR file and `compression="infer"`

Pull Request - State: closed - Opened by KevsterAmp about 1 year ago - 9 comments
Labels: Bug, IO CSV

#60100 - BUG: `read_csv` with chained fsspec TAR file and `compression="infer"`

Pull Request - State: closed - Opened by KevsterAmp about 1 year ago - 8 comments
Labels: Bug, IO CSV

#60028 - BUG: read_csv with chained fsspec TAR file and compression="infer" fails with tarfile.ReadError

Issue - State: closed - Opened by mxmlnkn about 1 year ago - 4 comments
Labels: Bug, IO CSV

#59904 - BUG: pd.read_csv date parsing not working with dtype_backend="pyarrow" and missing values

Issue - State: closed - Opened by mhabets about 1 year ago - 12 comments
Labels: Bug, Missing-data, IO CSV, good first issue, Needs Tests, Arrow

#59839 - ENH: add a comments variable to pandas.DataFrame.to_csv

Issue - State: closed - Opened by ebo about 1 year ago - 11 comments
Labels: Enhancement, IO CSV, Needs Discussion, Closing Candidate

#59755 - Fix/na_values_GH59303

Pull Request - State: closed - Opened by sshu2017 about 1 year ago - 1 comment
Labels: IO CSV

#59755 - Fix/na_values_GH59303

Pull Request - State: closed - Opened by sshu2017 about 1 year ago - 2 comments
Labels: IO CSV

#59608 - PERF: Performance Improvement on `DataFrame.to_csv()` when `index=False`

Pull Request - State: closed - Opened by KevsterAmp about 1 year ago - 2 comments
Labels: Performance, IO CSV

#59608 - PERF: Performance Improvement on `DataFrame.to_csv()` when `index=False`

Pull Request - State: closed - Opened by KevsterAmp about 1 year ago - 3 comments
Labels: Performance, IO CSV

#59454 - BUG: escapechar=',' Causes Double Commas in Output in Pandas 2.2.2

Issue - State: closed - Opened by SamuelManaay over 1 year ago - 5 comments
Labels: Bug, IO CSV

#59318 - DOC: Typo in docs for na_values parameter in pandas.read_csv function #59314

Pull Request - State: closed - Opened by kushagr96 over 1 year ago - 5 comments
Labels: Docs, IO CSV

#59316 - BUG: Avoid RangeIndex conversion in read_csv if dtype is specified

Pull Request - State: open - Opened by mroeschke over 1 year ago
Labels: Dtype Conversions, IO CSV

#59316 - BUG: Avoid RangeIndex conversion in read_csv if dtype is specified

Pull Request - State: closed - Opened by mroeschke over 1 year ago - 1 comment
Labels: Dtype Conversions, IO CSV

#59312 - PERF: Significant Performance Difference in DataFrame.to_csv() with and without Index Reset

Issue - State: closed - Opened by hogan-roblox over 1 year ago - 2 comments
Labels: Performance, IO CSV

#59303 - QST: Is this expected behavior when pd.read_csv() with na_values arguments?

Issue - State: closed - Opened by sshu2017 over 1 year ago - 12 comments
Labels: Bug, Missing-data, IO CSV

#59210 - CLN: More read_csv state

Pull Request - State: closed - Opened by mroeschke over 1 year ago - 1 comment
Labels: Refactor, IO CSV

#59194 - REF: Minimize state in read_csv

Pull Request - State: closed - Opened by mroeschke over 1 year ago
Labels: Refactor, IO CSV

#59194 - REF: Minimize state in read_csv

Pull Request - State: closed - Opened by mroeschke over 1 year ago
Labels: Refactor, IO CSV

#59139 - ValueError: Usecols do not match columns, columns expected but not found: ['Col3', 'Col1']

Issue - State: open - Opened by Hermann12 over 1 year ago - 6 comments
Labels: Bug, IO CSV

#59080 - BUG: Fix read_csv raising TypeError when iterator and nrows are specified without chunksize

Pull Request - State: closed - Opened by Aloqeely over 1 year ago - 1 comment
Labels: IO CSV

#59080 - BUG: Fix read_csv raising TypeError when iterator and nrows are specified without chunksize

Pull Request - State: closed - Opened by Aloqeely over 1 year ago
Labels: IO CSV

#59079 - BUG: read_csv throws TypeError with iterator, nrows

Issue - State: closed - Opened by mdavis-xyz over 1 year ago - 2 comments
Labels: Bug, IO CSV

#59075 - BUG: Add type check for encoding_errors in pd.read_csv

Pull Request - State: closed - Opened by Aliebc over 1 year ago - 3 comments
Labels: Error Reporting, IO CSV

#59075 - BUG: Add type check for encoding_errors in pd.read_csv

Pull Request - State: closed - Opened by Aliebc over 1 year ago - 2 comments
Labels: Error Reporting, IO CSV

#58996 - BUG: csv date inconsistencies

Issue - State: closed - Opened by rdeteix over 1 year ago - 2 comments
Labels: Bug, IO CSV, Closing Candidate

#58870 - ENH: skiprows after header in read_csv

Issue - State: closed - Opened by davetapley over 1 year ago - 2 comments
Labels: Enhancement, IO CSV, Needs Discussion

#58760 - ENH: Randomised row selection with read_csv()

Issue - State: closed - Opened by Arjun-G-Ravi over 1 year ago - 4 comments
Labels: Enhancement, IO CSV, Closing Candidate

#58679 - Potential regression induced by "CLN: Enforce read_csv(keep_date_col, parse_dates) deprecations (#58622)"

Issue - State: closed - Opened by DeaMariaLeon over 1 year ago
Labels: IO CSV, Benchmark

#58668 - CLN: Remove deprecated read_csv(delim_whitespace=)

Pull Request - State: closed - Opened by mroeschke over 1 year ago - 2 comments
Labels: IO CSV, Clean

#58668 - CLN: Remove deprecated read_csv(delim_whitespace=)

Pull Request - State: closed - Opened by mroeschke over 1 year ago - 2 comments
Labels: IO CSV, Clean

#58666 - Clarify on_bad_lines PyArrow in read_csv

Pull Request - State: closed - Opened by wjandrea over 1 year ago
Labels: Docs, IO CSV

#58666 - Clarify on_bad_lines PyArrow in read_csv

Pull Request - State: closed - Opened by wjandrea over 1 year ago - 1 comment
Labels: Docs, IO CSV

#58661 - DOC: Add examples for pd.read_csv

Pull Request - State: closed - Opened by Aloqeely over 1 year ago
Labels: Docs, IO CSV

#58661 - DOC: Add examples for pd.read_csv

Pull Request - State: closed - Opened by Aloqeely over 1 year ago - 1 comment
Labels: Docs, IO CSV

#58624 - CLN: Remove deprecated read_*(date_parser=)

Pull Request - State: closed - Opened by mroeschke over 1 year ago
Labels: IO CSV, Clean

#58624 - CLN: Remove deprecated read_*(date_parser=)

Pull Request - State: closed - Opened by mroeschke over 1 year ago
Labels: IO CSV, Clean

#58622 - CLN: Enforce read_csv(keep_date_col, parse_dates) deprecations

Pull Request - State: closed - Opened by mroeschke over 1 year ago - 1 comment
Labels: IO CSV, Clean

#58622 - CLN: Enforce read_csv(keep_date_col, parse_dates) deprecations

Pull Request - State: closed - Opened by mroeschke over 1 year ago - 1 comment
Labels: IO CSV, Clean

#58410 - DEPR: nested parse_dates in read_csv

Pull Request - State: closed - Opened by jbrockmendel over 1 year ago - 1 comment
Labels: IO CSV, Clean

#58348 - Csv issue

Pull Request - State: closed - Opened by gb0808 over 1 year ago - 1 comment
Labels: IO CSV

#58348 - Csv issue

Pull Request - State: closed - Opened by gb0808 over 1 year ago - 1 comment
Labels: IO CSV

#58280 - CLN: Enforce the deprecation of `delim_whitespace` kwd in `read_csv`

Pull Request - State: closed - Opened by natmokval over 1 year ago - 1 comment
Labels: IO CSV, Clean

#58280 - CLN: Enforce the deprecation of `delim_whitespace` kwd in `read_csv`

Pull Request - State: closed - Opened by natmokval over 1 year ago - 1 comment
Labels: IO CSV, Clean

#58257 - BUG:Characters like '/' are being replaced by '_' when importing a CSV file into Python with pandas.

Issue - State: closed - Opened by harishvspeaker over 1 year ago - 6 comments
Labels: Bug, IO CSV, Needs Info

#58250 - ENH: DtypeWarning message enhancement

Pull Request - State: closed - Opened by abeltavares over 1 year ago
Labels: IO CSV, Warnings

#58250 - ENH: DtypeWarning message enhancement

Pull Request - State: closed - Opened by abeltavares over 1 year ago - 1 comment
Labels: IO CSV, Warnings

#58196 - ENH: pd.read_csv() does not reture back datetime dtypes after pd.to_csv()

Issue - State: closed - Opened by weikhor over 1 year ago - 2 comments
Labels: Enhancement, IO CSV, Closing Candidate

#58175 - TST: Remove deprecation check from test_pyarrow_engine

Pull Request - State: closed - Opened by Aloqeely over 1 year ago - 1 comment
Labels: Testing, IO CSV

#58175 - TST: Remove deprecation check from test_pyarrow_engine

Pull Request - State: closed - Opened by Aloqeely over 1 year ago
Labels: Testing, IO CSV

#58174 - ENH: DtypeWarning message enhancement

Issue - State: closed - Opened by VelizarVESSELINOV over 1 year ago - 2 comments
Labels: Enhancement, IO CSV, Warnings

#57968 - BUG: #57954 encoding ignored for filelike

Pull Request - State: closed - Opened by dontgoto over 1 year ago - 1 comment
Labels: Error Reporting, IO CSV

#57966 - CLN: Enforce verbose parameter deprecation in read_csv/read_table

Pull Request - State: closed - Opened by lithomas1 over 1 year ago - 2 comments
Labels: IO CSV, Clean

#57966 - CLN: Enforce verbose parameter deprecation in read_csv/read_table

Pull Request - State: closed - Opened by lithomas1 over 1 year ago
Labels: IO CSV, Clean

#57965 - BUG: Fix na_values dict not working on index column (#57547)

Pull Request - State: closed - Opened by tomhoq over 1 year ago - 1 comment
Labels: IO CSV

#57965 - BUG: Fix na_values dict not working on index column (#57547)

Pull Request - State: closed - Opened by tomhoq over 1 year ago - 3 comments
Labels: IO CSV

#57930 - BUG: pd.read_csv error when parse_dates used on index_col for dtype_backend="pyarrow"

Issue - State: closed - Opened by MCRE-BE over 1 year ago - 12 comments
Labels: Bug, Datetime, IO CSV, ExtensionArray, Arrow

#57874 - DOC: add note to how pandas deduplicate header when read from file

Pull Request - State: closed - Opened by quangngd over 1 year ago - 3 comments
Labels: Docs, IO CSV

#57874 - DOC: add note to how pandas deduplicate header when read from file

Pull Request - State: closed - Opened by quangngd over 1 year ago - 2 comments
Labels: Docs, IO CSV

#57836 - read_csv date_format parameter should allow lambda as a value

Issue - State: closed - Opened by hasandiwan over 1 year ago - 2 comments
Labels: Enhancement, IO CSV, Closing Candidate

#57792 - BUG: read_csv inconsistent behavior

Issue - State: closed - Opened by fgr1986 over 1 year ago - 7 comments
Labels: Docs, IO CSV, good first issue

#57547 - BUG: na_values dict form not working on index column

Issue - State: closed - Opened by thomas-intellegens over 1 year ago - 6 comments
Labels: Bug, IO CSV

#57455 - Backport PR #57450 on branch 2.2.x (DOC: Set verbose parameter as deprecated in docstring)

Pull Request - State: closed - Opened by meeseeksmachine almost 2 years ago
Labels: Docs, IO CSV

GitHub / pandas-dev/pandas issues and pull requests