BUG: REGR: read_csv with memory_map=True raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data #43647
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Contributor
michal-gh commented Sep 18, 2021
michal-gh commented - [x ] closes BUG: REGR: read_csv with memory_map=True raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data #43540
- [x ] tests added / passed
- Ensure all linting tests pass, see here for how to run them
- [x ] whatsnew entry
3 tasks
twoertwein reviewed Sep 18, 2021
twoertwein added IO CSV 
jreback changed the title 
jreback reviewed Sep 20, 2021
doc/source/whatsnew/v1.3.4.rst Outdated
| - Fixed performance regression in :meth:`MultiIndex.equals` (:issue:`43549`) | ||
| - Fixed regression in :meth:`Series.cat.reorder_categories` failing to update the categories on the ``Series`` (:issue:`43232`) | ||
| - Fixed regression in :meth:`Series.cat.categories` setter failing to update the categories on the ``Series`` (:issue:`43334`) | ||
| - Fixed regression in :meth:`pandas.read_csv` raising UnicodeDecodeError exception when memory_map=True (:issue:`43540`) |
Contributor
There was a problem hiding this comment.
Suggested change
| - Fixed regression in :meth:`pandas.read_csv` raising UnicodeDecodeError exception when memory_map=True (:issue:`43540`) | |
| - Fixed regression in :meth:`pandas.read_csv` raising `UnicodeDecodeError` exception when `memory_map=True` (:issue:`43540`) |
Contributor Author
There was a problem hiding this comment.
Fixed in last commit
This reverts commit c2e91f8.
Contributor Author
| I updated |
twoertwein approved these changes Sep 21, 2021
jreback approved these changes Sep 21, 2021
Contributor
| thanks @michal-gh very nice. always happy to take further updates to master. |
Contributor
| @meeseeksdev backport 1.3.x |
meeseeksmachine pushed a commit to meeseeksmachine/pandas that referenced this pull request Sep 21, 2021
…e raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data
| Something went wrong ... Please have a look at my logs. |
simonjayhawkins pushed a commit that referenced this pull request Sep 22, 2021
…ap=True raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data ) (#43691) Co-authored-by: michal-gh <michaltus@gmail.com> Co-authored-by: Thomas Li <47963215+lithomas1@users.noreply.github.com>
Contributor Author
| Thank you @twoertwein , @jreback for help with this PR |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.