Skip to content

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xab in position 289: invalid start byte #8

@MahadevSV

Description

@MahadevSV

Hi, am getting error while loading the files into dataframe.
Please advice on this.
Here is the code and error:

Read and add data from file to a list

i=0
for f in labelled_files:
data_list.append((f,label_names[label_index[i]],Path(f).read_text()))
i += 1


UnicodeDecodeError Traceback (most recent call last)
in ()
2 i=0
3 for f in labelled_files:
----> 4 data_list.append((f,label_names[label_index[i]],Path(f).read_text()))
5 i += 1

~/anaconda3/lib/python3.6/pathlib.py in read_text(self, encoding, errors)
1195 """
1196 with self.open(mode='r', encoding=encoding, errors=errors) as f:
-> 1197 return f.read()
1198
1199 def write_bytes(self, data):

~/anaconda3/lib/python3.6/codecs.py in decode(self, input, final)
319 # decode input (taking the buffer into account)
320 data = self.buffer + input
--> 321 (result, consumed) = self._buffer_decode(data, self.errors, final)
322 # keep undecoded input until the next call
323 self.buffer = data[consumed:]

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xab in position 289: invalid start byte

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions