python - Read csv with tab delimiter produces errors -

-

i have csv file, uses '\t' tab delimiter. contains 5 columns. tried this:

import numpy np  #b=np.loadtxt(r'train_set.csv',dtype=str,delimiter=' ') my_data = np.genfromtxt('train_set.csv', delimiter='\t') print my_data

but getting following errors:

traceback (most recent call last):   file "./wordcloud.py", line 7, in <module>     my_data = np.genfromtxt('train_set.csv', delimiter='\t')   file "/usr/lib/python2.7/dist-packages/numpy/lib/npyio.py", line 1667, in genfromtxt     raise valueerror(errmsg) valueerror: errors detected !     line #14 (got 4 columns instead of 5)     line #21 (got 4 columns instead of 5)     line #135 (got 4 columns instead of 5)

any ideas please? not know python (yet :))!

the dataset (which examine right now) looks this:

enter image description here

edit:

if do:

my_data = np.genfromtxt('train_set.csv', delimiter='    ')

then getting no errors, output is:

[ nan  nan  nan ...,  nan  nan  nan]

the answer gives these warnings:

...     line #26310 (got 4 columns instead of 5)     line #26383 (got 4 columns instead of 5)     line #26448 (got 4 columns instead of 5)     line #26489 (got 4 columns instead of 5)     line #26589 (got 4 columns instead of 5)     line #26593 (got 4 columns instead of 5)     line #26888 (got 4 columns instead of 5)     line #27002 (got 4 columns instead of 5)     line #27065 (got 4 columns instead of 5)     line #27234 (got 3 columns instead of 5)     line #27327 (got 4 columns instead of 5)     line #27418 (got 4 columns instead of 5)     line #27594 (got 4 columns instead of 5)     line #27827 (got 4 columns instead of 5)     line #27944 (got 4 columns instead of 5)     line #28074 (got 4 columns instead of 5)     line #28102 (got 4 columns instead of 5)     line #28147 (got 4 columns instead of 5)     line #28224 (got 4 columns instead of 5)     line #28264 (got 4 columns instead of 5)     line #28344 (got 4 columns instead of 5)     line #28484 (got 4 columns instead of 5)   warnings.warn(errmsg, conversionwarning)

and output gets strange characters, like:

costing @ least \xc2\xa3429

in place of costing @ least £429.

can check line #14, 21, , 135 of csv file? these lines not contain 5 columns, error states (all of them contains 4 columns).

if 5th column supposed blank, insert \t character @ end.

looking @ data, want:

my_data = np.genfromtxt('train_set.csv', delimiter='\t',                         invalid_raise=false, skip_header=1,                         dtype=none)

invalid_raise: skip invalid lines (#14, 21 , 135). please recheck them. (in libre office: use 'save as')

skip_header: name explains itself.

dtype: should none, datatype of each column determined contents of column.


Comments

Post a Comment

Popular posts from this blog

c++ - llvm function pass ReplaceInstWithInst malloc -

-
#include "llvm/pass.h" #include "llvm/ir/module.h" #include "llvm/ir/function.h" #include "llvm/support/raw_ostream.h" #include "llvm/ir/legacypassmanager.h" #include "llvm/ir/instrtypes.h" #include "llvm/transforms/ipo/passmanagerbuilder.h" #include "llvm/ir/irbuilder.h" #include "llvm/transforms/utils/basicblockutils.h" using namespace llvm; namespace { struct replacepass : public functionpass { static char id; replacepass() : functionpass(id) {} virtual bool runonfunction(function &f) { allocainst* insttoreplace = ??? basicblock::iterator ii(insttoreplace); replaceinstwithinst(insttoreplace->getparent()->getinstlist(), ii, new allocainst(type::int32ty, 0, insttoreplace)); return true; } }; } char replacepass::id = 0; static void registerreplacepass(const passmanagerbuilder &, legacy::passmanagerbase &pm) { pm.add(new re
Read more

java.lang.NoClassDefFoundError When Creating New Android Project -

-
i've tried installing (and re-installing) android studio several times now, , each time, studio isn't able create new android project. when attempt initial android studio window (ie. basic 'create', 'open', 'import' etc options), i'm asked of questions in wizard, brief progress dialog, followed nothing @ all. if open incomplete project process creates choosing 'open' list, can try choosing create new android project menu. this has same issue, error message in output console time... java.lang.noclassdeffounderror: com/sun/xml/internal/bind/v2/model/annotation/annotationreader (wrong name: com/sun/xml/internal/bind/v0/model/qnnotation/annotationreader) note: when installed android studio, installed incompatible jdk (1.8, not 1.7). have had go default project settings change jdk uses 1.8. does know how can avoid this? there place should downloading jxb classes? missing in java paths? this appears have been caused cor
Read more

Decoding a Python 2 `tempfile` with python-future -

-
i'm attempting write python 2/3 compatible routine fetch csv file, decode latin_1 unicode , feed csv.dictreader in robust, scalable manner. for python 2/3 support, i'm using python-future including imporing open builtins , , importing unicode_literals consistent behaviour i'm hoping handle exceptionally large files spilling disk, using tempfile.spooledtemporaryfile i'm using io.textiowrapper handle decoding latin_1 encoding before feeding dictreader this works fine under python 3. the problem textiowrapper expects wrap stream conforms bufferediobase . unfortunately under python 2, although have imported python 3-style open , vanilla python 2 tempfile.spooledtemporaryfile still of course returns python 2 cstringio.stringo , instead of python 3 io.bytesio required textiowrapper . i can think of these possible approaches: wrap python 2 cstringio.stringo python 3-style io.bytesio . i'm not sure how approach - need write such wrapper or 1 ex
Read more