Geek Answers Handbook

PicklingError when copying a very large cassandra table using cqlsh

When I try to copy a table to cassandra using the command:

copy images from 'images.csv'

I get an error message:

'PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed'

I have successfully imported all my other tables, but this one does not work. The only difference with this is that it contains large binary drops for images.

Here is an example line from the csv file:

b267ba01-5420-4be5-b962-7e563dc245b0,,0x89504e...[large binary blob]...426082,0,7e700538-cce3-495f-bfd2-6a4fa968bdf6,pentium_e6600,01fa819e-3425-47ca-82aa-a3eec319a998,0,7e700538-cce3-495f-bfd2-6a4fa968bdf6,,,png,0

And here is the file that causes the error: https://www.dropbox.com/s/5mrl6nuwelpf3lz/images.csv?dl=0

Here is my diagram:

CREATE TABLE dealtech.images (
    id uuid PRIMARY KEY,
    attributes map<text, text>,
    data blob,
    height int,
    item_id uuid,
    name text,
    product_id uuid,
    scale double,
    seller_id uuid,
    text_bottom int,
    text_top int,
    type text,
    width int
)

Tables have been exported using cassandra 2.x, and I am currently using cassandra 3.0.9to import them.

+2
source share
1 answer

apache cassandra 3.9, (46 , 262 ).

PicklingError: Can't pickle <class 'cqlshlib.copyutil.link'>: attribute lookup cqlshlib.copyutil.link failed

PicklingError: Can't pickle <class 'cqlshlib.copyutil.attribute'>: attribute lookup cqlshlib.copyutil.attribute failed

link attribute I.

COPY .cql script, Docker, .

, PicklingError Windows (, NTFS), Docker Alpine Linux.

, COPY:

WITH MINBATCHSIZE=1 AND MAXBATCHSIZE=1 AND PAGESIZE=10;

http://docs.datastax.com/en/cql/3.3/cql/cql_reference/cqlshCopy.html

, PicklingError .cql-, COPY , , , , .

:

+2

More articles:


All Articles