Skip to content

msgpack_unpack is super slow (30x times igbinary) on big data sets #90

@parf

Description

@parf

msgpack_unpack is super slow (30x times igbinary) on big data sets
In this example 1500x1500 array unpacking take 90 seconds !!! (only 34MB of data)
i can gzip this data in 0.1 sec

https://gist.github.com/parf/f05ca955a523657581b55c62fc982059

./igbinary-vs-msgpack.php
PHP Version: 5.6.20 @
Data set: array 1500 x 1500, performed 2 iterations, data-set-memory-usage: 1,306.0M
ALGO SIZE-RAW UNPACK1/sec PACK1/sec << time per one iteration
igbinary_serialize: 34,866,787 1.8 2.1
msgpack_pack: 34,348,503 51.9 1.3

./igbinary-vs-msgpack.php
PHP Version: 7.0.8 @
Data set: array 1500 x 1500, performed 2 iterations, data-set-memory-usage: 1,101.0M
ALGO SIZE-RAW UNPACK1/sec PACK1/sec << time per one iteration
igbinary_serialize: 34,866,787 3.3 0.63
msgpack_pack: 34,348,503 91.5 1.6

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions