Hackage :: [Package]

hw-json-simd: SIMD-based JSON semi-indexer

[ bsd3, data, library, program ] [ Propose Tags ] [ Report a vulnerability ]

Flags

Automatic Flags
NameDescriptionDefault
avx2

Enable avx2 instruction set

Disabled
bmi2

Enable bmi2 instruction set

Disabled
sse42

Enable SSE 4.2 optimisations.

Enabled

Use -f <flag> to enable a flag, or -f -<flag> to disable that flag. More info

Downloads

Maintainer's Corner

Package maintainers

For package maintainers and hackage trustees

Candidates

Versions [RSS] 0.1.0.0, 0.1.0.1, 0.1.0.2, 0.1.0.3, 0.1.0.4, 0.1.1.0, 0.1.1.1, 0.1.1.2, 0.1.1.3
Change log ChangeLog.md
Dependencies base (>=4 && <5), bytestring (>=0.10.6 && <0.11), hw-json-simd, hw-prim (>=0.6.2.21 && <0.7), lens (>=4 && <5), optparse-applicative (>=0.14 && <0.15), semigroups (>=0.8.4 && <0.19), vector (>=0.12 && <0.13) [details]
Tested with ghc ==8.6.1, ghc ==8.4.3, ghc ==8.2.2, ghc ==7.10.3, ghc ==8.0.2
License BSD-3-Clause
Copyright 2018 - 2019 John Ky
Author John Ky
Maintainer newhoggy@gmail.com
Category Data
Home page https://github.com/haskell-works/hw-json-simd#readme
Bug tracker https://github.com/haskell-works/hw-json-simd/issues
Source repo head: git clone https://github.com/haskell-works/hw-json-simd
Uploaded by haskellworks at 2019-01-30T22:32:29Z
Distributions
Reverse Dependencies 3 direct, 6 indirect [details]
Executables hw-json-simd
Downloads 3692 total (16 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Docs available [build log]
Last success reported on 2019-01-30 [all 1 reports]

Readme for hw-json-simd-0.1.0.1

[back to package description]

hw-json-simd

This library/tool will generate semi-indexes on JSON files as per the paper: Semi-Indexing Semi-Structured Data in Tiny Space.

The command line tool

For a given JSON file, hw-json-simd will generate two semi-index files, which both together can be loaded into a single in-memory semi-index.

The semi-index files can be generated using two methods, which will be called standard and simple, which correspond to sections 4 and 5 of the Semi-Indexing Semi-Structured Data in Tiny Space paper respectively.

Navigation of the JSON text using the standard index is suppored by the hw-json project for more information. There is currently no support for navigation of the JSON text using the simple index.

Using on the command line

cat test.json | pv -t -e -b -a | time hw-json-simd create-index \ -i /dev/stdin --output-ib-file test.json.ib.idx --output-bp-file test.json.bp.idx --method standard 
cat test.json | pv -t -e -b -a | time hw-json-simd create-index \ -i /dev/stdin --output-ib-file test.json.ib.idx --output-bp-file test.json.bp.idx --method simple

Installation

From hackage

cabal new-install hw-json-simd