Commit Graph

922 Commits

Author SHA1 Message Date
Geoff Langdale b824ba5d99 Issues #2 and #3 solved and the safety issues raised in my followup comments also resolved. 2018-05-31 13:26:24 +10:00
Daniel Lemire 74d1680e7e Trying simplier white space. 2018-05-30 23:05:18 -04:00
Geoff Langdale eece51c4fd Dammit switching off DEBUG mode 2018-05-31 12:46:28 +10:00
Geoff Langdale d820829e88 Switching to thicker tape as per https://github.com/lemire/simdjson/issues/4 2018-05-31 12:41:37 +10:00
Daniel Lemire f5a0346192 minifier can accelerate JSON so much that it is worth it ... 2018-05-27 22:30:22 -04:00
Daniel Lemire 43f871e761 Merge branch 'master' of github.com:lemire/simdjson 2018-05-27 21:50:29 -04:00
Daniel Lemire 9cc00ab584 AVX minifier coded (first version). 2018-05-27 21:15:11 -04:00
Daniel Lemire fcc0391b58
saving... 2018-05-15 20:38:07 -04:00
Geoff Langdale 4ac426b61b Finished code for Unicode escaping; PoC only 2018-05-14 21:08:46 +10:00
Geoff Langdale e28af20593 Add a 'code sketch' for Unicode escapes; incomplete 2018-05-14 16:38:38 +10:00
Geoff Langdale 624b3d8742 Cleanups. 2018-05-14 10:17:00 +10:00
Geoff Langdale 88b0edd60f Partial completion on numbers and string normalization. 2018-05-11 14:45:54 +10:00
Daniel Lemire 3c46aa47ce Adding more benchmarks. 2018-05-08 12:37:21 -04:00
Daniel Lemire 5835b77a00 Adding version with string validation. 2018-05-08 12:29:08 -04:00
Geoff Langdale 750978bef9 Early (rough as guts) implementation of string normalization. 2018-05-08 16:28:54 +10:00
Geoff Langdale 77d8caa332 Allow a -DSQUASH_COUNTERS to suppress counters at build time (e.g. for using other tools like toplev) 2018-05-07 21:33:23 +10:00
Geoff Langdale 1df475a5ea Tiny opt changes to avoid 4K aliasing and loop bound recalc. 2018-05-07 20:45:51 +10:00
Geoff Langdale 8733686fc0 Rotation of our offsets for [] and {} on tapes, to make them navigable. Balancing []/{} moved to stage 4. Prefetch tweaks in stage 1. 2018-05-07 17:26:44 +10:00
Geoff Langdale 0fec86d105 Removed memcmp and replaced with masked compare. 2018-05-05 20:39:43 +10:00
Geoff Langdale 76ad40272e Removed close quotes from structural list; homogenized tape writes sizes (now always 4 or 0). Some tuning. 2018-05-05 14:44:31 +10:00
Geoff Langdale 5cd7813f6d Merge branch 'master' of https://github.com/lemire/simdjson 2018-05-03 21:42:53 +10:00
Geoff Langdale e78e7687d6 Adding a nominal stage 4. 2018-05-03 21:42:16 +10:00
Daniel Lemire b918ccf238
RapidJSON does not like SSE. 2018-05-02 21:19:55 -04:00
Daniel Lemire d29e0b4dcf Adding a "numbers" file. 2018-05-02 21:12:40 -04:00
Daniel Lemire 2c022e9267 Saving... (SIMD is not good for rapidjson) 2018-05-02 20:59:22 -04:00
Daniel Lemire b52bcfb84e Avoiding stackoverflow. 2018-05-02 19:59:26 -04:00
Geoff Langdale 237d83885d Fixed display bug (cycles <-> instructions), tweak performance. 2018-05-01 19:05:31 +10:00
Geoff Langdale 232607278a Tapes now self-describing. Introduced temporary limit of 16MB (2^24) file size (fix later w. streaming) 2018-05-01 10:39:26 +10:00
Geoff Langdale 350aeecf3d Transformed tape machine. Now uses old tape not uptape and puts markers for open brace. Some streamlining. 2018-05-01 10:22:33 +10:00
Geoff Langdale dafcde53e5 Some cleanups and better diagnostic output including number of structural chars. 2018-05-01 09:51:12 +10:00
Daniel Lemire 3bc81cf9cf Adding another example. 2018-04-30 17:35:11 -04:00
Daniel Lemire f82cf14c97 Adding stage speeds. 2018-04-27 13:31:28 -04:00
Daniel Lemire 5ccd5f6b4e Adding stringify. 2018-04-27 13:31:28 -04:00
geofflangdale fd56854c3f
Update rapidjsondesign.md 2018-04-27 18:59:43 +10:00
Daniel Lemire 8d3c10ca74
Create rapidjsondesign.md 2018-04-26 21:37:48 -04:00
Daniel Lemire bc85248978 Fixed dependency. 2018-04-26 20:28:02 -04:00
Daniel Lemire 6d5c5fc2d5 Fixing include 2018-04-26 00:02:34 -04:00
Daniel Lemire 4eb410bc50 Cleaning. 2018-04-26 00:00:46 -04:00
Daniel Lemire 54f308ae11 rapidjson 2018-04-25 23:51:14 -04:00
Daniel Lemire 307bb5f29b submodule 2018-04-25 23:04:02 -04:00
Daniel Lemire da7c811590 Outputting the number of cycles per input byte 2018-04-25 22:41:28 -04:00
Daniel Lemire 484a6c2799 Instrumenting the code to measure cycles and stuff. 2018-04-25 21:36:07 -04:00
Daniel Lemire 64be7259f3
Adding ref. 2018-04-23 10:49:03 -04:00
geofflangdale 57db2ae3ce
Update README.md 2018-04-14 22:30:20 +10:00
geofflangdale 17f8a4e6e7
Update Notes.md 2018-04-14 22:22:08 +10:00
geofflangdale 080a636638
Update README.md 2018-04-14 22:16:12 +10:00
Geoff Langdale 211892439e Switched to a simpler but more useful notion of pseudo-structural character; some small fixes. 2018-04-14 22:12:43 +10:00
Geoff Langdale 694942e3cd Merge branch 'master' of https://github.com/lemire/simdjson 2018-04-14 21:47:41 +10:00
Geoff Langdale 03799855df Fixup parsing stage with a new, dual state-machine/tape-machine approach. 2018-04-14 21:46:35 +10:00
Daniel Lemire 46d55fa6ce
pseudo-structural 2018-04-13 19:52:02 -04:00