7219d28a31
Call end_scope directly from stage 2 code
2020-05-11 05:20:04 -07:00
0875bce68f
Don't pass depth to on_end_*
2020-05-11 05:15:39 -07:00
54fe302907
Don't pass depth to end_scope
2020-05-11 05:06:41 -07:00
edaa8f811f
Move on_start_* depth management to stage 2 code
2020-05-11 05:03:25 -07:00
2c8fd109de
Move increment_count to stage 2
2020-05-11 04:58:50 -07:00
16d88cc095
Don't pass depth to increment_count
2020-05-11 04:15:02 -07:00
2a6e6b3dbd
Cleaning string_view ( #872 )
...
* Cleaning string_view
* Corrected typo
* Alignment.
2020-05-10 16:05:52 -04:00
afb369950c
Disable Intellisense-only warnings in simdjson.h/cpp
2020-05-04 11:47:04 -07:00
1d06624d38
Unset /D_CRT_SECURE_NO_WARNINGS
...
- Also localize DISABLE_DEPRECATED_WARNING so that we catch other
deprecations
2020-05-04 11:35:05 -07:00
d40069a018
Disable deprecation warnings for VS builds
...
fopen/getenv are standard c++ that are not deprecated.
2020-05-04 11:34:00 -07:00
e04cbd71d0
Only install singleheader/simdjson.h as part of the public API
2020-05-02 01:44:11 +03:00
fc1ddcd2f8
Faster case-insensitive comparisons. ( #837 )
...
* Faster case-insensitive comparisons.
2020-04-30 15:52:28 -04:00
73d7d704c1
CMake: Remove export_private_library
...
Since we are exporting all the targets as part of the main simdjson target we do not need private
exports anymore
2020-04-30 02:06:19 +03:00
eee07e6cfd
Use the same export name for all targets
2020-04-29 23:47:27 +03:00
0f9dbf84b7
Fix incorrect check for case insensitive key lookup ( #824 )
2020-04-29 13:55:28 -04:00
2a1f8fa8f1
Provides support for clang under Windows. ( #817 )
2020-04-27 22:09:27 -04:00
49da7e74cd
usage.md -> basics.md ( #823 )
2020-04-27 16:03:19 -04:00
0514588175
Improves clang-cl build with Visual Studio ( #809 )
2020-04-27 08:59:32 -04:00
b99a7344c9
missing spaces.
2020-04-25 22:26:18 -04:00
f3ac0be0e6
Merge branch 'master' of github.com:simdjson/simdjson
2020-04-23 18:39:56 -04:00
18c9468af5
Fixed typo
2020-04-23 18:39:32 -04:00
d4239aaa8f
default initialisaiton ( #779 )
...
* padded_string.* default initialisation
parsedjson_iterator - copy constructor; depth_index not necessary
2020-04-23 18:32:11 -04:00
4d0c7d706d
Warn 32-bit users about their doom. ( #783 )
2020-04-23 16:01:19 -04:00
382392e03b
This should enable -Weffc++ ( #777 )
...
* Enabling -Weffc++
2020-04-23 13:03:04 -04:00
0d1c574cb1
A few more changes... ( #775 )
...
* More nitpicking.
2020-04-23 11:36:52 -04:00
87acab0846
elimination of most of g++ -Weffc++ warnings ( #764 )
...
Co-authored-by: Matjaž Ostroveršnik <ostri@localhost.localdomain>
Co-authored-by: Daniel Lemire <lemire@gmail.com>
2020-04-23 10:06:44 -04:00
e030f02776
Merge branch 'master' into jkeiser/wconversion
2020-04-22 22:03:34 -04:00
185274e70f
Let us see if we can test with libc++. ( #732 )
...
* Let us see if we can test with libc++.
* Fixed spacing.
2020-04-22 21:24:42 -04:00
d4a37f6ef5
Enable conversion warnings on Linux and Windows
2020-04-22 14:21:30 -07:00
3e9e14f4d6
Reenable deprecation warnings on Windows
2020-04-22 08:53:19 -07:00
289cc3e7a0
Treat warnings as errors during compilation
2020-04-15 19:59:38 -07:00
7480b87e07
Merge pull request #693 from simdjson/jkeiser/cmake-quickstartcpp
...
Add C++11 tests to cmake
2020-04-15 19:53:14 -07:00
befa6423be
This massively improves the performance of tight loops relying on a type() call. ( #721 )
...
* This massively improves the performance of tight loops relying on a type() call.
* Adding a few more benchmarks
2020-04-15 20:45:40 -04:00
fd418f568c
Fix c++11 warnings on clang
...
- namespace x::y is C++17
- static_assert requires message in C++11
2020-04-15 17:27:48 -07:00
09cf18a646
Add C++11 tests to cmake
...
- Add simdjson-flags target so callers don't have flags forced on them
2020-04-15 17:26:25 -07:00
326c175dcb
Massive performance boost for get<double>. ( #719 )
...
* Massive performance boost for get<double>.
2020-04-15 20:09:45 -04:00
6d7c77ddc1
Let us try to check with the exceptions disabled. ( #707 )
...
* Tweaking code so that we can run all tests with exceptions off.
* Removing SIMDJSON_DISABLE_EXCEPTIONS
2020-04-15 16:45:36 -04:00
b523c43927
Can we provide a size() function to arrays and objects? (eager approach) [TO BE MERGED] ( #690 )
...
* This is an implementation of "size()" for arrays and objects.
* Adding benchmark
* Adding a size() remark in the documentation.
* Extending size() to result types.
2020-04-15 10:15:48 -04:00
75545ff70d
ref qualify parser methods to avoid use of dangling objects ( #703 )
...
To avoid using data belonging to a temporary, the parse functions are ref qualified to get a compile error if used on an rvalue. See https://github.com/simdjson/simdjson/issues/696
Compilation tests are also added, to make sure bad usage fails to compile.
Reviewed by jkeiser.
2020-04-15 09:57:52 +02:00
8539896f3d
It is inconvenient to be unable to print a padded_string. ( #713 )
...
* It is inconvenient to be unable to print a padded_string.
* Allows us to print the padded_string even when it is embedded in result object when exceptions are enabled.
2020-04-14 19:07:32 -04:00
334a486737
Tweaking the doxygen. ( #700 )
...
* Tweaking the doxygen.
* Fixing typo.
2020-04-14 11:31:46 -04:00
4af7d6f108
Disabling threads on apple's hardware when optimizer is turned off ( #692 )
...
* Disabling threads on apple's hardware.
* Turns out that you can have your bread, your butter and you cake too!
2020-04-10 18:41:05 -04:00
6835dd73bc
Only apply compile flags to simdjson
2020-04-09 08:52:29 -07:00
54b7291c34
Reference simdjson by name, don't specify include files individually
2020-04-08 14:52:55 -07:00
1e30b6e334
Compile under C++ 11
2020-04-08 14:00:13 -07:00
406240bae3
Support C++ 14
2020-04-08 14:00:13 -07:00
12ed6336b1
remove three trailing semicolons that -pedantic dislikes ( #673 )
2020-04-02 21:06:25 -04:00
3cb79e6977
Trying again. ( #671 )
2020-04-02 19:24:43 -04:00
13aee51011
Add element.type() for type switching
2020-04-02 14:07:19 -07:00
3116e29d16
Release candidate ( #655 )
...
* Release candidate
2020-03-31 17:47:25 -04:00
d93af1161d
Remove set_capacity, replace with allocate
...
Makes allocation point more predictable
2020-03-30 13:49:54 -07:00
434776db1a
Deprecate more things
2020-03-30 13:48:43 -07:00
6167e9cefc
Update doxygen to not show deprecated/private things
2020-03-30 13:47:27 -07:00
dc918d764e
Merge pull request #646 from simdjson/jkeiser/quickstart-example
...
Compile all .md examples in CI
2020-03-30 13:44:43 -07:00
7656bd50ee
Generate API docs at /api/docs
2020-03-29 17:01:12 -07:00
7ed65e42d7
Add actual examples from basics.md to readme_examples
2020-03-29 16:28:29 -07:00
ea8a5020e2
Remove array indexer, make object indexer key lookup
2020-03-28 15:56:43 -07:00
622d9c9480
Replace as_X and is_X with get<T> and is<T>
2020-03-28 15:29:53 -07:00
62da98aef6
Rename dom::stream to dom::document_stream
2020-03-28 13:42:24 -07:00
03746b966b
Move document/element/etc. under dom
2020-03-28 13:42:21 -07:00
836e1fc330
Use simdjson_result for all _result classes
2020-03-28 12:03:05 -07:00
e836c28008
Deprecate parser error code methods
...
- Also make competitions compile without warnings
2020-03-28 10:13:20 -07:00
748df8d109
Use string_view instead of string/char* where possible
2020-03-27 13:11:41 -07:00
5ad405006c
Return document::element from parse, load, parse_many, load_many
2020-03-27 12:24:41 -07:00
e3efbcddc1
Cast padded_string to string_view instead of string
2020-03-27 09:13:11 -07:00
c14b2fb36c
Remove const char* variants for at_key()
...
- Remove const char * variants for at_key(), string_view covers them
- Add at_key_case_insensitive variants on *_result
- Add at(), at_key(), at_key_case_insensitive() tests
2020-03-27 09:09:08 -07:00
f0f111b387
Make ParsedJson::Iterator backcompat test
2020-03-27 09:07:39 -07:00
abb0bf9247
Fixed basictests
2020-03-26 19:40:29 -04:00
56841bcede
Fix conversion error on Windows
2020-03-26 12:48:07 -07:00
006cc2ed60
Remove simdjson_move_result
2020-03-26 12:48:03 -07:00
2e420169c3
Remove document::parse and document::load
2020-03-26 10:13:09 -07:00
5aec2671ea
Remove JsonStream. Use parse_many() instead.
2020-03-26 09:25:07 -07:00
06587824be
Deprecate ParsedJson::Iterator
2020-03-25 18:26:51 -07:00
a0bce440a6
Remove document_iterator, document::iterator, ParsedJsonIterator
...
Keep ParsedJson::Iterator only, without template, in same form as
it was in 0.2
2020-03-25 18:26:51 -07:00
8769e42a56
Fixes issue 600 ( #614 )
...
* Fixes issue 600
2020-03-25 18:01:23 -04:00
7cde65aa6e
This deprecates json_parse() and build_parsed_json().
2020-03-25 14:19:24 -07:00
e1b1500e3b
Make _padded available without using namespace simdjson
2020-03-25 09:37:18 -07:00
b28cafc1d1
Remove backslash unescaping from JSON pointer impl
...
Also speed up non-escaped key lookup
2020-03-25 08:56:40 -07:00
0bcda5e384
Support JSON pointer in DOM navigation model
2020-03-23 15:05:20 -07:00
3e39a998ce
Merge branch 'master' of github.com:lemire/simdjson
...
Conflicts:
include/simdjson/jsonstream.h
2020-03-22 12:40:34 -04:00
2867dc50fa
Minor typo.
2020-03-22 12:39:01 -04:00
c3c43769ae
Fix typos.
2020-03-22 09:14:14 -07:00
36ceaa4452
Keep loaded_bytes in parser to reduce allocation
...
Also centralized memory ownership to make it easy to keep data around
2020-03-21 18:12:16 -07:00
e8b3f9eaad
Support document::parse("[1,2,3]"_padded)
2020-03-21 11:15:20 -07:00
5d1e3efce8
faster minifier ( #568 )
...
* Fallback should use our scalar code.
* parse should have a nicer error message.
* Making it so that "minify" can use different architectures.
* Let us change the minifier competition so that it tests all implementations.
* Documenting the untaken optimization opportunity.
Co-authored-by: John Keiser <john@johnkeiser.com>
2020-03-20 16:14:47 -04:00
6cefeb338b
std::tie does not work on some compilers ( #567 )
...
* std::tie workaround.
* Cleaner solution
2020-03-19 16:56:45 -04:00
5a071c1907
Remove TARGET_FALLBACK
2020-03-17 14:59:47 -07:00
7cf3a7511b
Add fallback implementation to CI
...
- Also add SIMDJSON_IMPLEMENTATION_HASWELL/WESTMERE/ARM64/FALLBACK=1/0 to
enable/disable various implemnentations
2020-03-17 14:59:47 -07:00
af203aaf86
Add fallback parser for pre-SSE4.2 machines
2020-03-17 14:59:47 -07:00
8e2c06cb0e
Compile with -fno-exceptions
2020-03-17 13:54:37 -07:00
1a5d8f1957
Add tests for SIMDJSON_EXCEPTIONS=0, add `tie()` support
2020-03-17 13:54:37 -07:00
03c828c7ad
Add SIMDJSON_EXCEPTIONS=ON to turn on exception interface
2020-03-17 13:54:37 -07:00
acc7bd79b0
Support cout << json, cout << minify(json)
2020-03-13 18:59:15 -07:00
89d9de2353
Adding a check to see whether document::stream copy constructor and assignment actually compile ( #556 )
...
* Currently, document::stream contains an attribute that is a reference:
```
document::parser &parser;
```
Yet we try to have it default on the move operator:
```
stream &operator=(document::stream &&other) = default;
stream &operator=(const document::stream &) = delete; // Disallow copying
```
```
stream(document::stream &&other) = default;
stream(const document::stream &) = delete; // Disallow copying
```
I am not sure what the move is supposed to do with the reference.
I cannot find where we test the copy constructor and assignment. This has been concerned that it is either dead code or buggy code.
* Remove non-working, unnecessary move constructors
* We still want to disallow copies.
Co-authored-by: John Keiser <john@johnkeiser.com>
2020-03-13 12:53:42 -04:00
a5afec1f94
Make #defines into simdjson::constants
2020-03-11 19:16:29 -07:00
ac0899c043
Add error tests, doc_ref_result[] chaining
2020-03-11 17:19:41 -07:00
40c6213d7e
Add parser.load() and load_many() to load files
2020-03-11 17:19:41 -07:00
d140bc23f5
Automatically allocate memory as needed in parse
2020-03-11 16:14:54 -07:00
66a2807210
Rename invalid_json to simdjson_error
2020-03-06 16:12:51 -08:00
3bdfe167de
Support cout << error
2020-03-06 15:41:51 -08:00
31e8a12e88
Make error_message(error_code) return C string
...
- Also move all error message logic to include inline
2020-03-06 15:41:51 -08:00
9a7c8fb5be
Use parse_many in examples/tests/docs
2020-03-05 12:04:45 -08:00
cfef4ff2ad
Create parser.parse_many() API
2020-03-05 12:04:45 -08:00
1c922d3b73
Fix JsonStream reference to parser on_error
2020-03-04 14:26:54 -08:00
b23dd28a06
Declare functions inline to surface "undefined" errors earlier
2020-03-04 14:26:54 -08:00
a55f41a24a
Move JsonStream inline implementation to inline .h
2020-03-04 14:26:54 -08:00
5525c6f729
Stop using jsoncharutils.h in JsonStream
2020-03-04 14:26:54 -08:00
eb147d9868
Mark jsonformatutils.h/isadetection.h internal
...
- Move jsonformatutils.h to internal/jsonformatutils.h (it is used by
document::print_json)
- Move isadetection.h to src/ (it is only used internally)
2020-03-04 14:26:54 -08:00
f58a5d534e
Move parser inline implementation to .cpp
2020-03-04 14:26:54 -08:00
b3ea8c406e
Add simdjson.cpp for unified use ( #515 )
2020-03-04 10:12:27 -08:00
99667f7c55
Create top level simdjson.h ( #515 )
...
- Allows everyone to #include the same way, singleheader or not.
2020-03-04 10:12:27 -08:00
0b21203141
Document navigation API
2020-03-02 14:49:03 -08:00
910f272467
Add parser implementation interface and selection API ( #501 )
...
* Make architecture implementations virtual functions
- Easier to add new architectures (add implementation to implementation.cpp)
- Easier to add new algorithms / functions to architecture selection
(add to implementation.h, implement)
- Automatically select best implementation in static initialization
- Allow user to explicitly select implementation with a string (i.e.
parameter)
- Allow user to inspect current implementation name/description
- Allow user to list available implementations
- Eliminate architecture enum and architecture-based templating
- Add noexcept in non-inline functions
* Move implementation static methods to their own classes
* Detect best supported implementation on first use
* available_implementationsI() -> available_implementations
2020-02-21 16:34:27 -05:00
1f76737510
Make valstat-ish parse APIs
2020-02-18 08:37:07 -08:00
bc8bc7d1a8
Lowercase Architecture and ErrorValues ( #487 )
...
ErrorValues -> error_code, Architecture -> architecture
2020-02-14 15:21:28 -08:00
083569fca8
This code is terrible and should not be there. ( #496 )
2020-02-13 07:38:11 -05:00
8e7d1a5f09
Separate document state from ParsedJson
...
This creates a "document" class with only user-facing document state (no parser internals).
- document: user-facing document state
- document::iterator: iterator (equivalent of ParsedJsonIterator)
- document::parser: parser state plus a "docked" document we parse into (equivalent of ParsedJson)
Usage:
```c++
auto doc = simdjson::document::parse(buf, len); // less efficient but simplest
```
```c++
simdjson::document::parser parser; // reusable parser
parser.allocate_capacity(len);
simdjson::document* doc = parser.parse(buf, len); // pointer to doc inside parser
doc = parser.parse(buf2, len); // reuses all buffers and overwrites doc; more efficient
```
2020-02-07 10:02:36 -08:00
76c706644a
Move stage 2 tape writing to ParsedJson ( #477 )
...
This is a first step to allowing alternate tape formats.
2020-02-04 14:28:42 -08:00
c924aaede9
Fix issue472: make JsonStream a template. ( #473 )
...
* Fix issue472: make JsonStream a template.
* Adding missing include.
* Tweaking headers and some minor formatting.
* Removing file from aggregation.
* Moving jsoncharutils
* Adding new header.
* Trying another header.
* Let us try to route around Visual Studio's nonesense.
2020-01-30 17:16:41 -05:00
28710f8ad5
fix for Issue 467 ( #469 )
...
* Fix for issue467
* Updating single-header
* Let us make it so that JsonStream is constructed from a padded_string which will avoid dangerous overruns.
* Fixing parse_stream
* Updating documentation.
2020-01-29 19:00:18 -05:00
e695a19d11
Trying to fix issue 465 ( #466 )
...
* Trying to fix issue 465
* Actually testing
* Refreshing amal.
* Removing spurious ;
2020-01-27 11:25:23 -05:00
ba14232628
Fixing mem leak. ( #461 )
2020-01-27 09:31:12 -05:00
3488c49d0a
Basically, haswell processor should be able to count on lzcnt. ( #458 )
2020-01-22 16:52:55 -05:00
ce8fe1bdf6
This isolates a fix found in the large PR https://github.com/lemire/simdjson/pull/445 ( #457 )
2020-01-22 12:58:59 -05:00
fa04595d90
Correcting typo.
2020-01-22 11:08:53 -05:00
80b4dd2e8a
Removing all stdout, stderr from main library. ( #455 )
...
* Removing all stdout,stderr from main library.
2020-01-20 16:03:15 -05:00
a4025788ae
Commenting out one attribute when SIMDJSON_THREADS_ENABLED is off. ( #453 )
2020-01-20 11:18:29 -05:00
27861f6358
SIMDJSON_PADDING is now an absolute constant. This is temporary since
...
padding should go away once https://github.com/lemire/simdjson/issues/174
is resolved.
2020-01-15 15:49:50 -05:00
1498b78342
Minor simplifications.
2020-01-10 14:07:57 -05:00
85e84fc1fa
improved string padded ( #440 )
...
* dirent portable latest version
* improved
std::string argument passed by const reference
ctor added with std::string_view argument
`allocate_padded_buffer()` moved here with **optional** check on `length < 1`
* allocate_padded_buffer moved to padded_string.h
2020-01-10 10:15:48 -05:00
773883c486
Fix #420 ( #421 )
2020-01-09 09:56:43 -05:00
951c4bedf8
Simpler jsonstream ( #436 )
...
* One simplification.
* Removing untested functions.
2020-01-07 19:10:02 -05:00
0a874a5063
Some tuning
2020-01-06 11:41:07 -05:00
2caa6e3370
C++ language version detection ( #418 )
...
* added visual_studio folder where visual_studio cmake generated, local artefacts are
* C++ version detection
2020-01-06 11:38:09 -05:00
7bde23590a
Debugging jsonstream ( #432 )
...
Fixes #424 (and provide tests for it), as well as #401
2020-01-03 22:22:47 -05:00
165e23773f
Refactor stage 2 into structural_parser class
2020-01-02 13:12:22 -07:00
399d08c86c
use unique_ptr in class parsedjson ( #417 )
...
* refactor parsedjson to use unique_ptr instead of owning raw pointer
* fix a potential undefined behavior
* output only first cpu in /proc/cpuinfo
2019-12-31 14:31:45 -05:00
9c3828fefe
STRINGIFY implemented ( #402 )
...
* STRINGIFY implemented
* SIMDJSON_THREADS_ENABLED def/undef
2019-12-20 07:57:00 -05:00
e2f349e7bd
Measure impact of utf-8 blocks and structurals per block directly
2019-12-17 11:41:13 -08:00
102262c7ab
Fixing issue386 ( #396 )
...
* Creating arch-specific bitmanipulation.h files.
* Improving system and compiler portability.
* We want to allow trailing_zeroes on zero inputs.
2019-12-16 19:09:18 -05:00
d33208c7db
Correct detection of NEON support ( #392 )
...
... as the test as it is currently implemented will always evaluate to true.
Fixes #389
2019-12-10 13:12:17 -05:00
7c560fa137
Cleaning documentation.
2019-11-26 14:13:17 -05:00
f163155929
JsonStream documentation ( #381 )
...
* adding Multiline JSON competition chart to doc
* Completing the comments for JsonStream
* Adding a page for JsonStream's documentation.
2019-11-25 18:11:55 -05:00
29fc51522a
Introducing concurrency mode in JsonStream. ( #373 )
...
* JsonStream threaded prototype
* JsonStream Threaded version working. Still supporting non-threaded version.
* Fix where invalid files would enter infinite loop.
* SingleHeader update
* I will remove -pthread in cmake for now.
* Attempt at resolving the -pthread issue
2019-11-21 11:22:06 -05:00
58d249ca16
Introducing move assignments. ( #363 )
2019-11-09 10:34:32 -05:00
bdc2b07339
Streams of JSON documents + Large files (>4GB) ( #350 ) ( #364 )
...
* rough prototype working. Needs more test and fine tuning.
* prototype working on large files.
* prototype working on large files.
* Adding benchmarks
* jsonstream API adjustment
* type
* minor fixes and cleaning.
* minor fixes and cleaning.
* removing warnings
* removing some copies
* runtime dispatch error fix
* makefile linking src/jsonstream.cpp
* fixing arm stage 1 headers
* fixing stage 2 headers
* fixing stage 1 arm header
* making jsonstream portable
* cleaning imports
* including <algorithms> for windows compiler
* cleaning benchmark imports
* adding jsonstream to amalgamation
* merged main into branch
* bug fix where JsonStream would bug on rare cases.
* Addind a JsonStream Demo to Amalgamation
* Fix for https://github.com/lemire/simdjson/issues/345
* Follow up test and fix for https://github.com/lemire/simdjson/issues/345 (#347 )
* Final (?) fix for https://github.com/lemire/simdjson/issues/345
* Verbose basictest
* Being more forgiving of powers of ten.
* Let us zero the tail end.
* add basic fuzzers (#348 )
* add basic fuzzing using libFuzzer
* let cmake respect cflags, otherwise the fuzzer flags go unnoticed
also, integrates badly with oss-fuzz
* add new fuzzer for minification, simplify the old one
* add fuzzer for the dump example
* clang format
* adding Paul Dreik
* rough prototype working. Needs more test and fine tuning.
* prototype working on large files.
* prototype working on large files.
* Adding benchmarks
* jsonstream API adjustment
* type
* minor fixes and cleaning.
* Fixing issue 351 (#352 )
* Fixing issues 351 and 353
* minor fixes and cleaning.
* removing warnings
* removing some copies
* Fix ARM compile errors on g++ 7.4 (#354 )
* Fix ARM compilation errors
* Update singleheader
* runtime dispatch error fix
* makefile linking src/jsonstream.cpp
* fixing arm stage 1 headers
* fixing stage 2 headers
* fixing stage 1 arm header
* fix integer overflow in subnormal_power10 (#355 )
detected by oss-fuzz
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=18714
* Adding new test file, following https://github.com/lemire/simdjson/pull/355
* making jsonstream portable
* cleaning imports
* including <algorithms> for windows compiler
* cleaning benchmark imports
* adding jsonstream to amalgamation
* merged main into branch
* bug fix where JsonStream would bug on rare cases.
* Addind a JsonStream Demo to Amalgamation
* merging main
* rough prototype working. Needs more test and fine tuning.
* prototype working on large files.
* prototype working on large files.
* Adding benchmarks
* jsonstream API adjustment
* minor fixes and cleaning.
* minor fixes and cleaning.
* removing warnings
* removing some copies
* runtime dispatch error fix
* makefile linking src/jsonstream.cpp
* fixing arm stage 1 headers
* fixing stage 2 headers
* fixing stage 1 arm header
* making jsonstream portable
* cleaning imports
* including <algorithms> for windows compiler
* cleaning benchmark imports
* adding jsonstream to amalgamation
* bug fix where JsonStream would bug on rare cases.
* Addind a JsonStream Demo to Amalgamation
* rough prototype working. Needs more test and fine tuning.
* minor fixes and cleaning.
* adding jsonstream to amalgamation
* merged main into branch
* Addind a JsonStream Demo to Amalgamation
* merging main
* merging main
* make file fix
2019-11-08 17:39:45 -05:00
8ae818e17c
add ossfuzz support ( #362 )
...
* initial oss-fuzz friendly build
parts taken from libfmt, which I wrote and have the copyright to
* fix build error
* add script for building a corpus zip
see https://google.github.io/oss-fuzz/getting-started/new-project-guide/#seed-corpus
* fix zip command
* drop setting the C++ standard
* disable the minify fuzzer, does not pass oss-fuzz check-build test
* fix integer overflow in subnormal_power10
detected by oss-fuzz
https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=18714
* invoke the build like oss fuzz does
* document what the scripts are for and how to use them
* add a page about fuzzing
2019-11-08 10:32:43 -05:00
3439ce19c9
Adding a flag which allows us to disable AVX detection. This exposes a bug. ( #356 )
2019-11-06 10:39:26 -05:00
a065805b0f
Fix for https://github.com/lemire/simdjson/issues/345
2019-10-24 15:34:30 -04:00
64872bddf4
Eliminate stage1_find_marks_flatten.h
2019-10-14 12:33:46 -07:00
9bbd6bd874
Move headers to implementation area
...
- jsoncharutils.h, numberparsing.h, simdprune_tables.h
2019-10-14 11:51:41 -07:00
81f9aac13f
Fixing minor perf. regression.
2019-10-07 16:31:44 -04:00
b2eff3c90c
case insensitive move_to_key ( #324 )
...
* case insensitive move_to_key
* portable strcmpi
2019-10-07 16:08:17 -04:00
cf9dbe583d
improved const correctness ( #321 )
2019-10-02 14:25:28 -04:00
de8df0a05f
Combined performance patch (5% overall, 15% stage 1) ( #317 )
...
* Allow -f
* Support parse -s (force sse)
* Simplify flatten_bits
- Add directly to base instead of storing variable
- Don't modify base_ptr after beginning of function
- Eliminate base variable and increment base_ptr instead
* De-unroll the flatten_bits loops
* Decrease dependencies in stage 1
- Do all finalize_structurals work before computing the quote mask; mask
out the quote mask later
- Join find_whitespace_and_structurals and finalize_structurals into
single find_structurals call, to reduce variable leakage
- Rework pseudo_pred algorithm to refer to "primitive" for clarity and some
dependency reduction
- Rename quote_mask to in_string to describe what we're trying to
achieve ("mask" could mean many things)
- Break up find_quote_mask_and_bits into find_quote_mask and
invalid_string_bytes to reduce data leakage (i.e. don't expose quote bits
or odd_ends at all to find_structural_bits)
- Genericize overflow methods "follows" and "follows_odd_sequence" for
descriptiveness and possible lifting into a generic simd parsing library
* Mark branches as likely/unlikely
* Reorder and unroll+interleave stage 1 loop
* Nest the cnt > 16 branch inside cnt > 8
2019-10-01 12:01:08 -04:00
5765c81f66
Fixing number parsing of large ints
2019-09-02 12:40:39 -04:00
92334a8e28
Better tests.
2019-09-02 12:32:44 -04:00
c4218c8e40
Accept large unsigned integers ( #295 ) ( #306 )
...
* handle uint64 value in JSON
* Add integer_tests
* Add get_unsigned_integer() on ParsedJson::BasicIterator
* Write 'u' to tape when the value seems unsigned
* Add to handle 'u' element
* Brush up integer_tests.cpp
* Append tests/integer_tests in .gitignore
* Add comments to is_integer and is_unsigned_integer
2019-09-02 11:56:26 -04:00
c1f27fb848
Accept large unsigned integers ( #295 )
...
* handle uint64 value in JSON
* Add integer_tests
* Add get_unsigned_integer() on ParsedJson::BasicIterator
* Write 'u' to tape when the value seems unsigned
* Add to handle 'u' element
* Brush up integer_tests.cpp
* Append tests/integer_tests in .gitignore
* Add comments to is_integer and is_unsigned_integer
2019-09-02 10:50:24 -04:00
f667d4965d
This is a bug fix: our prev function was buggy. ( #291 )
2019-08-23 18:59:43 -04:00
585f84a734
Move architecture-specific headers to src/ ( #287 )
...
* Use namespaces instead of templates for stage1 impls
* Move stage1 implementation into the src/ directory
* Move architecture-specific code to src/
2019-08-21 07:59:49 -04:00
a1bff85263
Documenting the limits of move_to_key with respect to Unicode Equivalence.
2019-08-20 17:10:30 -04:00
94673bcdf2
Use methods for utf8 checker
2019-08-16 14:15:37 -07:00
aa15917c9d
Use methods instead of functions for simd_input
2019-08-16 14:07:30 -07:00
6a2728e730
No allocation in the iterator's constructor ( #276 )
...
* Get rid of dynamic allocation in ParsedJson::Iterator.
* Implement copy assignment operator for ParsedJson::Iterator.
* ParsedJson::Iterator is now a template class.
2019-08-15 19:42:15 -04:00
0042d9b406
Move UTF8 checking functions into their own file
2019-08-14 10:34:11 -07:00
237b8865f5
Correct header #define
2019-08-13 17:44:26 -07:00
8f01cece3a
Move simd_input and associated functions to their own header
2019-08-13 17:44:06 -07:00
2ca574d9e6
Removing windows.h ( #273 )
2019-08-12 19:40:21 -04:00
3fb82502f7
This gets rid of the silly ALLOW_SAME_PAGE_BUFFER_OVERRUN ( #268 )
2019-08-09 17:36:32 -04:00
9dfab9d9a4
Disable UBSan error in trailing_zeroes(). ( #266 )
...
https://github.com/lemire/simdjson/issues/265
2019-08-09 14:37:22 -04:00
f3c3afd4cd
Use direct call to templated flatten_bits instead of if ( #262 )
...
* Use direct call to templated flatten_bits instead of if
* Put really_inline back on find_structural_bits_64
2019-08-08 15:09:17 -04:00
b1beacd1f3
Make headers show up in Header Files in VS2019 ( #257 )
2019-08-05 16:36:52 -04:00
d9a0e2b8f4
Fix Intellisense errors opening .h files on VS2019 ( #253 )
2019-08-04 19:57:55 -04:00
2a24567370
Replace macros by include files ( #236 ) ( #248 )
...
* stage1 compiles without macros
* cleaning
* amalgation is weird but works
* macros are removed from stringparsing
* amalgation fixed
* Huge macros are removed.
* clang-format
2019-08-04 15:58:35 -04:00
bd9628df93
Producing a new release
2019-08-04 15:43:47 -04:00
99a153d9e8
Hiding the pointer away... ( #252 )
...
* Hiding the runtime dispatch pointer in a source file so it is not an exported symbol
* Disabling hard failure on style check.
* Fixes https://github.com/lemire/simdjson/issues/250
2019-08-04 15:41:00 -04:00
2a240e3fe2
Fixing style violation.
2019-08-01 16:38:51 -04:00
ee66fb1c60
Version 0.2.0.
2019-08-01 16:23:30 -04:00
038b18edf1
Adding style scripts. ( #243 )
...
* Adding style scripts.
2019-08-01 16:09:26 -04:00
968117c940
preventing clang-format to move sysinfoapi.h ( #244 )
2019-08-01 15:06:50 -04:00
6788b12d65
It is not beneficial to try to get clever with trailing zeroes. (Lead to major performance
...
regression under haswell+ for stage 1).
2019-08-01 14:44:04 -04:00
66ffc1b2d6
Adding a remark.
2019-08-01 11:33:51 -04:00
bf59ba76f5
Fix most warnings on VS2019 ( #241 )
2019-07-31 17:43:45 -04:00
76da659977
Fixing amalgamate under ARM
2019-07-30 22:10:48 +00:00
c2eea8abba
Style uniformization ( #238 )
...
* massive clang-format -style=LLVM
* naming harmonization
* adding commentary about sysinfoapi.h
2019-07-30 17:18:10 -04:00
5f20d3eb34
Merging No duplicate tail (PR#223) ( #232 )
...
* Use __forceinline on Windows for really_inline
https://docs.microsoft.com/en-us/cpp/cpp/inline-functions-cpp?view=vs-2019#inline-__inline-and-__forceinline
* Don't duplicate find_structural_bits for final chunk
* writing coherent macro definitions
2019-07-29 14:11:42 -04:00
3c0f5a3fe4
Improving the documentation.
2019-07-29 14:10:49 -04:00
771e9cd68a
Trying again... ( #235 )
2019-07-29 13:55:13 -04:00
c328afee57
This should fix master.
2019-07-29 13:44:25 -04:00
3dae86223d
Changing intrinsic name.
2019-07-29 13:39:54 -04:00
85e31a5479
This fixes the "big exp" bug, although we need to assess the performance and maybe do some tuning. ( #233 )
2019-07-29 13:28:16 -04:00
a53d95099c
Intrinsic-based flatten ( #234 )
...
* Providing a flatten function with intrinsics (for Visual Studio).
2019-07-29 13:28:02 -04:00
eba02dc1b9
Runtime dispatch
...
* Attempt 1 - fn targeting
GCC won't work with templates with different targets, need to specialize all the way up the call stack.
* Compiles properly with cmake. Does not with the Makefile.
* Compilation works with Makefile
* instruction_set changes to architecture
* some aesthetic changes
* fix amalgation and tests + aesthetic changes
* This now compiles and passes tests under CLANG
* Minor correction.
* Trying to make it work on ARM
* Adding missing namespace
* Missing bracket
* Fixing minor compilation issues.
* Getting parse to use runtime dispatch
* Fixing amalgamation script.
* Making sure that NEON is supported.
* Fixing typo
* Merging https://github.com/lemire/simdjson/pull/229
* Manual merge of
https://github.com/lemire/simdjson/pull/229
by @jkeiser (second part)
* Trying another way.
* Removing the paral.
* Fixing the make file
* Let us make the practice run long enough.
* Resolved the awful slowness.
* Cleaning the README.md
* With runtime dispatching, we should not need flags anymore.
* Changing isa detection file's name + fixing typos.
2019-07-28 22:46:33 -04:00
bcabdfc1ae
Json pointer ( #220 )
...
* json pointer support
* Addition of tests for the json pointer
* Adding a new tool for the JSON Pointer support, and some documentation.
2019-07-26 18:38:10 -04:00
a3beac8d13
This simplifies back the number parsing code... The extra work introduced recently is seemingly unnecessary. ( #218 )
2019-07-18 11:50:26 -04:00
e926b4b3c9
More accurate number parsing ( #217 )
...
* This drastically improves the accuracy (down to to a ULP of 1)
* More comments and documentation.
2019-07-15 22:17:49 -04:00
6c168f046d
Optimizing stage1 ( #216 )
...
* Optimizing stage 1-- avx edition
* Optimizing sse.
* Saving 0.5% in instruction count (NEON).
2019-07-11 20:59:21 -04:00
4b7e87ec7f
Removing garbage. ( #213 )
2019-07-09 21:51:16 -04:00
98b387aac3
Fixing a messed up interleaved #ifdef/namespace. ( #211 )
2019-07-09 19:48:20 -04:00
be956654b2
Minor cleaning = annotating simdjson namespaces and making sure that we don't have headers all over.
2019-07-09 19:24:08 -04:00
977f57fd37
We need to guard the simdutf8check files.
2019-07-09 16:53:28 -04:00
7369339c88
Neon utf8validation ( #207 )
...
* utf8 validation on neon works
2019-07-09 15:14:34 -04:00
3f79385160
Removing some fprintf. ( #209 )
2019-07-09 13:04:44 -04:00
b0d9c074e1
check_utf8_helper has a more meaningful name
2019-07-05 11:09:28 -04:00
fba27ef4b9
I missed a few. Building up VS support.
2019-07-04 17:45:45 -04:00
19cdc09928
Improving support for VS
2019-07-04 17:36:26 -04:00
2b2d93b05f
Various minor tweaks.
2019-07-04 17:19:05 -04:00
f7ea2629e4
Fixing warnings and Microsoft intinsics.
2019-07-04 10:13:40 -04:00
861a6a17e4
SSE implementation integrated
2019-07-03 17:15:21 -04:00
0df6d83f08
deleting useless comments and namespace indications
2019-07-03 10:47:45 -04:00
036f9d5a45
Merge branch 'master' of https://github.com/lemire/simdjson into Multiple_implementation_refactoring_stage2
2019-07-03 10:34:58 -04:00
3f24879157
Stage2 refactored to simplify multiple implementations
2019-07-02 17:12:00 -04:00
9230588ce8
conflicts are solved
2019-07-02 15:21:00 -04:00
aa78b70d69
Introducing a "native" instruction set so that you do not need to do #ifdef to select the right SIMD set all the time.
...
Fixing indentation.
Removing some obsolete WARN_UNUSED.
Fixing a weird warning with optind variable.
2019-07-01 14:18:30 -04:00
1b81e7c928
Correcting ugly indentation.
2019-07-01 11:55:39 -04:00
de08df6a7e
Correction of identation.
2019-06-28 15:33:30 -04:00
6723221a42
Refactoring stage1 to facilitate multiple implementations.
2019-06-28 15:14:42 -04:00
d7f7f1b200
Fixing issue. ( #193 )
2019-06-20 18:49:47 -04:00
3db8c5a0eb
Fixing the issue ( #191 )
2019-06-12 16:32:46 -04:00
b0e6bfa84c
Simpler iteration code ( #190 )
...
* Adding convenience method to simplify code.
* Simplifying the iteration code.
2019-06-12 16:29:24 -04:00
b1e8990654
Moving iterator functions in the header file ( #189 )
...
We want the compiler to inline hot functions in the iterators. Let us leave them in the header file. Please.
2019-06-11 21:09:58 -04:00
14016743be
fixing typo in comment.
2019-06-05 21:29:46 -04:00
59194dcf4d
Issue182: fixed ( #183 )
...
* Verifying issue 182.
* Fixing the corresponding bug.
2019-06-05 18:51:29 -04:00
642132920f
Fixing performance regression caused by helpful code contributions
...
that moved inlineable functions into the source file combined with
helpful compilers which aren't smart enough to do the inlinining in
any case.
2019-05-31 18:16:12 -04:00
f00be30318
Being clearer as to what TAPE_ERROR means.
2019-05-28 19:32:56 -04:00
8526387acb
Improving error codes. ( #176 )
...
* This commit adds new error codes.
2019-05-24 17:28:56 -04:00
bf82288ab1
Preventing implicit conversions for C strings to C++ strings (with evil results). ( #172 )
2019-05-21 13:32:23 -04:00
576914ed54
Remove MMX code ( #170 )
...
#169
2019-05-20 14:41:58 -04:00
dcd0cb8080
Fix for https://github.com/lemire/simdjson/issues/58 ( #168 )
2019-05-19 12:25:27 -04:00
47beaff152
Adding white-listing for memory sanitizer.
2019-05-19 11:18:54 -04:00
b98454d213
Add explicit conversion for leading and tailing zeros. ( #161 )
2019-05-09 20:56:13 -04:00
954b89e762
New version (0.1.2).
2019-05-09 20:55:26 -04:00
f75280ac9c
Fix for issue 150 ( #162 )
...
* Checks for issue 150. We run through the test files with sanitizers on.
* Fix for issue 150: the remaining issues were an overrun on the depth capacity and an "off-by-1" overrun on tape capacity.
* Improving makefile.
* Safer git submodule command.
* Getting get 'git' on circleci
2019-05-09 20:51:33 -04:00
e370a65383
Fix for issues 32, 50, 131, 137
...
* Improving portability.
* Revisiting faulty logic regarding same-page overruns.
* Disabling same-page overruns under VS.
* Clarifying the documentation
* Fix for issue 131 + being more explicit regarding memory realloc.
* Fix for issue 137.
* removing "using namespace std" throughout. Fix for 50
* Introducing typed malloc/free.
* Introducing a custom class (padded_string) that solves several minor usability issues.
* Updating amalgamation for testing.
2019-05-09 17:59:51 -04:00
c5a3f9ccd4
Add failing test for a json with content zero ( #134 )
...
* Add failing test for a json with content zero
* Mark 0 byte as false in structural_or_whitespace_or_exponent_or_decimal_negated
2019-05-09 12:24:22 -04:00
f0574d492c
Fix for issue 154 ( #157 )
...
* Changes necessary to reproduce
https://github.com/lemire/simdjson/issues/154
* Fixing issue 154.
2019-05-08 22:33:11 -04:00
39fcc62e85
Fixed typo
2019-05-08 13:42:30 -04:00
719dff1312
Add predicates to ParsedJson::iterator ( #153 )
2019-05-07 14:11:33 -04:00
0d81fd287e
With this commit we can do all tests with full sanitizers on, and get no warning ( #132 )
...
* Making sure we can run with the sanitizers on.
* Minor code simplification in the number parsing.
* Following @EmilGedda 's recommendations regarding the makefile.
* Reference to blog post.
* Adding link to https://johnnylee-sde.github.io/Fast-numeric-string-to-int/
* Better hex parsing.
2019-04-24 17:31:47 -04:00
681cd33698
Making the iterator a tad safer (tweaking the constructor so that it can throw).
2019-04-22 10:53:25 -04:00
777b9c9a9e
Unbreak x86. Durp.
2019-03-30 15:50:35 +11:00
5ba29122fd
First cut of ARM port. Needs hand-hacked Makefile.
2019-03-30 00:47:35 -04:00
ddc2867f94
Adjust format and comments on avxcheckOverlong ( #129 )
2019-03-25 10:06:27 -04:00
2c23b375b2
Temporarily added a non-x86 definition of SIMDJSON_PADDING
2019-03-21 11:37:40 +11:00
9b6d32346b
Fixup portability.h to be more portable.
2019-03-21 11:25:51 +11:00
374fe1af1e
Updating comments regarding usage
2019-03-15 12:10:10 -04:00
bf9b1b1457
New version (mostly setting the singleheader version in sync).
2019-03-13 21:02:39 -04:00
d5a185b13e
new release.
2019-03-13 20:02:44 -04:00
df8f792183
Store the string lengths on the string tape ( #101 )
...
* Store string length in the string-tape item.
* Files are now limited to 4GB.
* Moving detection of unescaped chars to stage 1 to reduce the burden due to string parsing.
Fixes https://github.com/lemire/simdjson/issues/114
Fixes https://github.com/lemire/simdjson/issues/87
2019-03-13 19:32:57 -04:00
609e96b5d1
Fix for https://github.com/lemire/simdjson/issues/119
2019-03-13 11:01:31 -04:00
d2fa086198
Fix C4146 build error on UWP with MSVC ( #113 )
...
* Fix C4146 build error on UWP with MSVC
* Regenerate single header version
* Fix typo in parsedjson.h
* Regenerate single header version
2019-03-09 08:46:06 -05:00
352dd5e7fa
Change parse_json return type from bool to int ( #82 )
...
* Added simdjerr namespace
* Updated jsonparser files
* updated stage1 and stage2
* removed stage2 inline function
* Added forgotten return statements
* Updated tools and benchmarks
* Corrected parenthesis
* Removed extra =
* Accidentally undid reinterpret_cast
* Better comments, undid a header name fuckup
* Added an errorMsg method, updated readme
* Removed useless header from stage2
* Updated single-header file
* added simdjerr.cpp contents to simdjson.cpp
* Made single header version work
* Updated singleheader test, fixed simdjson.cpp
* Renamed simdjerr namespace and files to simdjson
* Updating the amalgamation.
2019-03-02 17:18:45 -05:00
a24e701b4e
First release (0.0.1)
2019-02-26 10:14:49 -05:00
bdc2bc693f
Merge pull request #61 from NewProggie/fix_minor_problems
...
Fix minor problems
2019-02-26 20:50:03 +11:00
33341b60d8
Apply code review suggestions
...
- Undo explicit bool conversion
- Don't check for NULL before deleting pointer
2019-02-26 09:36:28 +01:00
5289bf3eeb
Fixing Utf8 validation question #72
2019-02-26 13:17:29 +11:00
e7683820d5
Merge branch 'master' into fix_minor_problems
2019-02-25 21:05:29 +01:00
95e6fc2844
Fix CI errors
2019-02-25 20:55:07 +01:00
7830b1be87
Use nothrow ( #65 )
...
* Use C++11 features
* Use std::nothrow
By default new throws std::bad_alloc, so no check code would be executed.
2019-02-25 14:36:45 -05:00
83ab72079f
Add link to C# version ( #66 )
...
* fix noiline for MSVC
* Add SimdJsonSharp link to README.md
2019-02-25 14:17:43 -05:00
b521719b6f
Fix old-style C-Casts
2019-02-23 17:31:38 +01:00
ff22e75f95
Apply minor readability fixes
2019-02-23 17:28:20 +01:00
3640ab9dd3
Fixing the makefile build.
2019-02-22 15:34:35 -05:00
9606343b2c
ParsedJson & ParsedJson::iterator definitions in .cpp files ( #47 )
...
* Minor change to benchmark cmake
* Moved ParsedJson and its Iterator to separate .cpp files
* Uncommented functions, that has nothing to do with this pr
* Removed really_inline comments
* Reinstated some inline functions to restore previous performance
* Re-merged iterator in ParsedJson
* Uncommented some WARN_UNUSED
2019-02-22 14:38:35 -05:00
4d6ed2b2c1
Tape capacity increase by 32 bytes to allow for expected overflow.
2019-02-22 13:08:46 -05:00
90c881a3de
Invoking -mbmi
2019-01-16 13:26:24 -05:00
b5a2c41049
We need the Intel intrinsic.
2019-01-16 13:13:03 -05:00
388f89f185
Working on improving portability
2019-01-16 12:33:06 -05:00
a00df9b992
Number parsing fix.
2019-01-04 17:36:52 -05:00
d94e8ee973
Fixing dead code.
2019-01-02 12:16:29 -05:00
3ce1dd8087
Cleaning.
2018-12-31 17:13:32 -05:00
58d41923fd
Porting to visual studio
...
Now builds on Visual Studio
2018-12-30 21:00:19 -05:00
46ef59c679
Cleaning.
2018-12-27 20:19:10 -05:00
bf4089b33b
Removing custom types (more standard code).
2018-12-27 20:09:25 -05:00
20133963bc
Trying a detailed analysis.
2018-12-19 21:23:37 -05:00
0a109508de
Added documentation of the tape format.
2018-12-18 15:09:27 -05:00
779ce184fb
Getting ready to document the tape format.
2018-12-18 14:21:22 -05:00
0769c39e27
Ok. Looks complete.
2018-12-14 21:32:42 -05:00
05a2547829
Adding benchmark.
2018-12-12 22:42:19 -05:00
751dce98f5
Getting there slowly.
2018-12-11 22:39:39 -05:00
e8d3d784ab
More fixing.
2018-12-10 22:21:03 -05:00
058eb917d1
Better doc.
2018-12-10 22:00:16 -05:00
e4703a383b
Even safer.
2018-12-10 20:54:31 -05:00
7296d4d48b
Fixing...
2018-12-10 17:39:19 -05:00
05636f3a1d
Cleaning.
2018-12-10 16:47:02 -05:00
7fda77d51a
Mostly fixed performance regression.
2018-12-10 15:35:42 -05:00
8615760331
Should now pass.
2018-12-10 15:16:31 -05:00
176d2ccda4
Tweaking.
2018-12-10 14:25:49 -05:00
52c4b65f1e
Progress validating the API.
2018-12-09 20:47:02 -05:00
a56e92a571
API works now.
2018-12-09 13:08:41 -05:00
747bb16919
Iteration API implemented but untested.
2018-12-07 23:35:53 -05:00
9df22452af
First API implementation.
2018-12-07 22:19:57 -05:00
628e4e3522
Fix https://github.com/lemire/simdjson/issues/26
2018-12-06 22:51:55 -05:00
beb030fc16
Tweaking
2018-12-06 22:23:57 -05:00
c2913d5d69
Adding dynamic memory allocation.
2018-12-06 21:44:26 -05:00
8589a0588b
More clever parse function.
2018-12-06 17:40:32 -05:00
e2d2d2f8ff
Adding more tests.
2018-12-06 17:22:22 -05:00
196c41e3bc
Fixed typo
2018-12-06 11:37:26 -05:00
0f9a7a6b2f
Improving a bit the number parsing using MMX.
2018-12-05 23:08:33 -05:00
c8706c66ec
Solving some build issues
2018-12-05 21:33:32 -05:00
4a4bf8d98d
Fixed issue where the numbers don't appear properly after parsing.
2018-11-30 22:40:10 -05:00
e3a4b41c2e
Cleaning.
2018-11-30 22:02:32 -05:00
c11eefca32
More cleaning.
2018-11-30 21:31:05 -05:00
a8b99984f2
Intermediate step.
2018-11-30 20:27:16 -05:00
e5707331e9
Some refactoring.
2018-11-30 09:37:57 -05:00
12b518578d
Ok, the new code seems quite fast.
2018-11-29 22:15:02 -05:00
ce85dd0c3a
Still need to streamline number parsing.
2018-11-29 17:56:17 -05:00
c1de7662c1
Simplifying function call.
2018-11-28 11:12:28 -05:00
b858a404f7
Adding missing include
2018-11-28 10:29:57 -05:00
8648c4108e
MOre cleaning.
2018-11-27 20:42:35 -05:00
ba0f6fea51
Cleaning.
2018-11-27 17:38:53 -05:00
58ac242770
Ok. Let us benchmark this thing.
2018-11-27 15:05:50 -05:00
a43b0772e1
Lots and lots of cleaning.
2018-11-27 14:37:59 -05:00
5fae7b2100
Still working
2018-11-27 10:10:39 -05:00
50defa510f
Stupid work.
2018-11-26 16:55:24 -05:00
08ae836aa1
Removing dead file.
2018-11-20 20:53:42 -05:00
1fcd2688f8
Better documentation.
2018-11-20 12:59:06 -05:00
bbeb64a70b
Cleaning documentation.
2018-11-20 12:54:06 -05:00
78e75a8bae
Even faster.
2018-11-20 11:56:10 -05:00
7dd590c43c
Saving faster version.
2018-11-20 11:02:39 -05:00
47ae00895a
Forgot to save...
2018-11-09 21:42:44 -05:00
17f5d0517d
Opting for a more common intrinsic.
2018-11-09 21:41:15 -05:00
76074a821f
Various cleaning steps.
2018-11-09 21:31:14 -05:00
0e5b939568
Merge branch 'master' of github.com:lemire/simdjson
2018-11-09 15:16:25 -05:00
c1a7e79862
Lifting the mem limit. (Dirty commit.)
2018-11-09 15:16:05 -05:00
df65de4ae2
Tuning presentation and fixing a problem with minifier benchmark.
2018-10-23 21:36:32 -04:00
18633e02d2
Added more thorough testing.
2018-10-23 20:19:33 -04:00
9738af68c8
Fixing up the code point parsing. I think that what is there is now correct.
...
I believe that there was a case of early optimization.
2018-10-19 22:07:22 -04:00
8315f4c888
Cleaning up the code.
2018-10-17 21:31:22 -04:00
35381279c3
Maybe we can do away with the fast ASCII trick.
2018-10-17 21:05:38 -04:00
e517414080
We include character-encoding validation.
2018-10-17 19:22:09 -04:00
355e5d2ed3
Checking for unescaped chars.
2018-10-17 15:08:49 -04:00
7eb7cd265a
We can now parse crazy things like pi to 100 digits.
2018-10-08 15:24:16 -04:00
70c122074f
Tests.
2018-10-08 14:41:36 -04:00
37adea9387
Adding a comment.
2018-09-30 14:44:30 -04:00
314356d561
We have faster number parsing...?
2018-09-28 18:26:27 -04:00
4ee515fa4b
The new number parsing code is faster.
2018-09-28 14:45:34 -04:00
57b840327f
Faster number parsing?
2018-09-28 14:38:40 -04:00
1e5d8ece56
Update API a bit
2018-09-28 14:59:30 +10:00
89fd074ec9
Draft API. No implementation yet.
2018-09-28 14:55:57 +10:00
ceb55cc8db
Pick new number parser as winner; move string parsing to own header
2018-09-28 14:27:48 +10:00
ecbe1158ed
Added testing for number parsing.
2018-09-27 20:26:27 -04:00
e4094afe08
Moving toward having number-parsing testing.
2018-09-27 17:38:15 -04:00
7606a43aa9
Merge branch 'master' of github.com:lemire/simdjson
2018-09-26 23:36:19 -04:00
1c8339297d
With new number parser (faster!). Removing the dependency on the doubleconv library (which proves to be useless).
2018-09-26 23:35:33 -04:00
ccb3670c7c
DEBUG mode fixes.
2018-09-27 13:10:33 +10:00
9f91650e72
Remove old 4-stage path.
2018-09-26 15:22:55 +10:00
c4c51627d3
Fix compile - jsonparser needs to include unified header
2018-09-26 11:33:35 +10:00
682c224d1a
Merge branch 'master' of https://github.com/lemire/simdjson
2018-09-26 11:29:23 +10:00
John Keiser
Daniel Lemire
Pavel P
Furkan Usta
Nong Li
ostri
Paul Dreik
Dirk Eddelbuettel
Bruce Mitchener
dbj
UKABUER
mswilson
Jeremie Piotte
Juho Lauri
saka1
Vitaly Baranov
ioioioio
alexey-milovidov
Dong Xie
Heinz N. Gies
Geoff Langdale
myd7349
Thomas Navennec
geofflangdale
Kai Wolf
Wojciech Muła
Egor Bogatov