jasder
/
simdjson
1
0
Fork 0
Code Issues Pull Requests Releases 2 Wiki Activity
simdjson/benchmark/bench_ondemand.cpp

93 lines
2.7 KiB
C++
Raw Normal View History

Make ondemand build without #include "simdjson.cpp"
2020-09-09 06:25:50 +08:00
#include "simdjson.h"
Add PartialTweets<Yyjson> benchmark
2021-01-02 13:15:03 +08:00
Make ondemand build without #include "simdjson.cpp"
2020-09-09 06:25:50 +08:00
SIMDJSON_PUSH_DISABLE_ALL_WARNINGS
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
Add PartialTweets<Yyjson> benchmark
2021-01-02 13:15:03 +08:00
#ifdef SIMDJSON_COMPETITION_YYJSON
#include "yyjson.h"
#endif
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
Add usage benchmarks for rapidjson
2021-01-05 07:22:35 +08:00
#ifdef SIMDJSON_COMPETITION_RAPIDJSON
#include "rapidjson/document.h"
#include "rapidjson/reader.h"
#include "rapidjson/stringbuffer.h"
#include "rapidjson/writer.h"
#endif
Add sajson benchmarks
2021-01-06 08:26:02 +08:00
#ifdef SIMDJSON_COMPETITION_SAJSON
#include "sajson.h"
#endif
Add nlohmann_json benchmarks
2021-01-07 06:38:12 +08:00
#ifdef SIMDJSON_COMPETITION_NLOHMANN_JSON
#include <nlohmann/json.hpp>
#endif
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
// This has to be last, for reasons I don't yet understand
Make ondemand build without #include "simdjson.cpp"
2020-09-09 06:25:50 +08:00
#include <benchmark/benchmark.h>
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
Make ondemand build without #include "simdjson.cpp"
2020-09-09 06:25:50 +08:00
SIMDJSON_POP_DISABLE_WARNINGS
Bringing ndjson(document_stream) to On Demand (#1643) * Update basic.md to document JSON pointer for On Demand. * Add automatic rewind for at_pointer * Remove DOM examples in basics.md and update documentation reflecting addition of at_pointer automatic rewinding. * Review * Add test * Add document_stream constructors and iterate_many * Attempt to implement streaming. * Kind of fixed next() for getting next document * Temporary save. * Putting in working order. * Add working doc_index and add function next_document() * Attempt to implement streaming. * Re-anchoring json_iterator after a call to stage 1 * I am convinced it should be a 'while'. * Add source() with test. * Add truncated_bytes(). * Fix casting issues. * Fix old style cast. * Fix privacy issue. * Fix privacy issues. * Again * . * Add more tests. Add error() for iterator class. * Fix source() to not included whitespaces between documents. * Fixing CI. * Fix source() for multiple batches. Add new tests. * Fix batch_start when document has leading spaces. Add new tests for that. * Add new tests. * Temporary save. * Working hacky multithread version. * Small fix in header files. * Correct version (not working). * Adding a move assignment to ondemand::parser. * Fix attempt by changing std::swap. * Moving DEFAULT_BATCH_SIZE and MINIMAL_BATCH_SIZE. * Update doc and readme tests. * Update basics.md * Update readme_examples tests. * Fix exceptions in test. * Partial setup for amazon_cellphones. * Benchmark with vectors. * Benchmark with maps * With vectors again. * Fix for weighted average. * DOM benchmark. * Fix typos. Add On Demand benchmark. * Add large amazon_cellphones benchmark for DOM * Add benchmark for On demand. * Fix broken read_me test. * Add parser.threaded to enable/disable thread usage. Co-authored-by: Daniel Lemire <lemire@gmail.com>
2021-07-21 02:17:23 +08:00
#include "amazon_cellphones/simdjson_dom.h"
#include "amazon_cellphones/simdjson_ondemand.h"
#include "large_amazon_cellphones/simdjson_dom.h"
#include "large_amazon_cellphones/simdjson_ondemand.h"
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "partial_tweets/simdjson_dom.h"
#include "partial_tweets/simdjson_ondemand.h"
Add PartialTweets<Yyjson> benchmark
2021-01-02 13:15:03 +08:00
#include "partial_tweets/yyjson.h"
Add sajson benchmarks
2021-01-06 08:26:02 +08:00
#include "partial_tweets/sajson.h"
Add usage benchmarks for rapidjson
2021-01-05 07:22:35 +08:00
#include "partial_tweets/rapidjson.h"
Add RapidJSON and nlohmann_json SAX to partial_tweets benchmark (#1597) * Add first working version of rapidjson_sax for partial tweets. * Add cleaner and faster rapidjson_sax * Add nlohmann_json_sax. * Replace array of bool by bitsets. * Replace strdup to copy string in rapidjson_sax. * Change std::string_view assignment in rapidjson_sax.
2021-06-04 04:41:20 +08:00
#include "partial_tweets/rapidjson_sax.h"
Add nlohmann_json benchmarks
2021-01-07 06:38:12 +08:00
#include "partial_tweets/nlohmann_json.h"
Add RapidJSON and nlohmann_json SAX to partial_tweets benchmark (#1597) * Add first working version of rapidjson_sax for partial tweets. * Add cleaner and faster rapidjson_sax * Add nlohmann_json_sax. * Replace array of bool by bitsets. * Replace strdup to copy string in rapidjson_sax. * Change std::string_view assignment in rapidjson_sax.
2021-06-04 04:41:20 +08:00
#include "partial_tweets/nlohmann_json_sax.h"
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "large_random/simdjson_dom.h"
#include "large_random/simdjson_ondemand.h"
#include "large_random/simdjson_ondemand_unordered.h"
#include "large_random/yyjson.h"
Add sajson benchmarks
2021-01-06 08:26:02 +08:00
#include "large_random/sajson.h"
Add usage benchmarks for rapidjson
2021-01-05 07:22:35 +08:00
#include "large_random/rapidjson.h"
Add large_random/rapidjson_sax.h and large_random/nlohmann_json_sax.h. Clean up kostya/rapidjson_sax.h (add flags also) and kostya/nlohmann_json_sax.h (#1600)
2021-06-04 04:40:39 +08:00
#include "large_random/rapidjson_sax.h"
Add nlohmann_json benchmarks
2021-01-07 06:38:12 +08:00
#include "large_random/nlohmann_json.h"
Add large_random/rapidjson_sax.h and large_random/nlohmann_json_sax.h. Clean up kostya/rapidjson_sax.h (add flags also) and kostya/nlohmann_json_sax.h (#1600)
2021-06-04 04:40:39 +08:00
#include "large_random/nlohmann_json_sax.h"
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "kostya/simdjson_dom.h"
#include "kostya/simdjson_ondemand.h"
Add Yyjson benchmarks
2021-01-02 14:41:15 +08:00
#include "kostya/yyjson.h"
Add sajson benchmarks
2021-01-06 08:26:02 +08:00
#include "kostya/sajson.h"
Add usage benchmarks for rapidjson
2021-01-05 07:22:35 +08:00
#include "kostya/rapidjson.h"
Add RapidJSON and nlohmann_json SAX to kostya benchmark (#1592) * Add RapidJSON and nlohmann_json SAX to kostya benchmark * Remove trailing whitespaces * Fix typo
2021-05-31 22:15:50 +08:00
#include "kostya/rapidjson_sax.h"
Add nlohmann_json benchmarks
2021-01-07 06:38:12 +08:00
#include "kostya/nlohmann_json.h"
Add RapidJSON and nlohmann_json SAX to kostya benchmark (#1592) * Add RapidJSON and nlohmann_json SAX to kostya benchmark * Remove trailing whitespaces * Fix typo
2021-05-31 22:15:50 +08:00
#include "kostya/nlohmann_json_sax.h"
Add PartialTweets<Yyjson> benchmark
2021-01-02 13:15:03 +08:00
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "distinct_user_id/simdjson_dom.h"
Fix branches. (#1619)
2021-06-18 06:31:40 +08:00
#include "distinct_user_id/simdjson_dom_json_pointer.h"
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "distinct_user_id/simdjson_ondemand.h"
Fix branches. (#1619)
2021-06-18 06:31:40 +08:00
#include "distinct_user_id/simdjson_ondemand_json_pointer.h"
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "distinct_user_id/yyjson.h"
Add sajson benchmarks
2021-01-06 08:26:02 +08:00
#include "distinct_user_id/sajson.h"
Add usage benchmarks for rapidjson
2021-01-05 07:22:35 +08:00
#include "distinct_user_id/rapidjson.h"
Add RapidJSON and nlohmann_json SAX to distinct_user_id benchmark (#1593) * Add rapidjson_sax for distinct_user_id * Add nlohmann_json_sax.h for distinct_user_id * Add flags for RapidJSON. * Fix revisions. * Fix revisions again. * Replace strcpy with memcpy. Increase performance fix.
2021-06-02 02:51:27 +08:00
#include "distinct_user_id/rapidjson_sax.h"
Add nlohmann_json benchmarks
2021-01-07 06:38:12 +08:00
#include "distinct_user_id/nlohmann_json.h"
Add RapidJSON and nlohmann_json SAX to distinct_user_id benchmark (#1593) * Add rapidjson_sax for distinct_user_id * Add nlohmann_json_sax.h for distinct_user_id * Add flags for RapidJSON. * Fix revisions. * Fix revisions again. * Replace strcpy with memcpy. Increase performance fix.
2021-06-02 02:51:27 +08:00
#include "distinct_user_id/nlohmann_json_sax.h"
Rearrange benchmarks to be easier to create
2021-01-05 04:21:50 +08:00
#include "find_tweet/simdjson_dom.h"
#include "find_tweet/simdjson_ondemand.h"
#include "find_tweet/yyjson.h"
Add sajson benchmarks
2021-01-06 08:26:02 +08:00
#include "find_tweet/sajson.h"
Add usage benchmarks for rapidjson
2021-01-05 07:22:35 +08:00
#include "find_tweet/rapidjson.h"
Add RapidJSON and nlohmann_json SAX to find_tweet benchmark (#1598) * Add rapidjson_sax.h . * Add nlohmann_json_sax.h . Fix typos distinct_user_id/nlohmann_json_sax.h, find_tweet/rapidjson.h and find_tweet/rapidjson_sax.h . * Add extra check for id key when looking for find_id.
2021-06-04 00:43:54 +08:00
#include "find_tweet/rapidjson_sax.h"
Add nlohmann_json benchmarks
2021-01-07 06:38:12 +08:00
#include "find_tweet/nlohmann_json.h"
Add RapidJSON and nlohmann_json SAX to find_tweet benchmark (#1598) * Add rapidjson_sax.h . * Add nlohmann_json_sax.h . Fix typos distinct_user_id/nlohmann_json_sax.h, find_tweet/rapidjson.h and find_tweet/rapidjson_sax.h . * Add extra check for id key when looking for find_id.
2021-06-04 00:43:54 +08:00
#include "find_tweet/nlohmann_json_sax.h"
Adding a new benchmark for ondemand: distinct user id (#1239) * Adding a distinct user id benchmark * reenabling everything * Removing an unnecessary "value()". * Better tests of the examples and some fixes. * Guarding exception code.
2020-10-23 20:47:01 +08:00
Add top_tweet benchmark to test laziness
2021-01-11 03:52:07 +08:00
#include "top_tweet/simdjson_dom.h"
#include "top_tweet/simdjson_ondemand.h"
#include "top_tweet/yyjson.h"
#include "top_tweet/sajson.h"
#include "top_tweet/rapidjson.h"
Add RapidJSON and nlohmann_json SAX to top_tweet benchmark (#1599) * Add rapidjson_sax.h and fix typo in rapidjson.h * Add nlohmann_json_sax.h and add user key check for screen_name in rapidjson_sax * Change std::string_view assignement for text and screen_name.
2021-06-04 04:41:00 +08:00
#include "top_tweet/rapidjson_sax.h"
Add top_tweet benchmark to test laziness
2021-01-11 03:52:07 +08:00
#include "top_tweet/nlohmann_json.h"
Add RapidJSON and nlohmann_json SAX to top_tweet benchmark (#1599) * Add rapidjson_sax.h and fix typo in rapidjson.h * Add nlohmann_json_sax.h and add user key check for screen_name in rapidjson_sax * Change std::string_view assignement for text and screen_name.
2021-06-04 04:41:00 +08:00
#include "top_tweet/nlohmann_json_sax.h"
Add top_tweet benchmark to test laziness
2021-01-11 03:52:07 +08:00
Make ondemand build without #include "simdjson.cpp"
2020-09-09 06:25:50 +08:00
BENCHMARK_MAIN();