Commit Graph

6281 Commits

Author SHA1 Message Date
Ben Hamilton 9c61db36b0 Small tidy for Java UnbufferedCharStream 2017-03-29 13:32:55 -07:00
Terence Parr 802f4c4e71 Merge pull request #1796 from bhamiltoncx/unbuffered-char-stream-code-points
Change UnbufferedCharStream to use code points
2017-03-29 13:20:55 -07:00
Ben Hamilton 8108b342ad Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer 2017-03-29 13:14:18 -07:00
Terence Parr 1f0db00cd0 Merge pull request #1794 from bhamiltoncx/char-streams-tidy
Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFFF
2017-03-29 10:24:52 -07:00
Ben Hamilton 200379802a Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFF 2017-03-29 10:06:08 -07:00
Terence Parr 9764ff7c50 Merge pull request #1781 from bhamiltoncx/char-streams-memory-usage
Improve memory usage and perf of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer
2017-03-29 10:01:26 -07:00
Ben Hamilton ab0655598e Improve memory usage of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer 2017-03-27 16:46:42 -07:00
Terence Parr de4d129921 Merge pull request #1791 from parrt/use-jol-for-object-size
use JOL to compute buffer sizes. Dumps footprint now too.
2017-03-27 11:35:13 -07:00
parrt eb49080720 add test showing cost to load from a file where we know the size. Add test of small file to load as well. 2017-03-27 11:34:23 -07:00
parrt 4ca382c9b0 add dependence on JOL http://hg.openjdk.java.net/code-tools/jol to compute buffer sizes. Dumps footprint now too. 2017-03-26 13:27:57 -07:00
parrt 00d5781bee update sample lexer timing numbers after IntervalSet binary search update. 2017-03-24 14:01:21 -07:00
Terence Parr b1360c4e28 Merge pull request #1789 from bhamiltoncx/interval-set-binary-search
IntervalSet perf: Use binary search for IntervalSet.contains(el)
2017-03-24 13:59:09 -07:00
Terence Parr 39cf969fd9 Merge pull request #1784 from hanjoes/testing
Adding more API tests to Swift runtime.
2017-03-24 13:54:28 -07:00
parrt 9cf26d0163 add my results to Ben's, small cleanup. 2017-03-24 13:45:37 -07:00
parrt 5a93f099a3 Merge branch 'bhamiltoncx-fix-time-test-resources-2' 2017-03-24 13:41:14 -07:00
parrt da71ea375f add legacy ascii *load* back. separate out stream locate time / mem overhead from load tests. 2017-03-24 13:39:20 -07:00
Ben Hamilton 850abe1c81 IntervalSet perf: Use binary search for IntervalSet.contains(el) 2017-03-24 12:19:38 -07:00
Hanzhou Shi e334b0df86 Adding visitor tests. 2017-03-23 22:51:21 -07:00
Hanzhou Shi 91ce56c7fd Tweak Run Script phase. 2017-03-23 22:51:21 -07:00
Hanzhou Shi c3dc1b0d68 Update grammar name to align with JAVA tests. 2017-03-23 22:51:21 -07:00
Hanzhou Shi 2dab85ce2b Fixed printing of RewriteOps, now tests are passing. 2017-03-23 22:51:21 -07:00
Hanzhou Shi cb396a5047 Fixes #550 by separate op for insertAfter. 2017-03-23 22:51:21 -07:00
Hanzhou Shi cefd2c6528 Adding TokenStreamRewriterTests. 2017-03-23 22:51:20 -07:00
Hanzhou Shi 6d2b5b6790 Added "run script" build phase that can generate parser files. 2017-03-23 22:51:20 -07:00
Ben Hamilton b2869ee0d7 Fix TimeLexerSpeed when run from jar 2017-03-23 14:18:17 -07:00
parrt 0713128d04 add size information to the load for streams 2017-03-23 10:54:19 -07:00
parrt e0ea43ccb8 fix antlr notation 2017-03-20 14:48:00 -07:00
Terence Parr 6de2f3f335 Merge pull request #1771 from mike-lischke/master
A few updates to the Unicode documentation.
2017-03-20 14:27:44 -07:00
Terence Parr 0ad7e7947b Merge pull request #1766 from pboyer/racefix2
Go runtime: Protect shared DFA state with mutexes
2017-03-20 09:48:37 -07:00
Peter Boyer eee59b9f7f Merge remote-tracking branch 'upstream/master' into racefix2 2017-03-19 17:59:13 -04:00
Terence Parr e68bedb2b2 Merge pull request #1768 from parrt/perf-testing
Lexer performance testing with new streams
2017-03-19 09:27:57 -07:00
Mike Lischke 54601f7128 A few updates to the Unicode documentation.
It should be made clear that the recommended use of CharStreams.fromPath() is a Java-only solution. The other targets just have their ANTLRInputStream class extended to support full Unicode.
2017-03-18 13:01:11 +01:00
parrt 648f517da0 add more load times 2017-03-17 14:08:25 -07:00
parrt b961c86143 add load times 2017-03-17 13:37:01 -07:00
parrt aa177cf415 Forgot to add UTF-8 encoding to legacy. 2017-03-17 13:09:11 -07:00
parrt 553742e149 rm deadcode 2017-03-17 12:07:01 -07:00
parrt 251d27493e add lexer speed tests for new unicode streams 2017-03-17 12:06:07 -07:00
parrt 53641c552c fix build issue in C#. some weird changes snuck in. 2017-03-16 17:13:47 -07:00
parrt 549d657ba4 rm dead code, tweak spaces, style. 2017-03-16 17:09:37 -07:00
Terence Parr 1f6a329692 Merge pull request #1765 from bhamiltoncx/unicode-cleanup-and-doc
Tidy up CharStreams and add new doc/unicode.md
2017-03-16 17:03:06 -07:00
Ben Hamilton 4f2168600d Tidy up CharStreams API. Add new doc/unicode.md 2017-03-16 17:01:46 -06:00
parrt b2e51e20b7 add C# keyword 2017-03-16 09:49:40 -07:00
Peter Boyer 11b4ee61f0 Protect shared DFA state with mutexes 2017-03-16 12:43:21 -04:00
parrt ae3aadce3f change whitespace for new wildcard test; messed up in python. 2017-03-15 14:10:55 -07:00
Terence Parr 4994ff540d Merge pull request #1761 from parrt/rollback-1740
rollback #1740. Useful stuff but breaks C++ unit tests.
2017-03-15 10:38:56 -07:00
parrt e7979dcf63 rollback #1740. Useful stuff but breaks C++ unit tests. 2017-03-15 10:34:27 -07:00
Terence Parr a872323474 Merge pull request #1760 from parrt/fix-1213
tweak wildcard
2017-03-15 10:29:08 -07:00
parrt d966702d63 add wildcard test. 2017-03-15 09:33:15 -07:00
Terence Parr 6d5de2418d Merge pull request #1758 from RobertvanderHulst/master
Fixed portability problems in C# target.  Also cleaned up some XML do…
2017-03-15 09:14:11 -07:00
parrt 4c1dc90064 tweak wildcard. Fixes #1213 2017-03-15 09:04:47 -07:00