Commit Graph

6291 Commits

Author SHA1 Message Date
parrt cd2b6936cf fix another reference to previous streams 2017-03-29 14:21:16 -07:00
parrt 6dd9a3fbe3 respond to @bhamiltoncx comments 2017-03-29 14:19:37 -07:00
parrt 1fcb5951c6 change the example to use the new stream interface 2017-03-29 14:14:32 -07:00
parrt c3ed9a992d Add more about unbuffered streams. tweak style of code 2017-03-29 13:56:57 -07:00
parrt 0b36aca0e6 Merge branch 'master' into deprecate-old-streams 2017-03-29 13:43:28 -07:00
Terence Parr 0c38662134 Merge pull request #1799 from bhamiltoncx/tidy-java-unbuffered-char-stream
Small tidy-up for Java UnbufferedCharStream
2017-03-29 13:42:26 -07:00
Terence Parr 04972c2676 Merge pull request #1798 from bhamiltoncx/csharp-unbuffered-char-stream-code-points
C#: Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer
2017-03-29 13:42:06 -07:00
Ben Hamilton 9c61db36b0 Small tidy for Java UnbufferedCharStream 2017-03-29 13:32:55 -07:00
parrt ef0ff3275f Merge branch 'master' into deprecate-old-streams 2017-03-29 13:30:33 -07:00
parrt 496f9c398d update unicode doc, code comments 2017-03-29 13:29:23 -07:00
Ben Hamilton 366dbac8d1 C#: Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer 2017-03-29 13:29:10 -07:00
Terence Parr 802f4c4e71 Merge pull request #1796 from bhamiltoncx/unbuffered-char-stream-code-points
Change UnbufferedCharStream to use code points
2017-03-29 13:20:55 -07:00
Ben Hamilton 8108b342ad Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer 2017-03-29 13:14:18 -07:00
Terence Parr 1f0db00cd0 Merge pull request #1794 from bhamiltoncx/char-streams-tidy
Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFFF
2017-03-29 10:24:52 -07:00
Ben Hamilton 200379802a Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFF 2017-03-29 10:06:08 -07:00
Terence Parr 9764ff7c50 Merge pull request #1781 from bhamiltoncx/char-streams-memory-usage
Improve memory usage and perf of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer
2017-03-29 10:01:26 -07:00
Ben Hamilton ab0655598e Improve memory usage of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer 2017-03-27 16:46:42 -07:00
Terence Parr de4d129921 Merge pull request #1791 from parrt/use-jol-for-object-size
use JOL to compute buffer sizes. Dumps footprint now too.
2017-03-27 11:35:13 -07:00
parrt eb49080720 add test showing cost to load from a file where we know the size. Add test of small file to load as well. 2017-03-27 11:34:23 -07:00
parrt 4ca382c9b0 add dependence on JOL http://hg.openjdk.java.net/code-tools/jol to compute buffer sizes. Dumps footprint now too. 2017-03-26 13:27:57 -07:00
parrt 00d5781bee update sample lexer timing numbers after IntervalSet binary search update. 2017-03-24 14:01:21 -07:00
Terence Parr b1360c4e28 Merge pull request #1789 from bhamiltoncx/interval-set-binary-search
IntervalSet perf: Use binary search for IntervalSet.contains(el)
2017-03-24 13:59:09 -07:00
Terence Parr 39cf969fd9 Merge pull request #1784 from hanjoes/testing
Adding more API tests to Swift runtime.
2017-03-24 13:54:28 -07:00
parrt 9cf26d0163 add my results to Ben's, small cleanup. 2017-03-24 13:45:37 -07:00
parrt 5a93f099a3 Merge branch 'bhamiltoncx-fix-time-test-resources-2' 2017-03-24 13:41:14 -07:00
parrt da71ea375f add legacy ascii *load* back. separate out stream locate time / mem overhead from load tests. 2017-03-24 13:39:20 -07:00
Ben Hamilton 850abe1c81 IntervalSet perf: Use binary search for IntervalSet.contains(el) 2017-03-24 12:19:38 -07:00
Hanzhou Shi e334b0df86 Adding visitor tests. 2017-03-23 22:51:21 -07:00
Hanzhou Shi 91ce56c7fd Tweak Run Script phase. 2017-03-23 22:51:21 -07:00
Hanzhou Shi c3dc1b0d68 Update grammar name to align with JAVA tests. 2017-03-23 22:51:21 -07:00
Hanzhou Shi 2dab85ce2b Fixed printing of RewriteOps, now tests are passing. 2017-03-23 22:51:21 -07:00
Hanzhou Shi cb396a5047 Fixes #550 by separate op for insertAfter. 2017-03-23 22:51:21 -07:00
Hanzhou Shi cefd2c6528 Adding TokenStreamRewriterTests. 2017-03-23 22:51:20 -07:00
Hanzhou Shi 6d2b5b6790 Added "run script" build phase that can generate parser files. 2017-03-23 22:51:20 -07:00
Ben Hamilton b2869ee0d7 Fix TimeLexerSpeed when run from jar 2017-03-23 14:18:17 -07:00
parrt 0713128d04 add size information to the load for streams 2017-03-23 10:54:19 -07:00
parrt e0ea43ccb8 fix antlr notation 2017-03-20 14:48:00 -07:00
Terence Parr 6de2f3f335 Merge pull request #1771 from mike-lischke/master
A few updates to the Unicode documentation.
2017-03-20 14:27:44 -07:00
Terence Parr 0ad7e7947b Merge pull request #1766 from pboyer/racefix2
Go runtime: Protect shared DFA state with mutexes
2017-03-20 09:48:37 -07:00
Peter Boyer eee59b9f7f Merge remote-tracking branch 'upstream/master' into racefix2 2017-03-19 17:59:13 -04:00
Terence Parr e68bedb2b2 Merge pull request #1768 from parrt/perf-testing
Lexer performance testing with new streams
2017-03-19 09:27:57 -07:00
Mike Lischke 54601f7128 A few updates to the Unicode documentation.
It should be made clear that the recommended use of CharStreams.fromPath() is a Java-only solution. The other targets just have their ANTLRInputStream class extended to support full Unicode.
2017-03-18 13:01:11 +01:00
parrt 648f517da0 add more load times 2017-03-17 14:08:25 -07:00
parrt b961c86143 add load times 2017-03-17 13:37:01 -07:00
parrt aa177cf415 Forgot to add UTF-8 encoding to legacy. 2017-03-17 13:09:11 -07:00
parrt 553742e149 rm deadcode 2017-03-17 12:07:01 -07:00
parrt 251d27493e add lexer speed tests for new unicode streams 2017-03-17 12:06:07 -07:00
parrt 53641c552c fix build issue in C#. some weird changes snuck in. 2017-03-16 17:13:47 -07:00
parrt 549d657ba4 rm dead code, tweak spaces, style. 2017-03-16 17:09:37 -07:00
Terence Parr 1f6a329692 Merge pull request #1765 from bhamiltoncx/unicode-cleanup-and-doc
Tidy up CharStreams and add new doc/unicode.md
2017-03-16 17:03:06 -07:00