parrt
1fcb5951c6
change the example to use the new stream interface
2017-03-29 14:14:32 -07:00
parrt
c3ed9a992d
Add more about unbuffered streams. tweak style of code
2017-03-29 13:56:57 -07:00
parrt
0b36aca0e6
Merge branch 'master' into deprecate-old-streams
2017-03-29 13:43:28 -07:00
Terence Parr
0c38662134
Merge pull request #1799 from bhamiltoncx/tidy-java-unbuffered-char-stream
...
Small tidy-up for Java UnbufferedCharStream
2017-03-29 13:42:26 -07:00
Terence Parr
04972c2676
Merge pull request #1798 from bhamiltoncx/csharp-unbuffered-char-stream-code-points
...
C#: Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer
2017-03-29 13:42:06 -07:00
Ben Hamilton
9c61db36b0
Small tidy for Java UnbufferedCharStream
2017-03-29 13:32:55 -07:00
parrt
ef0ff3275f
Merge branch 'master' into deprecate-old-streams
2017-03-29 13:30:33 -07:00
parrt
496f9c398d
update unicode doc, code comments
2017-03-29 13:29:23 -07:00
Ben Hamilton
366dbac8d1
C#: Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer
2017-03-29 13:29:10 -07:00
Terence Parr
802f4c4e71
Merge pull request #1796 from bhamiltoncx/unbuffered-char-stream-code-points
...
Change UnbufferedCharStream to use code points
2017-03-29 13:20:55 -07:00
Ben Hamilton
8108b342ad
Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer
2017-03-29 13:14:18 -07:00
Terence Parr
1f0db00cd0
Merge pull request #1794 from bhamiltoncx/char-streams-tidy
...
Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFFF
2017-03-29 10:24:52 -07:00
Ben Hamilton
200379802a
Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFF
2017-03-29 10:06:08 -07:00
Terence Parr
9764ff7c50
Merge pull request #1781 from bhamiltoncx/char-streams-memory-usage
...
Improve memory usage and perf of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer
2017-03-29 10:01:26 -07:00
Jonas Auer
3e06a04594
Sign contributors.txt
2017-03-28 11:57:54 +02:00
Jonas Auer
79eb3721e4
Obsolete String.contains(_:) of Swift runtime
...
Starting with iOS 10, macOS 10.12, tvOS 10.0 and watchOS 3.0, Foundation contains
its own definition of String.contains(_:), which conflicts with the extension
provided by antlr.
2017-03-28 11:52:32 +02:00
Ben Hamilton
ab0655598e
Improve memory usage of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer
2017-03-27 16:46:42 -07:00
Terence Parr
de4d129921
Merge pull request #1791 from parrt/use-jol-for-object-size
...
use JOL to compute buffer sizes. Dumps footprint now too.
2017-03-27 11:35:13 -07:00
parrt
eb49080720
add test showing cost to load from a file where we know the size. Add test of small file to load as well.
2017-03-27 11:34:23 -07:00
parrt
4ca382c9b0
add dependence on JOL http://hg.openjdk.java.net/code-tools/jol to compute buffer sizes. Dumps footprint now too.
2017-03-26 13:27:57 -07:00
parrt
00d5781bee
update sample lexer timing numbers after IntervalSet binary search update.
2017-03-24 14:01:21 -07:00
Terence Parr
b1360c4e28
Merge pull request #1789 from bhamiltoncx/interval-set-binary-search
...
IntervalSet perf: Use binary search for IntervalSet.contains(el)
2017-03-24 13:59:09 -07:00
Terence Parr
39cf969fd9
Merge pull request #1784 from hanjoes/testing
...
Adding more API tests to Swift runtime.
2017-03-24 13:54:28 -07:00
parrt
9cf26d0163
add my results to Ben's, small cleanup.
2017-03-24 13:45:37 -07:00
parrt
5a93f099a3
Merge branch 'bhamiltoncx-fix-time-test-resources-2'
2017-03-24 13:41:14 -07:00
parrt
da71ea375f
add legacy ascii *load* back. separate out stream locate time / mem overhead from load tests.
2017-03-24 13:39:20 -07:00
Ben Hamilton
850abe1c81
IntervalSet perf: Use binary search for IntervalSet.contains(el)
2017-03-24 12:19:38 -07:00
Hanzhou Shi
e334b0df86
Adding visitor tests.
2017-03-23 22:51:21 -07:00
Hanzhou Shi
91ce56c7fd
Tweak Run Script phase.
2017-03-23 22:51:21 -07:00
Hanzhou Shi
c3dc1b0d68
Update grammar name to align with JAVA tests.
2017-03-23 22:51:21 -07:00
Hanzhou Shi
2dab85ce2b
Fixed printing of RewriteOps, now tests are passing.
2017-03-23 22:51:21 -07:00
Hanzhou Shi
cb396a5047
Fixes #550 by separate op for insertAfter.
2017-03-23 22:51:21 -07:00
Hanzhou Shi
cefd2c6528
Adding TokenStreamRewriterTests.
2017-03-23 22:51:20 -07:00
Hanzhou Shi
6d2b5b6790
Added "run script" build phase that can generate parser files.
2017-03-23 22:51:20 -07:00
Ben Hamilton
b2869ee0d7
Fix TimeLexerSpeed when run from jar
2017-03-23 14:18:17 -07:00
parrt
0713128d04
add size information to the load for streams
2017-03-23 10:54:19 -07:00
Ben Hamilton
f72e22550c
charstreams-js
2017-03-22 11:03:16 -07:00
parrt
e0ea43ccb8
fix antlr notation
2017-03-20 14:48:00 -07:00
Terence Parr
6de2f3f335
Merge pull request #1771 from mike-lischke/master
...
A few updates to the Unicode documentation.
2017-03-20 14:27:44 -07:00
Ben Hamilton
307df9c68d
New C# CharStreams static factory class
2017-03-20 13:07:08 -07:00
Terence Parr
0ad7e7947b
Merge pull request #1766 from pboyer/racefix2
...
Go runtime: Protect shared DFA state with mutexes
2017-03-20 09:48:37 -07:00
Peter Boyer
eee59b9f7f
Merge remote-tracking branch 'upstream/master' into racefix2
2017-03-19 17:59:13 -04:00
Terence Parr
e68bedb2b2
Merge pull request #1768 from parrt/perf-testing
...
Lexer performance testing with new streams
2017-03-19 09:27:57 -07:00
Mike Lischke
54601f7128
A few updates to the Unicode documentation.
...
It should be made clear that the recommended use of CharStreams.fromPath() is a Java-only solution. The other targets just have their ANTLRInputStream class extended to support full Unicode.
2017-03-18 13:01:11 +01:00
parrt
648f517da0
add more load times
2017-03-17 14:08:25 -07:00
parrt
b961c86143
add load times
2017-03-17 13:37:01 -07:00
parrt
aa177cf415
Forgot to add UTF-8 encoding to legacy.
2017-03-17 13:09:11 -07:00
parrt
553742e149
rm deadcode
2017-03-17 12:07:01 -07:00
parrt
251d27493e
add lexer speed tests for new unicode streams
2017-03-17 12:06:07 -07:00
parrt
53641c552c
fix build issue in C#. some weird changes snuck in.
2017-03-16 17:13:47 -07:00