Commit Graph

6308 Commits

Author SHA1 Message Date
parrt 2ab9c8ab51 add note about utf-16 code units in grammars. Fixes #1802 2017-03-30 10:54:58 -07:00
parrt 04507895bd add link to Unicode doc 2017-03-30 09:49:45 -07:00
parrt bb33217d14 add Ben to readme 2017-03-30 09:47:06 -07:00
parrt 7595725dca add Ben to readme 2017-03-30 09:30:19 -07:00
Terence Parr b632a57dd8 Merge pull request #1800 from bhamiltoncx/unbuffered-utf8
Use UTF-8 by default in UnbufferedCharStream and allow specifying charset
2017-03-29 15:06:57 -07:00
Terence Parr 440f4e3e5c Merge pull request #1801 from parrt/tweak-target-doc
update target docs that need alteration for new interface
2017-03-29 15:04:31 -07:00
parrt ad3b43459d rm new 2017-03-29 15:04:19 -07:00
parrt 40e1072e7e update target docs that need alteration for new interface 2017-03-29 14:59:14 -07:00
Ben Hamilton a1c225dd23 Use UTF-8 by default in UnbufferedCharStream and allow specifying charset 2017-03-29 14:53:04 -07:00
parrt 66d2d7455d Merge branch 'master' of github.com:antlr/antlr4 2017-03-29 14:47:13 -07:00
parrt 039f43999c tweak documentation about various targets 2017-03-29 14:46:50 -07:00
Terence Parr 6e474eb43e Merge pull request #1776 from bhamiltoncx/js-char-streams
New JavaScript CharStreams functions
2017-03-29 14:38:41 -07:00
Terence Parr 828461337f Merge pull request #1775 from bhamiltoncx/csharp-char-streams
New C# CharStreams static factory class
2017-03-29 14:37:06 -07:00
Terence Parr 4a1e2c2fa5 Merge pull request #1797 from parrt/deprecate-old-streams
Deprecate old streams
2017-03-29 14:28:20 -07:00
parrt a7b2f3f12d more tweaks about the status of UTF-8 in previous and current defaults. 2017-03-29 14:26:36 -07:00
parrt cd2b6936cf fix another reference to previous streams 2017-03-29 14:21:16 -07:00
parrt 6dd9a3fbe3 respond to @bhamiltoncx comments 2017-03-29 14:19:37 -07:00
parrt 1fcb5951c6 change the example to use the new stream interface 2017-03-29 14:14:32 -07:00
parrt c3ed9a992d Add more about unbuffered streams. tweak style of code 2017-03-29 13:56:57 -07:00
parrt 0b36aca0e6 Merge branch 'master' into deprecate-old-streams 2017-03-29 13:43:28 -07:00
Terence Parr 0c38662134 Merge pull request #1799 from bhamiltoncx/tidy-java-unbuffered-char-stream
Small tidy-up for Java UnbufferedCharStream
2017-03-29 13:42:26 -07:00
Terence Parr 04972c2676 Merge pull request #1798 from bhamiltoncx/csharp-unbuffered-char-stream-code-points
C#: Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer
2017-03-29 13:42:06 -07:00
Ben Hamilton 9c61db36b0 Small tidy for Java UnbufferedCharStream 2017-03-29 13:32:55 -07:00
parrt ef0ff3275f Merge branch 'master' into deprecate-old-streams 2017-03-29 13:30:33 -07:00
parrt 496f9c398d update unicode doc, code comments 2017-03-29 13:29:23 -07:00
Ben Hamilton 366dbac8d1 C#: Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer 2017-03-29 13:29:10 -07:00
Terence Parr 802f4c4e71 Merge pull request #1796 from bhamiltoncx/unbuffered-char-stream-code-points
Change UnbufferedCharStream to use code points
2017-03-29 13:20:55 -07:00
Ben Hamilton 8108b342ad Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer 2017-03-29 13:14:18 -07:00
Terence Parr 1f0db00cd0 Merge pull request #1794 from bhamiltoncx/char-streams-tidy
Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFFF
2017-03-29 10:24:52 -07:00
Ben Hamilton 200379802a Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFF 2017-03-29 10:06:08 -07:00
Terence Parr 9764ff7c50 Merge pull request #1781 from bhamiltoncx/char-streams-memory-usage
Improve memory usage and perf of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer
2017-03-29 10:01:26 -07:00
Ben Hamilton ab0655598e Improve memory usage of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer 2017-03-27 16:46:42 -07:00
Terence Parr de4d129921 Merge pull request #1791 from parrt/use-jol-for-object-size
use JOL to compute buffer sizes. Dumps footprint now too.
2017-03-27 11:35:13 -07:00
parrt eb49080720 add test showing cost to load from a file where we know the size. Add test of small file to load as well. 2017-03-27 11:34:23 -07:00
parrt 4ca382c9b0 add dependence on JOL http://hg.openjdk.java.net/code-tools/jol to compute buffer sizes. Dumps footprint now too. 2017-03-26 13:27:57 -07:00
parrt 00d5781bee update sample lexer timing numbers after IntervalSet binary search update. 2017-03-24 14:01:21 -07:00
Terence Parr b1360c4e28 Merge pull request #1789 from bhamiltoncx/interval-set-binary-search
IntervalSet perf: Use binary search for IntervalSet.contains(el)
2017-03-24 13:59:09 -07:00
Terence Parr 39cf969fd9 Merge pull request #1784 from hanjoes/testing
Adding more API tests to Swift runtime.
2017-03-24 13:54:28 -07:00
parrt 9cf26d0163 add my results to Ben's, small cleanup. 2017-03-24 13:45:37 -07:00
parrt 5a93f099a3 Merge branch 'bhamiltoncx-fix-time-test-resources-2' 2017-03-24 13:41:14 -07:00
parrt da71ea375f add legacy ascii *load* back. separate out stream locate time / mem overhead from load tests. 2017-03-24 13:39:20 -07:00
Ben Hamilton 850abe1c81 IntervalSet perf: Use binary search for IntervalSet.contains(el) 2017-03-24 12:19:38 -07:00
Hanzhou Shi e334b0df86 Adding visitor tests. 2017-03-23 22:51:21 -07:00
Hanzhou Shi 91ce56c7fd Tweak Run Script phase. 2017-03-23 22:51:21 -07:00
Hanzhou Shi c3dc1b0d68 Update grammar name to align with JAVA tests. 2017-03-23 22:51:21 -07:00
Hanzhou Shi 2dab85ce2b Fixed printing of RewriteOps, now tests are passing. 2017-03-23 22:51:21 -07:00
Hanzhou Shi cb396a5047 Fixes #550 by separate op for insertAfter. 2017-03-23 22:51:21 -07:00
Hanzhou Shi cefd2c6528 Adding TokenStreamRewriterTests. 2017-03-23 22:51:20 -07:00
Hanzhou Shi 6d2b5b6790 Added "run script" build phase that can generate parser files. 2017-03-23 22:51:20 -07:00
Ben Hamilton b2869ee0d7 Fix TimeLexerSpeed when run from jar 2017-03-23 14:18:17 -07:00