Commit Graph

362 Commits

Author SHA1 Message Date
Ben Hamilton 200379802a Tidy comments and add tests to ensure UTF-16 and UTF-32 support Unicode code points > U+FFF 2017-03-29 10:06:08 -07:00
Ben Hamilton ab0655598e Improve memory usage of CodePointCharStream: Use 8-bit, 16-bit, or 32-bit buffer 2017-03-27 16:46:42 -07:00
parrt eb49080720 add test showing cost to load from a file where we know the size. Add test of small file to load as well. 2017-03-27 11:34:23 -07:00
parrt 4ca382c9b0 add dependence on JOL http://hg.openjdk.java.net/code-tools/jol to compute buffer sizes. Dumps footprint now too. 2017-03-26 13:27:57 -07:00
parrt 00d5781bee update sample lexer timing numbers after IntervalSet binary search update. 2017-03-24 14:01:21 -07:00
parrt 9cf26d0163 add my results to Ben's, small cleanup. 2017-03-24 13:45:37 -07:00
parrt da71ea375f add legacy ascii *load* back. separate out stream locate time / mem overhead from load tests. 2017-03-24 13:39:20 -07:00
Ben Hamilton b2869ee0d7 Fix TimeLexerSpeed when run from jar 2017-03-23 14:18:17 -07:00
parrt 0713128d04 add size information to the load for streams 2017-03-23 10:54:19 -07:00
parrt 648f517da0 add more load times 2017-03-17 14:08:25 -07:00
parrt b961c86143 add load times 2017-03-17 13:37:01 -07:00
parrt aa177cf415 Forgot to add UTF-8 encoding to legacy. 2017-03-17 13:09:11 -07:00
parrt 553742e149 rm deadcode 2017-03-17 12:07:01 -07:00
parrt 251d27493e add lexer speed tests for new unicode streams 2017-03-17 12:06:07 -07:00
Terence Parr 1f6a329692 Merge pull request #1765 from bhamiltoncx/unicode-cleanup-and-doc
Tidy up CharStreams and add new doc/unicode.md
2017-03-16 17:03:06 -07:00
Ben Hamilton 4f2168600d Tidy up CharStreams API. Add new doc/unicode.md 2017-03-16 17:01:46 -06:00
parrt ae3aadce3f change whitespace for new wildcard test; messed up in python. 2017-03-15 14:10:55 -07:00
parrt d966702d63 add wildcard test. 2017-03-15 09:33:15 -07:00
Dong Xie e49b0977f5 fix #1725; get dotnet target test run 2017-03-04 01:42:44 +00:00
Ivan Kochurkin b07528796e Removed runtime CharSetWithMissingEndRange test. 2017-03-03 13:42:09 +03:00
parrt 3df19fbcc8 make format consistent with most of antlr project 2017-03-02 10:38:48 -08:00
parrt 6215f18ec3 rename 4.6.1 to 4.7 everywhere 2017-02-23 14:48:58 -08:00
Ben Hamilton fd4246cf3f Implement new extended Unicode escape \u{10ABCD}. Bump UUID. Add lots more tests. 2017-02-23 09:39:44 -08:00
parrt e1101caffa resolve conflict 2017-02-17 11:08:15 -08:00
parrt f8e7a2cf08 merge in dotnet stuff 2017-02-17 11:02:52 -08:00
Terence Parr 877f6a396b Merge pull request #1659 from bhamiltoncx/js-use-code-points-for-tests
JavaScript: Allow Unicode code points > U+FFFF in tests
2017-02-16 09:53:43 -08:00
Terence Parr b3f5d1e3d1 Merge pull request #1658 from bhamiltoncx/csharp-use-output-file
C#: Write test output to a file
2017-02-16 09:53:16 -08:00
Ben Hamilton c35bbabc16 PR #1658: Also write stderr to file 2017-02-16 09:44:40 -08:00
Ben Hamilton cd7700939c Use code points for JS tests 2017-02-14 15:26:54 -08:00
Ben Hamilton cd922eb74c Python 2/3 runtime and test harness support for writing test output to file 2017-02-14 15:00:52 -08:00
David Neumann e967463e91 Merge branch 'master' into master 2017-02-14 11:20:02 +01:00
Terence Parr 287f17b796 Merge pull request #1652 from bhamiltoncx/csharp-lexer-parser-output-file
C# support for lexer and parser output to a file
2017-02-13 15:10:54 -08:00
Terence Parr 9b7e2a81ce Merge pull request #1651 from bhamiltoncx/python-lexer-parser-output-file
Python 2 and Python 3 support for lexer and parser output to a file
2017-02-13 15:10:19 -08:00
Terence Parr 51f6ad69b6 Merge pull request #1649 from bhamiltoncx/test-output-reading
New class TestOutputReading to mimic StreamVacuum for tests which write to a file
2017-02-13 15:07:28 -08:00
Terence Parr aa58ba5a2e Merge pull request #1648 from bhamiltoncx/file-encoding-utf-8
Ensure unit tests are run with file.encoding=UTF-8
2017-02-13 15:06:19 -08:00
Terence Parr 3cbc2af0cc Merge pull request #1655 from lionelplessis/fix-#1298-for-csharp
Fix #1298 for CSharp
2017-02-13 10:29:47 -08:00
Terence Parr ae5250685d Merge pull request #1637 from bhamiltoncx/char-streams
Make BaseJavaTest and TestRig work with Unicode values > U+FFFF
2017-02-10 14:11:34 -08:00
Ben Hamilton 6611c1ae27 C# runtime and test harness support for writing test output to file 2017-02-10 13:37:44 -08:00
Ben Hamilton 2c447a2b75 Python 2 and Python 3 support for lexer and parser output to a file instead of stdout 2017-02-10 13:11:24 -08:00
Ben Hamilton cf3b513a58 New TestOutputReading runtime-testsuite class 2017-02-10 11:30:05 -08:00
Ben Hamilton 11aa20c5e7 Ensure tests are run with file.encoding=UTF-8 2017-02-10 11:28:06 -08:00
lionelplessis 895681044e Fix #1298 for CSharp 2017-02-10 17:55:10 +01:00
Ben Hamilton 499e44b03a Pass through source name 2017-01-30 14:16:33 -08:00
Terence Parr 3e61421e59 Merge pull request #1636 from bhamiltoncx/stream-vacuum-utf8
Consolidate multiple copies of StreamVacuum, make use UTF-8
2017-01-30 13:29:32 -08:00
Ben Hamilton 0f52b7c0d9 CharStreams 2017-01-30 10:09:56 -08:00
Ben Hamilton (Ben Gertzfield) f0947f4365 Update copyright in StreamVacuum.java 2017-01-30 09:56:02 -07:00
Ben Hamilton eb54507e42 Consolidate multiple copies of StreamVacuum, make use UTF-8 2017-01-30 08:53:09 -08:00
Ben Hamilton 2defcc3e1f Change default encoding back to 'ascii'. Specify encoding=utf-8 and errors=replace in Python2/Python3 test templates. 2017-01-30 08:45:48 -08:00
Terence Parr b4508d26b2 Merge pull request #1629 from bhamiltoncx/fix-writing-unicode-in-tests
Fix writing Unicode values in runtime tests
2017-01-29 13:02:19 -08:00
Terence Parr bd8a367398 Merge pull request #1627 from bhamiltoncx/utf8-code-point-decoder
New class UTF8CodePointDecoder
2017-01-29 12:54:58 -08:00