8108b342ad
Change UnbufferedCharStream to use 32-bit Unicode code points and 32-bit buffer
2017-03-29 13:14:18 -07:00
1f6a329692
Merge pull request #1765 from bhamiltoncx/unicode-cleanup-and-doc
...
Tidy up CharStreams and add new doc/unicode.md
2017-03-16 17:03:06 -07:00
4f2168600d
Tidy up CharStreams API. Add new doc/unicode.md
2017-03-16 17:01:46 -06:00
c71b7d2f18
EmojiDefault and TextDefault
2017-03-14 13:27:01 -06:00
3219f1c77d
Extended Pictographic
2017-03-13 15:40:51 -06:00
6007132e2e
Also support Unicode enumerated properties via \p{East_Asian_Width=Ambiguous} escape
2017-03-08 09:43:50 -08:00
e3f85774a4
Reverted unterminated ranges: [+-], [-+].
2017-03-03 21:35:31 +03:00
b3e667c619
Fixed escaped charactes in error messages.
2017-03-03 16:44:41 +03:00
d59d193252
CharSupport code improved and cleared.
...
Tests fixed.
2017-03-03 16:44:41 +03:00
e1ec6a4222
Fixed line break in test.
2017-03-03 13:44:44 +03:00
a1c50de31f
Improved testInvalidCharSetsAndStringLiterals test with invalid char sets, fixed Java.g4 grammar: [+-] -> [+\-]
2017-03-03 13:41:36 +03:00
c5f9d5e2a1
More accurate escaping (different symbols for string literals (') and char sets(]-)).
...
Improved testInvalidCharSetsAndStringLiterals test.
2017-03-02 18:16:05 +03:00
77f7fd135d
Fixed incorrect "used multiple times" warning.
...
Improved warning output in ATNOptimizer.
2017-03-02 14:56:50 +03:00
d9ae13fc1a
we left invalid escapes in string literals which was causing an error. This is related to #1537 . All tool errors pass now.
2017-03-01 17:32:44 -08:00
8d1df4c9e4
Merge pull request #1688 from bhamiltoncx/unicode-property-escape
...
New \p{Letter} Unicode property escape
2017-03-01 15:24:52 -08:00
070849698a
error-> warnings. Fixes #1537
2017-03-01 15:10:44 -08:00
ca03e6ab5e
New \p{Letter} Unicode property escape
2017-03-01 14:50:02 -08:00
d11968d993
Merge pull request #1693 from bhamiltoncx/escape-parsing
...
New class EscapeSequenceParsing with \p{UnicodeProperty} support
2017-03-01 14:47:44 -08:00
3557f48386
EscapeSequenceParsing
2017-03-01 14:06:04 -08:00
e8bb58f7b9
Also support Unicode blocks
2017-02-23 16:21:55 -08:00
6215f18ec3
rename 4.6.1 to 4.7 everywhere
2017-02-23 14:48:58 -08:00
4589ff56ea
Add test for "binary" grammar
2017-02-23 09:39:44 -08:00
fd4246cf3f
Implement new extended Unicode escape \u{10ABCD}. Bump UUID. Add lots more tests.
2017-02-23 09:39:44 -08:00
5c5f52ab83
Use code generation in new tool-codegen build step instead of making tool depend on ICU at runtime
2017-02-22 11:09:02 -08:00
f384ef5fb4
New utility class Unicode
2017-02-21 12:40:31 -08:00
6c878b0709
Merge pull request #1653 from bhamiltoncx/codegen-unicode-escapes
...
Emit language-specific Unicode escapes in codegen
2017-02-15 16:48:50 -08:00
0049d6d9ae
Emit language-specific Unicode escapes when generating code containing non-ASCII Unicode values
2017-02-10 14:31:56 -08:00
11aa20c5e7
Ensure tests are run with file.encoding=UTF-8
2017-02-10 11:28:06 -08:00
0901851719
Merge pull request #1585 from KvanTTT/left-recursive-rule-labels
...
The final fix (hopefully) for alternative labels check in left recursive rules
2017-01-29 13:34:32 -08:00
3017de10bc
Fix tool-testsuite
2017-01-25 16:42:28 -08:00
633a2df710
Mark BufferedTokenStream.reset as deprecated to avoid confusion
...
See #895
2017-01-07 10:45:08 -06:00
c929469c5f
Restored old testLabelsForTokensWithMixedTypesLRWithLabels & testLabelsForTokensWithMixedTypesLRWithoutLabels tests.
2017-01-07 18:47:08 +03:00
a46db4b0b7
Updated testLabelsForTokensWithMixedTypes.
...
Removed excess testLabelsForTokensWithMixedTypesLRWithLabels and testLabelsForTokensWithMixedTypesLRWithoutLabels.
2017-01-07 18:17:40 +03:00
8d7a9e19e2
Use MurmurHash in TestPerformance so results are comparable across targets
2017-01-05 13:52:10 -06:00
6b007b445c
Disable label checks for left recursive rules
...
See #1543
2017-01-02 14:14:06 -06:00
36ee17449f
Fixes #1556 .
...
```
beast:/tmp $ a4.6 T.g4
org/antlr/v4/parse/GrammarTreeVisitor.g: node from line 2:7 no viable alternative at input '..'
org/antlr/v4/parse/GrammarTreeVisitor.g: node from line 2:7 no viable alternative at input '..'
org/antlr/v4/parse/GrammarTreeVisitor.g: node from line 2:7 no viable alternative at input '..'
org/antlr/v4/parse/GrammarTreeVisitor.g: node from line 2:7 no viable alternative at input '..'
org/antlr/v4/parse/GrammarTreeVisitor.g: node from line 2:7 no viable alternative at input '..'
context [/report INTERNAL_ERROR] 1:17 attribute arg isn't defined
error(20): internal error:
beast:/tmp $ a4.6.1 T.g4
error(181): T.g4:2:4: token ranges not allowed in parser: 'A'..'Z'
```
2016-12-28 11:47:48 -08:00
23313ee44e
[maven-release-plugin] prepare for next development iteration
2016-12-15 14:25:41 -08:00
aacd2a2c95
[maven-release-plugin] prepare release 4.6
2016-12-15 14:25:36 -08:00
642d06ebb2
fix typo
2016-12-15 11:15:56 -08:00
5d3b99b2ee
Fixed error message for EMPTY_STRINGS_AND_SETS_NOT_ALLOWED.
2016-12-15 11:08:09 -08:00
49cec3a610
Added and improved tests for INVALID_LITERAL_IN_LEXER_SET and EMPTY_STRINGS_AND_SETS_NOT_ALLOWED.
2016-12-15 11:08:09 -08:00
1d53b416ee
Added tests for CHARACTERS_COLLISION_IN_SET.
2016-12-15 11:08:09 -08:00
33bce0d8a8
oops. tool tests need actual tool jar
2016-12-10 16:21:40 -08:00
9b758cb668
update versions
2016-12-10 16:07:35 -08:00
87fbc682e3
strip more stuff we don't need
2016-12-10 15:58:28 -08:00
9d06400ef0
add test scope to tool test pom
2016-12-10 15:31:17 -08:00
f2f54f0fd5
manually doing similar cleanup to https://github.com/antlr/antlr4/pull/1467
2016-12-10 15:19:45 -08:00
0eb27279de
fix LL1 analyzer
2016-12-09 18:07:47 -08:00
e46db41bbd
move api lib test to runtime tests
2016-12-08 14:37:13 -08:00
11117e02d4
Merge pull request #1458 from KvanTTT/mixed_type_labels_1409
...
Check labels for tokens with different types
2016-12-08 11:47:09 -08:00
Ben Hamilton
Terence Parr
Ivan Kochurkin
Sam Harwell