lexer
Lexical analysis in MRI Ruby 1.9.2
I\'m learning some compiler theory and practice at the moment.Ruby is my every day language of choice, and so I went to look at its lexer and parse grammar.Does ruby have a separate le开发者_开发百科x[详细]
2023-01-21 03:07 分类:问答Antlr (lexer): matching the right token
In my Antlr3 grammar, I have several \"overlapping\" lexer rules, like this: NAT: (\'0\' .. \'9\')+ ; INT: (\'+\' | \'-\')? (\'0\' .. \'9\')+ ;[详细]
2023-01-19 08:58 分类:问答Is there a Javascript lexer / tokenizer (in PHP)?
I\'ve seen a couple of Python Javascript tokenizers and a c开发者_如何学JAVAryptic document on Mozilla.org about a Javascript Lexer but can\'t find any Javascript tokenizers for PHP specifically. Are[详细]
2023-01-13 07:08 分类:问答How to parse template languages in Ragel?
I\'ve been working on a parser for simple template language. I\'m using Ragel. The requirements are modest. I\'m trying to find [[tags]] that can be embedded anywhere in the input string.[详细]
2023-01-09 00:44 分类:问答Basic problem with yacc/lex
I have some problems with a very simple yacc/lex program. I have maybe forgotten some basic steps (it\'s been a long time since I\'ve used these tools).[详细]
2023-01-08 20:53 分类:问答Adding a new lexer to scintilla/scite (...and eventually wxPython StyledTextCtrl)
Has anyone of you successfully added a lexer to scintilla? I have been following the short instructions at http://www.scintilla.org/SciTELexer.html - and even discovered the secret extra inst开发者_[详细]
2023-01-08 17:53 分类:问答Why is ANTLR parsing skipping token?
I\'m trying to do some very basic C++ function declaration parsing. Here is my rule for parsing an input parameter:[详细]
2023-01-08 01:26 分类:问答Design guidelines for parser and lexer?
I\'m writing a lexer (with re2c) and a parser (with Lemon) for a slightly convoluted data format: CSV-like, but with specific string types at specific places (alphanumeric chars only, alphanumeric cha[详细]
2023-01-06 17:58 分类:问答why does 'a'..'z' in ANTLR match wildcards like $ or £
When I run the following grammer: test : WORD+; WORD : (\'a\'..\'z\')+; WS : \' \'+ {$channel = HIDDEN;};[详细]
2023-01-06 09:28 分类:问答Simple XML parser in bison/flex
I would like to create simple xml parser using bison/flex. I don\'t need validation, comments, arguments, only <tag>value</tag>, where value can be number, string or other <tag>value[详细]
2023-01-04 23:51 分类:问答