Announcement: Parsing text inclusions with TextTransformer 1.1.0

TextTransformer 1.1.0 - a parser generator IDE - just has been
released. It has the new ability, to parse text inclusions. Inclusions
are sections of text, which can appear everywhere between two tokens
in the text without destroying the syntax of the whole text. Typical
examples are comments in programming languages or processing
instructions.


In the previous versions of TextTransformer such inclusions only could
be recognized as a whole by complex regular expressions. Now they can
be parsed and processed in detail by a second (or third ...) parser,
which is managed in the same project as the main parser. A common
inclusion parser can be used for all productions of the main parser or
individual inclusion parsers can be set for each production. So for
the productions of an inclusion parser the same or another (start rule
of a) parser can be set for parsing inclusions of the inclusion:
inclusion parsers can be stacked, If for example a comment production
is set in itself, you get a parser for a nested comment.


Text inclusions can be parsed with token sets, which are different
from that of the main parser. So, a systematic concept for the change
of lexical states was introduced. This concept was extended to the
other uses of productions already existing in the TextTransformer.
Look-ahead productions, and productions for sub-parsers, callable in
semantic actions, also can operate on own token sets now. For more
details see:


http://texttransformer.com/tthelp/index.html -> Algorithms -> Token
sets


or in German


http://www.texttransformer.de/html/tthelp/index.html -> Algorithmen ->
Tokenmengen




In the visual development environment of TextTransformer you can test
such inclusion-parsers in the same manner as used for the productions
of the main parser: you can step through the nodes of the syntax tree,
you can set breakpoints in the tree or in the source text and you can
execute text transformations on single files or on groups of files.




TextTransformer home page:


English: http://www.texttransformer.com
German: http://www.texttransformer.de




Regards


Detlef Meyer-Eltz

Return to the comp.compilers page.
Search the comp.compilers archives again.