Re: Avoid "symbol" and "token" terms ambiguity (VBDis)
30 Jan 2005 13:57:46 -0500

          From comp.compilers

Related articles
Avoid "symbol" and "token" terms ambiguity (Vasily Karyaev) (2005-01-09)
Re: Avoid "symbol" and "token" terms ambiguity (2005-01-30)
Re: Avoid "symbol" and "token" terms ambiguity (2005-02-03)
| List of all articles for this month |

From: (VBDis)
Newsgroups: comp.compilers
Date: 30 Jan 2005 13:57:46 -0500
Organization: AOL Bertelsmann Online GmbH & Co. KG
References: 05-01-026
Keywords: practice
Posted-Date: 30 Jan 2005 13:57:46 EST

Vasily Karyaev <> schreibt:

>I need to assign appropriate class names for the two related but
>different entities:
>1. "A grammar symbol (token)".
>2. "A parser symbol (token)".

You have 2 grammars, one for the lexer and one for the parser. Each grammar has
terminals (atoms) and nonterminals (symbols), where the nonterminals of the
lexer grammar are the terminals of the parser grammar.

AFAIK Token is commonly used for lexer symbols, and Production or
simply Symbol is used for parser symbols. John?

[I'd say that "production" is more often used to describe the entire rule,
not just the symbol, but the terminolgy isn't very consistent. -John]

Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.