Re: lexing backwards

genew@mail.ocis.net (Gene Wirchenko)
6 May 2003 19:17:03 -0400

          From comp.compilers

Related articles
[2 earlier articles]
Re: lexing backwards cfc@world.std.com (Chris F Clark) (2003-04-07)
Re: lexing backwards maratb@cs.berkeley.edu (Marat Boshernitsan) (2003-04-07)
Re: lexing backwards stan@zaborowski.org (Stan Zaborowski) (2003-04-13)
Re: lexing backwards Ron@Profit-Master.com (Ron Pinkas) (2003-04-13)
Re: lexing backwards monnier+comp.compilers/news/@rum.cs.yale.edu (Stefan Monnier) (2003-04-15)
Re: lexing backwards cfc@TheWorld.com (Chris F Clark) (2003-04-15)
Re: lexing backwards genew@mail.ocis.net (2003-05-06)
Re: lexing backwards Ron@Profit-Master.com (Ron Pinkas) (2003-05-14)
Re: lexing backwards Ron@Profit-Master.com (Ron Pinkas) (2003-05-16)
Re: lexing backwards genew@mail.ocis.net (2003-05-16)
Re: lexing backwards Ron@Profit-Master.com (Ron Pinkas) (2003-05-18)
Re: lexing backwards genew@mail.ocis.net (2003-05-24)
| List of all articles for this month |

From: genew@mail.ocis.net (Gene Wirchenko)
Newsgroups: comp.compilers
Date: 6 May 2003 19:17:03 -0400
Organization: Posted via Supernews, http://www.supernews.com
References: 03-04-015 03-04-026 03-04-030
Keywords: lex, practice
Posted-Date: 06 May 2003 19:17:03 EDT

"Ron Pinkas" <Ron@Profit-Master.com> wrote:


[snip]


>Self Contained
>---------------
>
>These are tokens like the C language:
>
> -> ++ -- := ==
>
>That's to say no Delimiter is required to terminate such token. One may also
>think of this class of tokens, as Multi-Character delimiters. Once found in
>the input outside the context of a Stream, they serve as unconditional
>terminator of the prior input, and are also tokens on their own.


Counterexample:


                    a/*comment*/=5;
                                          ^^
          If I follow you correctly "/=" is a self-contained token, but
that is not how the above would be parsed in C/C++.


[snip]


Sincerely,


Gene Wirchenko


Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.