Re: Lexical scanners?

Christian Wetzel <cnwetzel@linguistik.uni-erlangen.de>
3 Apr 1998 17:01:10 -0500

          From comp.compilers

Related articles
Lexical scanners? mfinney@lynchburg.net (1998-03-30)
Re: Lexical scanners? cnwetzel@linguistik.uni-erlangen.de (Christian Wetzel) (1998-04-03)
Re: Lexical scanners? mfinney@lynchburg.net (1998-04-09)
| List of all articles for this month |

From: Christian Wetzel <cnwetzel@linguistik.uni-erlangen.de>
Newsgroups: comp.compilers
Date: 3 Apr 1998 17:01:10 -0500
Organization: CLUE -- Computerlinguistik Uni Erlangen
References: 98-03-235
Keywords: lex, i18n

mfinney@lynchburg.net wrote:
> I need a lexical scanner which...
> a) uses a large symbol set (Unicode), and
> b) can have new tokeens added dynamically.


> Ignoring requirement (b), for the moment, are there any tools
> available which can construct (with reasonable space and time
> efficiency) a lexical scanner for large character sets?


zlex seems to fulfill your requirements, at least it supports =


16-bit characters:


    http://opal.cs.binghamton.edu/~zdu/zlex


Hope that helps,
      Christian
--


Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.