|Lexer capable of 16-bit characters email@example.com (Marcel) (1998-08-05)|
|Re: Lexer capable of 16-bit characters firstname.lastname@example.org (Quinn Tyler Jackson) (1998-08-10)|
|Re: Lexer capable of 16-bit characters email@example.com (1998-08-10)|
|Re: Lexer capable of 16-bit characters firstname.lastname@example.org (Christian Wetzel) (1998-08-10)|
|Re: Lexer capable of 16-bit characters email@example.com (Scott Stanchfield) (1998-08-10)|
|Re: Lexer capable of 16-bit characters firstname.lastname@example.org (Gerwin Klein) (1998-08-24)|
|From:||Christian Wetzel <email@example.com>|
|Date:||10 Aug 1998 10:11:05 -0400|
|Organization:||CLUE -- Computerlinguistik Uni Erlangen|
> I've been looking for a lexer which is capable of handling 16-bit
> characters (for use with Unicode).
> Best results I've found so far looks to be Zlex, but the site it's
> located at (http://opal.cs.binghamton.edu/~zdu/zlex) can't
> be reached.
Some months ago the pages were reachable, but there was no
downloadable zlex. I asked the author of zlex for a copy, but didn't
get an answer yet.
> Does anyone know of another location of Zlex, or know another
> lexer which can handle 16-bit characters?
The newest perl version (5.005_50) has utf8 support (statement: "use
perl 5.005_50; use utf8;"), but it is said to be probably buggy, since
it's all brand new. But expect to have perl with reliable unicode
support soon. And as you can read in the thread "lex/flex for perl"
some days ago, perl is definitely a good choice for writing
lexers. There's also a module Parse::Lex for yacc-compatible lexers.
By the way: Apart from Parse::RecDescent there is a new
perl module Parse::Yapp announced to be available
on CPAN soon, which accepts yacc-like grammars
Return to the
Search the comp.compilers archives again.