Re: Lexer capable of 16-bit characters

Marcel wrote:


> I've been looking for a lexer which is capable of handling 16-bit
> characters (for use with Unicode).
> Best results I've found so far looks to be Zlex, but the site it's
> located at (http://opal.cs.binghamton.edu/~zdu/zlex) can't
> be reached.


Some months ago the pages were reachable, but there was no
downloadable zlex. I asked the author of zlex for a copy, but didn't
get an answer yet.


> Does anyone know of another location of Zlex, or know another
> lexer which can handle 16-bit characters?


The newest perl version (5.005_50) has utf8 support (statement: "use
perl 5.005_50; use utf8;"), but it is said to be probably buggy, since
it's all brand new. But expect to have perl with reliable unicode
support soon. And as you can read in the thread "lex/flex for perl"
some days ago, perl is definitely a good choice for writing
lexers. There's also a module Parse::Lex for yacc-compatible lexers.


Christian


By the way: Apart from Parse::RecDescent there is a new
                        perl module Parse::Yapp announced to be available
                        on CPAN soon, which accepts yacc-like grammars
--

Return to the comp.compilers page.
Search the comp.compilers archives again.