Re: Languages with optional spaces

Maury Markowitz <maury.markowitz@gmail.com>
Tue, 25 Feb 2020 06:13:23 -0800 (PST)

          From comp.compilers

Related articles
Languages with optional spaces maury.markowitz@gmail.com (Maury Markowitz) (2020-02-19)
Re: Languages with optional spaces awanderin@gmail.com (Jerry) (2020-02-20)
Re: Languages with optional spaces drikosev@gmail.com (Ev. Drikos) (2020-02-23)
Re: Languages with optional spaces maury.markowitz@gmail.com (Maury Markowitz) (2020-02-25)
Re: Languages with optional spaces maury.markowitz@gmail.com (Maury Markowitz) (2020-02-25)
Re: Languages with optional spaces martin@gkc.org.uk (Martin Ward) (2020-02-25)
Re: Languages with optional spaces 493-878-3164@kylheku.com (Kaz Kylheku) (2020-02-26)
Re: Languages with optional spaces awanderin@gmail.com (awanderin) (2020-02-26)
Re: Languages with optional spaces drikosev@gmail.com (Ev. Drikos) (2020-02-28)
Re: Languages with optional spaces christopher.f.clark@compiler-resources.com (Christopher F Clark) (2020-02-29)
Re: Languages with optional spaces drikosev@gmail.com (Ev. Drikos) (2020-02-29)
[10 later articles]
| List of all articles for this month |
From: Maury Markowitz <maury.markowitz@gmail.com>
Newsgroups: comp.compilers
Date: Tue, 25 Feb 2020 06:13:23 -0800 (PST)
Organization: Compilers Central
References: 20-02-015 20-02-016
Injection-Info: gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="44281"; mail-complaints-to="abuse@iecc.com"
Keywords: Basic
Posted-Date: 25 Feb 2020 10:48:07 EST
In-Reply-To: 20-02-016

Unless I'm mistaken, Integer BASIC is a "deep tokenizer", so is it not the case the spaces exist only at entry time? IE, if one types 'PRINT"HELLO"' that will actually be LISTed as 'PRINT "HELLO"?
[That is my recollection. Storing tokens takes less space than storing the input text and on those tiny little
micros, every byte counted. -John]



Post a followup to this message

Return to the comp.compilers page.
Search the comp.compilers archives again.