|
The Lex & Yacc Page
|
||||||
| The asteroid to kill this dinosaur is still in orbit. - Lex Manual Page |
||||||
| ON THIS PAGE | ||||||
| Overview | Lex | Yacc | Flex | Bison | Tools | Books |
||||||
| OVERVIEW | ||||||
A compiler or interptreter for a programminning language is often decomposed into two parts:
The task of discovering the source structure again is decomposed into subtasks:
|
||||||
| LEX | ||||||
Lex - A Lexical Analyzer GeneratorM. E. Lesk and E. SchmidtLex helps write programs whose control flow is directed by instances of regular expressions in the input stream. It is well suited for editor-script type transformations and for segmenting input in preparation for a parsing routine. Lex source is a table of regular expressions and corresponding program fragments. The table is translated to a program which reads an input stream, copying it to an output stream and partitioning the input into strings which match the given expressions. As each such string is recognized the corresponding program fragment is executed. The recognition of the expressions is performed by a deterministic finite automaton generated by Lex. The program fragments written by the user are executed in the order in which the corresponding regular expressions occur in the input stream.
|
||||||
| YACC | ||||||
Yacc: Yet Another Compiler-CompilerStephen C. JohnsonComputer program input generally has some structure; in fact, every computer program that does input can be thought of as defining an ``input language‘‘ which it accepts. An input language may be as complex as a programming language, or as simple as a sequence of numbers. Unfortunately, usual input facilities are limited, difficult to use, and often are lax about checking their inputs for validity. Yacc provides a general tool for describing the input to a computer program. The Yacc user specifies the structures of his input, together with code to be invoked as each such structure is recognized. Yacc turns such a specification into a subroutine that han- dles the input process; frequently, it is convenient and appropriate to have most of the flow of control in the user‘s application handled by this subroutine.
|
||||||
| FLEX | ||||||
Flex, A fast scanner generatorVern Paxsonflex is a tool for generating scanners: programs which recognized lexical patterns in text. flex reads the given input files, or its standard input if no file names are given, for a description of a scanner to generate. The description is in the form of pairs of regular expressions and C code, called rules. flex generates as output a C source file, `lex.yy.c‘, which defines a routine `yylex()‘. This file is compiled and linked with the `-lfl‘ library to produce an executable. When the executable is run, it analyzes its input for occurrences of the regular expressions. Whenever it finds one, it executes the corresponding C code.
|
||||||
| BISON | ||||||
Bison, The YACC-compatible Parser GeneratorCharles Donnelly and Richard StallmanBison is a general-purpose parser generator that converts a grammar description for an LALR(1) context-free grammar into a C program to parse that grammar. Once you are proficient with Bison, you may use it to develop a wide range of language parsers, from those used in simple desk calculators to complex programming languages. Bison is upward compatible with Yacc: all properly-written Yacc grammars ought to work with Bison with no change. Anyone familiar with Yacc should be able to use Bison with little trouble.
|
||||||
| TOOLS | ||||||
Other tools for compiler writers:
|
||||||
| BOOKS | ||||||
|
|
|
