Solved

lex: how to restart a lexer with string input

Posted on 1999-01-20
9
352 Views
Last Modified: 2006-11-17
(note: I'm using AT&T lex)
I'm writing a shared library that lexs string input sent by external programs. Problem is, when the function is called consecutively by any instance of an external program, the lexer -- yylex() --  does not get reset. Thus, subsequent return values are null (the first call works great though!). Below is part of this program:


Part of the header file:
    ...
    #undef input
    #undef unput
    #define input() (*instring++)
    #define unput(c) ( *--instring = c)
    ...
and later I define the main function:

    char * lexfunction(char *yourstring)
    {
      ...
       instring=cpy_of_yourstring;
       yylex();
      ...
       return parsed_string;
    }

THEN an external script which loads in this library
can call "lexfunction(somestring)".

QUESTION: how do I reset the lexer. I know it's something with either yywrap() or yylex() but I don't know how to do it!

Any suggestions would be GREATLY appreciated.
0
Comment
Question by:greenhaze
9 Comments
 
LVL 1

Author Comment

by:greenhaze
ID: 1258232
Edited text of question
0
 
LVL 1

Author Comment

by:greenhaze
ID: 1258233
Edited text of question
0
 
LVL 5

Expert Comment

by:thoellri
ID: 1258234
Try adding the following function to your source:

int yywrap() {
  return 0;
}

Hope this helps
  Tobias
0
 
LVL 1

Author Comment

by:greenhaze
ID: 1258235
I had tried that. It causes the program to hang because yylex() needs a return 1 to shutdown. Modifying yywrap() seems to be best suited for applications that spin through a series of inputs with each execution.

As a shared library, it's not clear to me when execution really ends. Maybe that's the central issue here: how do I ensure a new instance of the function when new data comes in? This is very frustrating!!

Thanks for any help!
0
Scale it in WD Gold

With up to ten times the workload capacity of desktop drives, WD Gold hard drives employ advanced technology to deliver among the best in reliability, capacity, power efficiency and performance.

 
LVL 1

Author Comment

by:greenhaze
ID: 1258236
I had tried that. It causes the program to hang because yylex() needs a return 1 to shutdown. Modifying yywrap() seems to be best suited for applications that spin through a series of inputs with each execution.

As a shared library, it's not clear to me when execution really ends. Maybe that's the central issue here: how do I ensure a new instance of the function when new data comes in? This is very frustrating!!

Thanks for any help!
0
 
LVL 5

Expert Comment

by:thoellri
ID: 1258237
I'm sorry that it didn't fix your problem - I'm at a loss here :-(
  Tobias

0
 
LVL 3

Expert Comment

by:_Scotch_
ID: 1258238
Have you done something with YY_INPUT to lex a buffer rather
than a file ??

If so have a look at yy_create_buffer() and yy_switch_to_buffer()

-- I use flex but imagine the interface is much the same as lex
0
 

Accepted Solution

by:
login0000 earned 200 total points
ID: 1258239
to force lex to go back to the initial state after each call ,you can use yyterminate.
you can add for example this whitch work eaven if lex work on a string an not a file.

<<EOF>>                        {
                              //      printf("end du fichier");
                                    BEGIN(0);
                                    yyterminate();
                        
                              }
just try it. good luck
0
 
LVL 1

Author Comment

by:greenhaze
ID: 1258240
This is correct if using GNU flex; however, I'm using AT&T lex - its buggier cousin.

Likewise, the YY_INPUT macro is flex-specific. I had to use the #define input() statements for AT&T lex.

Alas, I got it running. Thanks for all the suggestions!


0

Featured Post

Save on storage to protect fatherhood memories

You're the dad who has everything. This Father's Day, make sure your family memories are protected. My Passport Ultra has automatic backup and password protection to keep your cherished photos and videos safe. With up to 3TB, you have plenty of room to hold the adventures ahead.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Summary: This tutorial covers some basics of pointer, pointer arithmetic and function pointer. What is a pointer: A pointer is a variable which holds an address. This address might be address of another variable/address of devices/address of fu…
Windows programmers of the C/C++ variety, how many of you realise that since Window 9x Microsoft has been lying to you about what constitutes Unicode (http://en.wikipedia.org/wiki/Unicode)? They will have you believe that Unicode requires you to use…
The goal of this video is to provide viewers with basic examples to understand how to use strings and some functions related to them in the C programming language.
The goal of this video is to provide viewers with basic examples to understand and use conditional statements in the C programming language.

861 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now