dimmus
/
efl
forked from enlightenment/efl
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
efl/src/lib/eolian/eo_lexer.h

106 lines
2.8 KiB
C
Raw Normal View History

eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#ifndef __EO_LEXER_H__
#define __EO_LEXER_H__
#include <setjmp.h>
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
#include <Eina.h>
Eolian/Lexer: support of class types. Now, .eo format has to supply the class type class, abstract, mixin or interface. Example: class Elm_Button {...
2014-02-17 04:05:52 -08:00
#include <Eolian.h>
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
#include "eo_definitions.h"
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define START_CUSTOM 257
enum Tokens
{
eolian: fix end-of-file checking, move namespaces from :: to .
2014-06-20 02:45:55 -07:00
TOK_COMMENT = START_CUSTOM, TOK_EOF, TOK_VALUE
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
};
#define KEYWORDS KW(class), KW(const), KW(private), KW(protected), \
KW(return), KW(signed), KW(struct), KW(unsigned), KW(virtual), \
KW(abstract), KW(constructor), KW(constructors), KW(data), \
KW(destructor), KW(eo_prefix), KW(events), KW(get), KW(implements), \
KW(interface), KW(keys), KW(legacy), KW(legacy_prefix), KW(methods), \
KW(mixin), KW(params), KW(properties), KW(set), KW(type), KW(values), \
KWAT(in), KWAT(inout), KWAT(nonull), KWAT(out), KWAT(own), KWAT(warn_unused)
#define KW(x) KW_##x
#define KWAT(x) KW_at_##x
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
enum Keywords
{
KW_UNKNOWN = 0,
KEYWORDS,
NUM_KEYWORDS
};
#undef KW
#undef KWAT
typedef struct _Eo_Token
{
int token;
const char *value;
int kw;
} Eo_Token;
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
typedef struct _Eo_Lexer
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
{
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
int current;
int line_number;
Eo_Token t, lookahead;
Eina_Strbuf *buff;
Eina_File *handle;
const char *source;
const char *stream;
eolian: fix end-of-file checking, move namespaces from :: to .
2014-06-20 02:45:55 -07:00
const char *stream_end;
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
jmp_buf err_jmp;
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
Revert "eolian: process classes and typedefs in order (preparation for later potential extension)" This reverts commit 7c28de061693fdc9a9409039692a4298bfb587c6.
2014-06-23 10:44:11 -07:00
Eina_List *classes;
Eina_List *typedefs;
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
Eo_Lexer_Temps tmp;
eolian: Eo_Tokenizer -> Eo_Lexer
2014-06-18 02:08:43 -07:00
} Eo_Lexer;
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: more cleanups
2014-06-20 07:31:45 -07:00
int eo_lexer_init (void);
int eo_lexer_shutdown (void);
Eo_Lexer *eo_lexer_new (const char *source);
void eo_lexer_free (Eo_Lexer *ls);
int eo_lexer_get_balanced (Eo_Lexer *ls, char beg, char end);
int eo_lexer_get_until (Eo_Lexer *ls, char end);
int eo_lexer_get (Eo_Lexer *ls);
int eo_lexer_get_ident (Eo_Lexer *ls, const char *chars);
int eo_lexer_lookahead (Eo_Lexer *ls);
int eo_lexer_lookahead_ident(Eo_Lexer *ls, const char *chars);
void eo_lexer_lex_error (Eo_Lexer *ls, const char *msg, int token);
void eo_lexer_syntax_error (Eo_Lexer *ls, const char *msg);
void eo_lexer_token_to_str (int token, char *buf);
const char *eo_lexer_keyword_str_get(int kw);
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
extern int _eo_lexer_log_dom;
#ifdef CRITICAL
#undef CRITICAL
#endif
#define CRITICAL(...) EINA_LOG_DOM_CRIT(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#ifdef ERR
#undef ERR
#endif
#define ERR(...) EINA_LOG_DOM_ERR(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#ifdef WRN
#undef WRN
#endif
#define WRN(...) EINA_LOG_DOM_WARN(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define INF_ENABLED EINA_FALSE
#ifdef INF
#undef INF
#endif
#define INF(...) if (INF_ENABLED) EINA_LOG_DOM_INFO(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define DBG_ENABLED EINA_FALSE
#ifdef DBG
#undef DBG
#endif
#define DBG(...) if (DBG_ENABLED) EINA_LOG_DOM_DBG(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#endif /* __EO_LEXER_H__ */