kimcinoo
/
efl
forked from enlightenment/efl
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
efl/src/lib/eolian/eo_lexer.h

146 lines
3.6 KiB
C
Raw Normal View History

eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#ifndef __EO_LEXER_H__
#define __EO_LEXER_H__
#include <setjmp.h>
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
#include <Eina.h>
Eolian/Lexer: support of class types. Now, .eo format has to supply the class type class, abstract, mixin or interface. Example: class Elm_Button {...
2014-02-17 04:05:52 -08:00
#include <Eolian.h>
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
#include "eo_definitions.h"
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define START_CUSTOM 257
enum Tokens
{
eolian: different syntax for functions (func ret_type (arg_types))
2014-06-30 14:07:13 -07:00
TOK_COMMENT = START_CUSTOM, TOK_EOF, TOK_VALUE
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
};
#define KEYWORDS KW(class), KW(const), KW(private), KW(protected), \
KW(return), KW(signed), KW(struct), KW(unsigned), KW(virtual), \
eolian: support for C type translation in eo lexer
2014-06-26 04:02:19 -07:00
\
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
KW(abstract), KW(constructor), KW(constructors), KW(data), \
eolian/lexer: new keyword (func) plus new token (->) - for function pointer types
2014-06-26 06:27:45 -07:00
KW(destructor), KW(eo_prefix), KW(events), KW(func), KW(get), \
KW(implements), KW(interface), KW(keys), KW(legacy), KW(legacy_prefix), \
eolian: @own -> own
2014-06-30 10:10:29 -07:00
KW(methods), KW(mixin), KW(own), KW(params), KW(properties), KW(set), \
KW(type), KW(values), KWAT(in), KWAT(inout), KWAT(nonull), KWAT(out), \
eolian: support for C type translation in eo lexer
2014-06-26 04:02:19 -07:00
KWAT(warn_unused), \
\
eolian: schar and uchar are now called byte and ubyte, char stays Here, 'char' represents an actual character and is meant to be treated as so by generators. The byte types represent a numerical value and should be treated numerically.
2014-07-14 08:25:26 -07:00
KW(byte), KW(ubyte), KW(char), KW(short), KW(ushort), KW(int), KW(uint), \
eolian: builtin fixed size integer types, floating point types and void
2014-06-26 06:11:52 -07:00
KW(long), KW(ulong), KW(llong), KW(ullong), \
\
KW(int8), KW(uint8), KW(int16), KW(uint16), KW(int32), KW(uint32), \
KW(int64), KW(uint64), KW(int128), KW(uint128), \
\
eolian: builtin types size, ssize, intptr, uintptr, ptrdiff
2014-07-14 08:51:38 -07:00
KW(size), KW(ssize), KW(intptr), KW(uintptr), KW(ptrdiff), \
\
eolian: also make time_t a builtin
2014-07-14 09:02:58 -07:00
KW(time), \
\
eolian: builtin fixed size integer types, floating point types and void
2014-06-26 06:11:52 -07:00
KW(float), KW(double), KW(ldouble), \
\
eolian: builtin bool type, and change the eo files to use that
2014-07-11 06:40:14 -07:00
KW(bool), \
\
KW(void), \
\
KW(true), KW(false), KW(null)
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define KW(x) KW_##x
#define KWAT(x) KW_at_##x
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
enum Keywords
{
KW_UNKNOWN = 0,
eolian/lexer: new keyword (func) plus new token (->) - for function pointer types
2014-06-26 06:27:45 -07:00
KEYWORDS
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
};
#undef KW
#undef KWAT
typedef struct _Eo_Token
{
int token;
const char *value;
int kw;
} Eo_Token;
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: process classes and typedefs in order
2014-06-23 11:04:20 -07:00
enum Nodes
{
NODE_CLASS = 0,
eolian: better struct support including an API for by-name lookup
2014-07-08 08:42:33 -07:00
NODE_TYPEDEF,
NODE_STRUCT
eolian: process classes and typedefs in order
2014-06-23 11:04:20 -07:00
};
typedef struct _Eo_Node
{
unsigned char type;
union {
eolian: type -> typedef
2014-06-27 02:55:54 -07:00
void *def;
Eo_Class_Def *def_class;
eolian: refactoring: remove Eo_Type_Def
2014-07-10 07:10:24 -07:00
Eolian_Typedef *def_typedef;
eolian: get rid of Eo_Type_Def
2014-07-10 06:44:17 -07:00
Eolian_Type *def_struct;
eolian: process classes and typedefs in order
2014-06-23 11:04:20 -07:00
};
} Eo_Node;
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
typedef struct _Eo_Lexer
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
{
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
int current;
eolian: keep track of column better
2014-07-02 16:14:28 -07:00
int column, icolumn;
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
int line_number;
Eo_Token t, lookahead;
Eina_Strbuf *buff;
Eina_File *handle;
const char *source;
const char *stream;
eolian: fix end-of-file checking, move namespaces from :: to .
2014-06-20 02:45:55 -07:00
const char *stream_end;
eolian: print error line with a caret
2014-07-02 16:30:39 -07:00
const char *stream_line;
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
jmp_buf err_jmp;
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: process classes and typedefs in order
2014-06-23 11:04:20 -07:00
Eina_List *nodes;
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
Eo_Lexer_Temps tmp;
eolian: Eo_Tokenizer -> Eo_Lexer
2014-06-18 02:08:43 -07:00
} Eo_Lexer;
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: more cleanups
2014-06-20 07:31:45 -07:00
int eo_lexer_init (void);
int eo_lexer_shutdown (void);
Eo_Lexer *eo_lexer_new (const char *source);
void eo_lexer_free (Eo_Lexer *ls);
int eo_lexer_get_balanced (Eo_Lexer *ls, char beg, char end);
int eo_lexer_get_until (Eo_Lexer *ls, char end);
int eo_lexer_get (Eo_Lexer *ls);
int eo_lexer_get_ident (Eo_Lexer *ls, const char *chars);
int eo_lexer_lookahead (Eo_Lexer *ls);
int eo_lexer_lookahead_ident(Eo_Lexer *ls, const char *chars);
void eo_lexer_lex_error (Eo_Lexer *ls, const char *msg, int token);
void eo_lexer_syntax_error (Eo_Lexer *ls, const char *msg);
void eo_lexer_token_to_str (int token, char *buf);
const char *eo_lexer_keyword_str_get(int kw);
eolian: support for C type translation in eo lexer
2014-06-26 04:02:19 -07:00
Eina_Bool eo_lexer_is_type_keyword(int kw);
const char *eo_lexer_get_c_type (int kw);
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
extern int _eo_lexer_log_dom;
#ifdef CRITICAL
#undef CRITICAL
#endif
#define CRITICAL(...) EINA_LOG_DOM_CRIT(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#ifdef ERR
#undef ERR
#endif
#define ERR(...) EINA_LOG_DOM_ERR(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#ifdef WRN
#undef WRN
#endif
#define WRN(...) EINA_LOG_DOM_WARN(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define INF_ENABLED EINA_FALSE
#ifdef INF
#undef INF
#endif
#define INF(...) if (INF_ENABLED) EINA_LOG_DOM_INFO(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#define DBG_ENABLED EINA_FALSE
#ifdef DBG
#undef DBG
#endif
#define DBG(...) if (DBG_ENABLED) EINA_LOG_DOM_DBG(_eo_lexer_log_dom, __VA_ARGS__)
Eolian: first import. Imported by Tom, from the eolian repo which was written by: Daniel Zaoui <daniel.zaoui@samsung.com> Yakov Goldberg <yakov.g@samsung.com> Yossi Kantor <yossi.kantor@samsung.com> Savio Sena <savio@expertisesolutions.com.br> Jérémy Zurcher <jeremy@asynk.ch> Signed-off-by: Tom Hacohen <tom@stosb.com>
2014-02-11 05:42:59 -08:00
eolian: introducing a new lexer/parser This handwritten lexer/parser is more strict and cleaner than the previous Ragel based one, as well as faster and doesn't leak memory (or shouldn't). It's a recursive descent style parser with separate lexer part (unlike the previous effort) which is run at the same stage as the parser (so it doesn't pre-lex). @feature
2014-06-18 03:25:07 -07:00
#endif /* __EO_LEXER_H__ */