Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
#include <e.h>
|
|
|
|
#include <Eina.h>
|
|
|
|
#include <grp.h>
|
|
|
|
#include <sys/types.h>
|
|
|
|
#include <pwd.h>
|
2021-03-24 08:04:48 -07:00
|
|
|
#include <Elput.h>
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
|
|
|
|
E_API E_Module_Api e_modapi =
|
|
|
|
{
|
|
|
|
E_MODULE_API_VERSION,
|
|
|
|
"Gesture Recognition"
|
|
|
|
};
|
|
|
|
|
|
|
|
static Eina_Hash *active_gestures;
|
2021-03-24 08:04:48 -07:00
|
|
|
static Elput_Manager *manager;
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
|
|
|
|
typedef struct {
|
|
|
|
Eina_Vector2 pos;
|
|
|
|
unsigned int fingers;
|
|
|
|
struct {
|
|
|
|
Evas_Object *visuals, *win;
|
|
|
|
} visuals;
|
|
|
|
} Swipe_Stats;
|
|
|
|
|
|
|
|
static Swipe_Stats*
|
2021-03-24 08:04:48 -07:00
|
|
|
_find_swipe_gesture_recognizition(Elput_Device *dev)
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
{
|
|
|
|
Swipe_Stats *stats = eina_hash_find(active_gestures, dev);
|
|
|
|
|
|
|
|
return stats;
|
|
|
|
}
|
|
|
|
|
|
|
|
static Swipe_Stats*
|
2021-03-24 08:04:48 -07:00
|
|
|
_start_swipe_gesture_recognizition(Elput_Device *dev)
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
{
|
|
|
|
Swipe_Stats *stats = _find_swipe_gesture_recognizition(dev);
|
|
|
|
|
|
|
|
if (stats)
|
|
|
|
eina_hash_del_by_key(active_gestures, dev);
|
|
|
|
|
|
|
|
stats = calloc(1, sizeof(Swipe_Stats));
|
|
|
|
EINA_SAFETY_ON_NULL_RETURN_VAL(stats, NULL);
|
|
|
|
|
|
|
|
if (e_bindings_swipe_available())
|
|
|
|
{
|
2020-07-28 01:02:58 -07:00
|
|
|
E_Zone *zone = e_zone_current_get();
|
|
|
|
|
|
|
|
stats->visuals.win = elm_notify_add(zone->base);
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
elm_notify_align_set(stats->visuals.win, 0.5, 0.5);
|
|
|
|
elm_object_tree_focus_allow_set(stats->visuals.win, EINA_FALSE);
|
|
|
|
evas_object_layer_set(stats->visuals.win, E_LAYER_CLIENT_PRIO);
|
|
|
|
evas_object_show(stats->visuals.win);
|
|
|
|
|
|
|
|
stats->visuals.visuals = elm_progressbar_add(stats->visuals.win);
|
|
|
|
elm_object_text_set(stats->visuals.visuals, "Progress of visuals");
|
|
|
|
evas_object_size_hint_min_set(stats->visuals.visuals, 300, 50);
|
|
|
|
evas_object_show(stats->visuals.visuals);
|
|
|
|
elm_object_content_set(stats->visuals.win, stats->visuals.visuals);
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
eina_hash_add(active_gestures, dev, stats);
|
|
|
|
|
|
|
|
return stats;
|
|
|
|
}
|
|
|
|
|
|
|
|
static void
|
2021-03-24 08:04:48 -07:00
|
|
|
_end_swipe_gesture_recognizition(Elput_Device *dev)
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
{
|
|
|
|
eina_hash_del_by_key(active_gestures, dev);
|
|
|
|
}
|
|
|
|
|
|
|
|
static double
|
|
|
|
_config_angle(Eina_Vector2 pos)
|
|
|
|
{
|
|
|
|
double res = atan(pos.y/pos.x);
|
|
|
|
|
|
|
|
if (res < 0) res += M_PI;
|
|
|
|
if (pos.y < 0) res += M_PI;
|
|
|
|
return res;
|
|
|
|
}
|
|
|
|
|
|
|
|
static Eina_Bool
|
|
|
|
_user_part_of_input(void)
|
|
|
|
{
|
|
|
|
uid_t user = getuid();
|
|
|
|
struct passwd *user_pw = getpwuid(user);
|
|
|
|
gid_t *gids = NULL;
|
|
|
|
int number_of_groups = 0;
|
|
|
|
struct group *input_group = getgrnam("input");
|
|
|
|
|
|
|
|
EINA_SAFETY_ON_NULL_RETURN_VAL(user_pw, EINA_FALSE);
|
|
|
|
EINA_SAFETY_ON_NULL_RETURN_VAL(input_group, EINA_FALSE);
|
|
|
|
|
|
|
|
if (getgrouplist(user_pw->pw_name, getgid(), NULL, &number_of_groups) != -1)
|
|
|
|
{
|
|
|
|
ERR("Failed to enumerate groups of user");
|
|
|
|
return EINA_FALSE;
|
|
|
|
}
|
|
|
|
number_of_groups ++;
|
|
|
|
gids = alloca((number_of_groups) * sizeof(gid_t));
|
|
|
|
if (getgrouplist(user_pw->pw_name, getgid(), gids, &number_of_groups) == -1)
|
|
|
|
{
|
|
|
|
ERR("Failed to get groups of user");
|
|
|
|
return EINA_FALSE;
|
|
|
|
}
|
|
|
|
|
|
|
|
for (int i = 0; i < number_of_groups; ++i)
|
|
|
|
{
|
|
|
|
if (gids[i] == input_group->gr_gid)
|
|
|
|
return EINA_TRUE;
|
|
|
|
}
|
|
|
|
return EINA_FALSE;
|
|
|
|
}
|
|
|
|
|
|
|
|
static void
|
|
|
|
_stats_free(void *ptr)
|
|
|
|
{
|
|
|
|
Swipe_Stats *stats = ptr;
|
|
|
|
|
|
|
|
evas_object_del(stats->visuals.win);
|
|
|
|
free(stats);
|
|
|
|
}
|
|
|
|
|
2021-03-24 08:04:48 -07:00
|
|
|
static void
|
|
|
|
_begin(void *data EINA_UNUSED, Elput_Device *device, Elput_Swipe_Gesture *gesture)
|
|
|
|
{
|
|
|
|
Swipe_Stats *stats = _start_swipe_gesture_recognizition(device);
|
|
|
|
stats->fingers = elput_swipe_finger_count_get(gesture);
|
|
|
|
stats->pos.x = stats->pos.y = 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
static void
|
|
|
|
_update(void *data EINA_UNUSED, Elput_Device *device, Elput_Swipe_Gesture *gesture)
|
|
|
|
{
|
|
|
|
E_Bindings_Swipe_Live_Update live_update = e_bindings_swipe_live_update_hook_get();
|
|
|
|
Swipe_Stats *stats = _find_swipe_gesture_recognizition(device);
|
|
|
|
|
|
|
|
stats->pos.x += elput_swipe_dx_get(gesture);
|
|
|
|
stats->pos.y += elput_swipe_dy_get(gesture);
|
|
|
|
|
|
|
|
if (live_update)
|
|
|
|
{
|
|
|
|
live_update(e_bindings_swipe_live_update_hook_data_get(), EINA_FALSE, _config_angle(stats->pos), eina_vector2_length_get(&stats->pos), 0.8, stats->fingers);
|
|
|
|
}
|
|
|
|
else if (stats->visuals.win)
|
|
|
|
{
|
|
|
|
Eina_Inarray *res = e_bindings_swipe_find_candidates(E_BINDING_CONTEXT_NONE, _config_angle (stats->pos), eina_vector2_length_get(&stats->pos), stats->fingers);
|
|
|
|
E_Binding_Swipe_Candidate *itr;
|
|
|
|
double total = 0.0f;
|
|
|
|
unsigned int len = 0;
|
|
|
|
|
|
|
|
EINA_INARRAY_FOREACH(res, itr)
|
|
|
|
{
|
|
|
|
total += itr->acceptance;
|
|
|
|
len ++;
|
|
|
|
}
|
|
|
|
|
|
|
|
if (len > 0)
|
|
|
|
{
|
|
|
|
char text_buffer[1000];
|
|
|
|
|
|
|
|
snprintf(text_buffer, sizeof(text_buffer), "%d gestures possible", len);
|
|
|
|
elm_progressbar_value_set(stats->visuals.visuals, total/len);
|
|
|
|
elm_object_text_set(stats->visuals.visuals, text_buffer);
|
|
|
|
}
|
|
|
|
else
|
|
|
|
{
|
|
|
|
elm_progressbar_value_set(stats->visuals.visuals, 0.0f);
|
|
|
|
elm_object_text_set(stats->visuals.visuals, "No gesture found");
|
|
|
|
}
|
|
|
|
|
|
|
|
eina_inarray_free(res);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
static void
|
|
|
|
_end(void *data EINA_UNUSED, Elput_Device *device, Elput_Swipe_Gesture *gesture EINA_UNUSED)
|
|
|
|
{
|
|
|
|
E_Bindings_Swipe_Live_Update live_update = e_bindings_swipe_live_update_hook_get();
|
|
|
|
Swipe_Stats *stats = _find_swipe_gesture_recognizition(device);
|
|
|
|
|
|
|
|
if (live_update)
|
|
|
|
live_update(e_bindings_swipe_live_update_hook_data_get(), EINA_TRUE, _config_angle(stats->pos), eina_vector2_length_get(&stats->pos), 0.8, stats->fingers);
|
|
|
|
else
|
|
|
|
e_bindings_swipe_handle(E_BINDING_CONTEXT_NONE, NULL, _config_angle(stats->pos), eina_vector2_length_get(&stats->pos), stats->fingers);
|
|
|
|
|
|
|
|
_end_swipe_gesture_recognizition(device);
|
|
|
|
}
|
|
|
|
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
E_API int
|
|
|
|
e_modapi_init(E_Module *m EINA_UNUSED)
|
|
|
|
{
|
2021-03-24 08:04:48 -07:00
|
|
|
const char *device = NULL;
|
|
|
|
|
|
|
|
elput_init();
|
|
|
|
|
|
|
|
device = getenv("XDG_SEAT");
|
|
|
|
if (!device) device = "seat0";
|
|
|
|
manager = elput_manager_connect_gestures(device, 0);
|
|
|
|
elput_input_init(manager);
|
|
|
|
|
|
|
|
elput_manager_swipe_gesture_listen(manager, _begin, NULL, _update, NULL, _end, NULL);
|
|
|
|
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
if (!_user_part_of_input())
|
|
|
|
{
|
|
|
|
e_module_dialog_show(m, "Gesture Recognition", "Your user is not part of the input group, libinput cannot be used.");
|
|
|
|
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
active_gestures = eina_hash_pointer_new(_stats_free);
|
|
|
|
|
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
|
|
|
|
E_API int
|
|
|
|
e_modapi_shutdown(E_Module *m EINA_UNUSED)
|
|
|
|
{
|
2021-03-24 08:04:48 -07:00
|
|
|
elput_shutdown();
|
Introduce gesture recognition
This is currently using libinputs gesture recognition. And offers a
config screen to setup new gestures.
1. No default gesture bindings are setup
2. When libinput is not available the module is not going to be loaded,
and nothing is recognited.+
3. Only swipe gestures are recognized yet.
4. For now, you are required to be part of the input group, otherwise we cannot
get the libinput events. (See Todo 1)
5. The visual representation is not really good. In terms of UI, it is
visually showing a value coming from left to right, which is
indicating a direction, which is not always the direction of the
gesture, which is kind of bad. More improvements needed here.
Some things that still can be done:
1. The whole libinput things should be handled by elput, either with the
input group hack, or logind, or simply by root. The ideal idea would
be that e_sys is creating the elput context, which also listens for new
devices etc.. When all this is done, and it recognizes a new device, it
can simply sent a message from e_sys to e, that there is some new
device, with a opened fd. (However, this all needs to be locked up in a
way that e_sys cannot be abused)
2020-07-02 03:18:42 -07:00
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
|
|
|
|
E_API int
|
|
|
|
e_modapi_save(E_Module *m EINA_UNUSED)
|
|
|
|
{
|
|
|
|
|
|
|
|
return 1;
|
|
|
|
}
|
|
|
|
|