Commit Graph

125 Commits

Author SHA1 Message Date
Daniel Zaoui bea26c676e Inspect: introduce a scenario visualizer and compare tool
This replaces the existing exactness_helper. A GUI has been added:
- Compare images
- Compare scenarios
2018-05-06 22:53:30 +03:00
Daniel Zaoui db747c49a9 Disable PRELOAD libs compilation 2018-05-06 22:53:30 +03:00
Daniel Zaoui 3bcd6bb4de Replace preload invocation with exactness_play 2018-05-06 22:53:30 +03:00
Daniel Zaoui e4ac42a7b1 Refactor exactness binary
As all the file have been merged, code cleaning is necessary. In
addition, some structures have been removed.
2018-05-06 22:53:30 +03:00
Daniel Zaoui 83e34fec36 Merge all the source files of exactness binary
It will be easier to refactor everything after that
2018-04-21 22:20:23 +03:00
Daniel Zaoui 76a433273e Introduce a new recorder not using LD_PRELOAD 2018-04-21 22:20:23 +03:00
Daniel Zaoui 7a4e7f2e55 Introduce a new player not using LD_PRELOAD
To make Exactness portable, LD_PRELOAD needs to be replaced by other
2018-04-21 22:20:23 +03:00
Daniel Zaoui 7c10de63e3 Support adding delay to a specific shot in the scenario
It helps when a shot is not stable and need a few ms more to be ok.
2018-01-01 00:18:27 +02:00
Daniel Zaoui c83ed3fabb Fix preload after removal of ecore_main_loop_begin
Since this function doesn't exist anymore, we need to catch the loop
begin in a different way.
2018-01-01 00:18:27 +02:00
Daniel Zaoui 09dc7c8353 Update code after EFL changes 2017-09-19 10:36:04 +03:00
Daniel Zaoui 62298eb8ff Check evas validity before invocations 2016-11-30 07:06:02 +02:00
Daniel Zaoui 8a76345c15 Fix compilation when debug is enabled 2016-11-30 06:42:06 +02:00
Daniel Zaoui 781f294654 Helper: write recording only if needed 2016-11-06 10:19:37 +02:00
Daniel Zaoui ee1e8f77e1 Print command line when verbose is on 2016-11-06 08:43:47 +02:00
Daniel Zaoui dd4c1caade Store and compare objects information at every shot
This feature is aimed to provide a new way to debug applications during
scenarios playing.
When a difference happens between two shots of an application, the
investigation can be tough as the cause may be hidden into a tiny
change, such as an update of the theme.
This feature tries to respond to this problem by storing objects of
the application every time a shot is taken. Then during shots comparison,
objects information are compared and differences are displayed on the

The feature can be used with the -S option.

For the moment, only hierarchy, order and geometry are checked.
2016-10-26 07:57:24 +03:00
Daniel Zaoui 8e0a638b19 Rename static variable 2016-10-23 06:10:20 +03:00
Daniel Zaoui 33730b5dcd Destination directory is not needed during simulation
Shots are not needed in this mode too.
2016-10-10 10:42:48 +03:00
Daniel Zaoui 0eb607e7df Separate code related to recording and to playing hooks.
Hooks mixed in a same file leads to less readability.
2016-10-09 10:28:14 +03:00
Daniel Zaoui 081a86902c Rename internal file
This is the first part to separate hooks related to recorder and to
2016-10-09 07:41:20 +03:00
Daniel Zaoui 66347ba6a7 Modify internal functions scope.
These functions were declared as EAPI when they were only used
2016-10-09 07:38:07 +03:00
Daniel Zaoui 389c05bb5c Remove unused structure 2016-10-09 07:14:21 +03:00
Daniel Zaoui 905a507ab0 Centralize run command string generation
Most of this command is common to all the run modes.
2016-09-29 08:02:32 +03:00
Daniel Zaoui 1ad03a2e49 Modify macro to prevent simple-but-hard-to-find bugs
One of them is to forget to replace the struct name during a line copy,
leading to write bad data in the recording file and to its corruption.
2016-09-22 08:01:39 +03:00
Daniel Zaoui 95327a0f7c Recording: support new EFL input events
During recording, hooking on Evas functions can't work anymore as they
are no more invoked internally.
The new way to catch the events is to listen to them on the canvas.
Additionally, regular mouse events are now multi events whose tool (device id)
is 0, as well as key events with and without keycode are now always
considered with a keycode that can be 0.

Previous events catching has been kept to support legacy applications.
2016-09-22 07:38:10 +03:00
Daniel Zaoui fefa31d7b2 Fix compilation after Emile API change 2016-09-11 13:14:03 +03:00
Daniel Hirt 365630b8db Use correct output dir for reports
Not really sure if it needs to generate reports on 'init' mode, but at least now
it will be in the correct directory.
2016-07-13 16:30:07 +00:00
Daniel Zaoui a21c2f39cc Add an new executable to help on recordings maintenance
An issue that currently happens in Exactness is that we don't have any
way to debug the recordings.
Only debug information can help us to figure out what data is stored
inside the rec files.

Three commands are available:
- Clean: remove bad timestamp events and duplicate events
- Add a delay: because of the first event is directly treated if no
first timestamp is present, we need a way to fix recordings by adding
them a delay before the first event.
- List information: display the list of events, as vieet doesn't work at
all. Really helpful to figure out bugs.
2016-03-27 11:53:44 +03:00
Daniel Zaoui 4effc37ab0 Support reference timestamp
An issue due to timing happens when applying scenarios on applications.

The first event is directly treated, even if the recorder waited a few
seconds without any action.
The reason is that Exactness saves in the .rec file a timestamp that is
the uptime value, i.e an absolute value. A better choice would have been
to save the number of ms relative to the launch of the application.

Because of this, Exactness doesnt have any way to know when the first
event has to be treated and consumes it whenever possible, i.e at the

This patch adds to the recording file a timestamp reference, corresponding
to the uptime at ecore_init. When applying the scenario, this timestamp
is checked and gives an idea of a delay to wait before consuming the first
2016-03-23 11:42:47 +02:00
Daniel Zaoui b5900b27af Don't record an event with incorrect timestamp 2016-03-23 11:41:53 +02:00
Daniel Zaoui 1a35f7e8ba Remove struct member that has no reason to be 2016-03-23 09:06:08 +02:00
Stefan Schmidt 33787ceb6a Revert "replace "compare" utility with custom compare function using only EFL."
This reverts commit 7989552b29.

This change introduces segfaults on my machine as well as Jenkins every time a
test fails and a comparison of the images is needed. We might want to bring this
back later but for now a working solution is preferred.
2016-03-22 14:13:56 +01:00
Daniel Zaoui 06811238a1 Recording: stop recording consecutive duplicates events
A lot of events caught by Exactness preload are repeated with the same
information, such as mouse move on the same coordinates and with the
same timestamp. This adds a lot of noise into the recording file.

This patch checks if the current caught event is the same as the last
stored and skips it if they are the same.
2016-03-17 11:48:35 +02:00
Daniel Zaoui 4b2887721b Force scale and finger size
These two environment variables need to be forced to the standard
values to make sure scenarios are well applied.
Without this forcing, mouse clicks are not done at the right
coordinates, leading to a different behavior of the application. In
addition, shots comparison will always fail if the series of images are
based on different values of these variables.
2016-03-02 12:46:26 +02:00
Daniel Zaoui ef0b0ae89b Modify the verbose rectangle color on clicked and shot
This is useful when looking at recorded scenarios to understand what is
Sometimes, when scenarios are too old, click is not done on the right
area, leading to weird behavior.
2016-02-28 15:00:40 +02:00
Daniel Zaoui 83b9e632dc Add F3 key to record scenario
During ecore_shutdown, when the refcount reached 0, the scenario record
has to be done. The problem is that the ecore termination never happens
because of ecore modules loaded during init that references ecore
The solution, until this is fixed, is to trigger the scenario recording
from a key press.
2016-02-28 15:00:40 +02:00
kabeer khan 7989552b29 replace "compare" utility with custom compare function using only EFL.
Summary: Signed-off-by: kabeer khan <>

Reviewers: cedric, tasn

Reviewed By: cedric, tasn

Subscribers: tasn

Differential Revision:

Signed-off-by: Cedric BAIL <>
2015-07-29 23:27:29 +02:00
kabeer khan bb051fce2b Prevent deletion of shots having same prefix as test name
Summary: Signed-off-by: kabeer khan <>

Reviewers: tasn

Differential Revision:
2015-06-09 13:52:53 +01:00
kabeer khan 773e539083 Avoid comparing of tests in play step having common prefix
Currently genlist_group is also running in play step even if it is
commented in tests.txt. Fixed this issue

Signed-off-by: kabeer khan <>

Reviewers: cedric, stefan_schmidt, tasn

Subscribers: stefan_schmidt

Differential Revision:
2015-06-04 10:50:33 +01:00
kabeer khan 834021b743 Enabled exactness to use efl beta API's
Summary: Signed-off-by: kabeer khan <>

Reviewers: cedric, tasn

Differential Revision:
2015-05-27 13:12:40 +01:00
kabeer khan e02ad005f1 Using sha1 to compare two images in play step instead of md5
Using using emile to calculate image sha1 instead of md5 to compare
two images, hence making exactness independant of md5.

Signed-off-by: kabeer khan <>

Reviewers: cedric, tasn

Differential Revision:
2015-05-27 11:41:28 +01:00
kabeer khan a701d336ca Make exactness independant of elementary
Summary: Signed-off-by: kabeer khan <>

Reviewers: tasn

Differential Revision:
2015-03-05 13:03:08 +00:00
Tom Hacohen e2c1fa0636 Remove unused variable. 2015-03-05 12:03:55 +00:00
kabeer khan 079dbb6dd5 added code to enable shots capturing of ecore_evas and evas examples
Summary: Signed-off-by: kabeer khan <>

Reviewers: cedric, tasn

Reviewed By: tasn

Differential Revision:
2015-03-04 15:00:05 +00:00
kabeer khan 450d2888eb Add key up/down with keycode event handler
To catch key press event added key up/down with keycode event handler

Signed-off-by: kabeer khan <>

Reviewers: cedric, tasn

Differential Revision:
2015-03-04 14:55:17 +00:00
kabeer khan c883067d4b Added .gitignore in bin folder to ignore exactness binary
Summary: Signed-off-by: kabeer khan <>

Reviewers: tasn

Differential Revision:
2015-02-26 13:10:01 +00:00
Tom Hacohen 3b0eb3b873 Fixed a bug preventing it from working on some setups. 2013-10-20 11:21:12 +01:00
Tom Hacohen 163567f0cc Added a more verbose "Shot taken" message.
Include the filename in the message.
2013-06-14 14:41:55 +01:00
Tom Hacohen a2c36ec82a Fix memory leak of filename when running in simulation mode. 2013-06-14 14:41:04 +01:00
Tom Hacohen 7f40296382 Sort exactness errors. 2013-06-14 13:33:32 +01:00
Tom Hacohen 4b8326ad60 Change image files naming template: name_%d.png -> name_%03d.png. 2013-06-14 13:33:23 +01:00