Commit Graph

228 Commits

Author SHA1 Message Date
Daniel Zaoui 1ad03a2e49 Modify macro to prevent simple-but-hard-to-find bugs
One of them is to forget to replace the struct name during a line copy,
leading to write bad data in the recording file and to its corruption.
2016-09-22 08:01:39 +03:00
Daniel Zaoui 95327a0f7c Recording: support new EFL input events
During recording, hooking on Evas functions can't work anymore as they
are no more invoked internally.
The new way to catch the events is to listen to them on the canvas.
Additionally, regular mouse events are now multi events whose tool (device id)
is 0, as well as key events with and without keycode are now always
considered with a keycode that can be 0.

Previous events catching has been kept to support legacy applications.
2016-09-22 07:38:10 +03:00
Daniel Zaoui fefa31d7b2 Fix compilation after Emile API change 2016-09-11 13:14:03 +03:00
Daniel Hirt 365630b8db Use correct output dir for reports
Not really sure if it needs to generate reports on 'init' mode, but at least now
it will be in the correct directory.
2016-07-13 16:30:07 +00:00
Daniel Zaoui a21c2f39cc Add an new executable to help on recordings maintenance
An issue that currently happens in Exactness is that we don't have any
way to debug the recordings.
Only debug information can help us to figure out what data is stored
inside the rec files.

Three commands are available:
- Clean: remove bad timestamp events and duplicate events
- Add a delay: because of the first event is directly treated if no
first timestamp is present, we need a way to fix recordings by adding
them a delay before the first event.
- List information: display the list of events, as vieet doesn't work at
all. Really helpful to figure out bugs.
2016-03-27 11:53:44 +03:00
Daniel Zaoui 4effc37ab0 Support reference timestamp
An issue due to timing happens when applying scenarios on applications.

The first event is directly treated, even if the recorder waited a few
seconds without any action.
The reason is that Exactness saves in the .rec file a timestamp that is
the uptime value, i.e an absolute value. A better choice would have been
to save the number of ms relative to the launch of the application.

Because of this, Exactness doesnt have any way to know when the first
event has to be treated and consumes it whenever possible, i.e at the
beginning.

This patch adds to the recording file a timestamp reference, corresponding
to the uptime at ecore_init. When applying the scenario, this timestamp
is checked and gives an idea of a delay to wait before consuming the first
event.
2016-03-23 11:42:47 +02:00
Daniel Zaoui b5900b27af Don't record an event with incorrect timestamp 2016-03-23 11:41:53 +02:00
Daniel Zaoui 1a35f7e8ba Remove struct member that has no reason to be 2016-03-23 09:06:08 +02:00
Stefan Schmidt 33787ceb6a Revert "replace "compare" utility with custom compare function using only EFL."
This reverts commit 7989552b29.

This change introduces segfaults on my machine as well as Jenkins every time a
test fails and a comparison of the images is needed. We might want to bring this
back later but for now a working solution is preferred.
2016-03-22 14:13:56 +01:00
Daniel Zaoui 06811238a1 Recording: stop recording consecutive duplicates events
A lot of events caught by Exactness preload are repeated with the same
information, such as mouse move on the same coordinates and with the
same timestamp. This adds a lot of noise into the recording file.

This patch checks if the current caught event is the same as the last
stored and skips it if they are the same.
2016-03-17 11:48:35 +02:00
Daniel Zaoui 4b2887721b Force scale and finger size
These two environment variables need to be forced to the standard
values to make sure scenarios are well applied.
Without this forcing, mouse clicks are not done at the right
coordinates, leading to a different behavior of the application. In
addition, shots comparison will always fail if the series of images are
based on different values of these variables.
2016-03-02 12:46:26 +02:00
Daniel Zaoui ef0b0ae89b Modify the verbose rectangle color on clicked and shot
This is useful when looking at recorded scenarios to understand what is
done.
Sometimes, when scenarios are too old, click is not done on the right
area, leading to weird behavior.
2016-02-28 15:00:40 +02:00
Daniel Zaoui 83b9e632dc Add F3 key to record scenario
During ecore_shutdown, when the refcount reached 0, the scenario record
has to be done. The problem is that the ecore termination never happens
because of ecore modules loaded during init that references ecore
refcount.
The solution, until this is fixed, is to trigger the scenario recording
from a key press.
2016-02-28 15:00:40 +02:00
kabeer khan 7989552b29 replace "compare" utility with custom compare function using only EFL.
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Reviewed By: cedric, tasn

Subscribers: tasn

Differential Revision: https://phab.enlightenment.org/D2684

Signed-off-by: Cedric BAIL <cedric@osg.samsung.com>
2015-07-29 23:27:29 +02:00
kabeer khan bb051fce2b Prevent deletion of shots having same prefix as test name
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn

Differential Revision: https://phab.enlightenment.org/D2629
2015-06-09 13:52:53 +01:00
kabeer khan 773e539083 Avoid comparing of tests in play step having common prefix
Summary:
Currently genlist_group is also running in play step even if it is
commented in tests.txt. Fixed this issue

Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, stefan_schmidt, tasn

Subscribers: stefan_schmidt

Differential Revision: https://phab.enlightenment.org/D2604
2015-06-04 10:50:33 +01:00
kabeer khan 834021b743 Enabled exactness to use efl beta API's
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Differential Revision: https://phab.enlightenment.org/D2583
2015-05-27 13:12:40 +01:00
kabeer khan c0b95e61cd Fixed DSO error which occured in auto build
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn, cedric

Differential Revision: https://phab.enlightenment.org/D2584
2015-05-27 12:56:08 +01:00
kabeer khan e02ad005f1 Using sha1 to compare two images in play step instead of md5
Summary:
Using using emile to calculate image sha1 instead of md5 to compare
two images, hence making exactness independant of md5.

Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Differential Revision: https://phab.enlightenment.org/D2569
2015-05-27 11:41:28 +01:00
Stefan Schmidt 9be2fb5747 Remove useless file that is not related to the project. 2015-05-13 15:43:30 +02:00
Stefan Schmidt f5d21bf0ad build: Use silent rules for automake by deafult.
This allows us to have a sane clean build ouput and spot problems easier.
Using V=1 is still possible to get a verbose output.
2015-05-13 15:42:16 +02:00
kabeer khan a701d336ca Make exactness independant of elementary
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn

Differential Revision: https://phab.enlightenment.org/D2105
2015-03-05 13:03:08 +00:00
Tom Hacohen e2c1fa0636 Remove unused variable. 2015-03-05 12:03:55 +00:00
kabeer khan 079dbb6dd5 added code to enable shots capturing of ecore_evas and evas examples
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Reviewed By: tasn

Differential Revision: https://phab.enlightenment.org/D2082
2015-03-04 15:00:05 +00:00
kabeer khan 450d2888eb Add key up/down with keycode event handler
Summary:
To catch key press event added key up/down with keycode event handler

Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Differential Revision: https://phab.enlightenment.org/D2052
2015-03-04 14:55:17 +00:00
Tom Hacohen 93620e389f Add arc config. 2015-02-26 13:10:22 +00:00
kabeer khan c883067d4b Added .gitignore in bin folder to ignore exactness binary
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn

Differential Revision: https://phab.enlightenment.org/D2057
2015-02-26 13:10:01 +00:00
Tom Hacohen 3b0eb3b873 Fixed a bug preventing it from working on some setups. 2013-10-20 11:21:12 +01:00
Tom Hacohen 37655cbab1 Updated README. 2013-07-31 13:08:21 +01:00
Tom Hacohen 163567f0cc Added a more verbose "Shot taken" message.
Include the filename in the message.
2013-06-14 14:41:55 +01:00
Tom Hacohen a2c36ec82a Fix memory leak of filename when running in simulation mode. 2013-06-14 14:41:04 +01:00
Tom Hacohen 7f40296382 Sort exactness errors. 2013-06-14 13:33:32 +01:00
Tom Hacohen 4b8326ad60 Change image files naming template: name_%d.png -> name_%03d.png. 2013-06-14 13:33:23 +01:00
Tom Hacohen 5500a3c0b1 Add an hook to evas_event_input_mouse_move.
Apparently this one is what the new function that is used by ecore_input
(and should be used by input providers) to get input to Evas.
2013-06-13 15:38:03 +01:00
Tom Hacohen b606de65cc Hook on evas_new instead of elm_win_add when tracking Evas.
This makes it more general and thus suitable for non-elm applications.
2013-06-13 13:48:28 +01:00
Tom Hacohen b4b7e65edd Fix initialization issues (and thus some segfaults).
Init ecore before using it, shutdown after done.
Init eet, as we need it as well.
2013-06-13 13:47:22 +01:00
Tom Hacohen b5523094af Print an error if report file can't be opened for writing. 2013-06-12 15:15:02 +01:00
Tom Hacohen 2d5cc83ed5 Also fail if exit signal is non-zero.
We should fail if we segfault, or exit because of another error that
ecore_exe reports a zero exit code for.
2013-06-10 16:57:48 +01:00
Daniel Willmann f94850e84a ecore_init/shutdown: Proper refcounting for wrappers
Signed-off-by: Daniel Willmann <d.willmann@samsung.com>
2013-06-10 16:57:48 +01:00
Tom Hacohen ed1d015b8f Added more verbose output to test buildbot. 2013-06-10 13:44:36 +01:00
Tom Hacohen afb0cd3cd1 Added the 'wrap' parameter, to use a wrapping command around the tests.
A good example would be valgrind.
2013-05-21 15:35:35 +01:00
Daniel Willmann eac1c58b97 There is not data/ dir, don't try to generate Makefiles for it
Signed-off-by: Daniel Willmann <d.willmann@samsung.com>
2013-05-21 14:00:26 +01:00
Tom Hacohen c99fdfb239 Added some verbose support (including cursor in simulation). 2013-05-17 15:47:08 +01:00
Tom Hacohen 36fe181d8e Moved recordings to exactness-data-elm. 2013-05-17 11:23:24 +01:00
Tom Hacohen 3e4c93bd83 Make the Exactness error report valid XHTML 1.0 Strict. 2013-05-15 17:20:00 +01:00
Tom Hacohen 11cc575120 Added html output for easier viewing of the errors. 2013-05-15 16:48:04 +01:00
Daniel Willmann feac36f368 Fix destdir usage for destdir != ./
Some more checks would be good, but this fixes basic usage for now.

Signed-off-by: Daniel Willmann <d.willmann@samsung.com>
2013-05-09 13:59:58 +01:00
Tom Hacohen 93ed31024e Removed accidentally added printf. 2013-05-08 15:48:21 +01:00
Tom Hacohen c5860fc6e6 Fixed exactness compilation. Thanks seoz. 2013-05-08 15:43:19 +01:00
Tom Hacohen b421382985 Fixed button test following last change. 2013-05-08 14:41:55 +01:00