enlightenment
/
exactness
7
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
176 Commits 2 Branches 0 Tags 1.2 MiB
Commit Graph

151 Commits

Author SHA1 Message Date
Daniel Zaoui fefa31d7b2 Fix compilation after Emile API change 2016-09-11 13:14:03 +03:00
Daniel Hirt 365630b8db Use correct output dir for reports 
Not really sure if it needs to generate reports on 'init' mode, but at least now
it will be in the correct directory.
 2016-07-13 16:30:07 +00:00
Daniel Zaoui a21c2f39cc Add an new executable to help on recordings maintenance 
An issue that currently happens in Exactness is that we don't have any
way to debug the recordings.
Only debug information can help us to figure out what data is stored
inside the rec files.

Three commands are available:
- Clean: remove bad timestamp events and duplicate events
- Add a delay: because of the first event is directly treated if no
first timestamp is present, we need a way to fix recordings by adding
them a delay before the first event.
- List information: display the list of events, as vieet doesn't work at
all. Really helpful to figure out bugs.
 2016-03-27 11:53:44 +03:00
Daniel Zaoui 4effc37ab0 Support reference timestamp 
An issue due to timing happens when applying scenarios on applications.

The first event is directly treated, even if the recorder waited a few
seconds without any action.
The reason is that Exactness saves in the .rec file a timestamp that is
the uptime value, i.e an absolute value. A better choice would have been
to save the number of ms relative to the launch of the application.

Because of this, Exactness doesnt have any way to know when the first
event has to be treated and consumes it whenever possible, i.e at the
beginning.

This patch adds to the recording file a timestamp reference, corresponding
to the uptime at ecore_init. When applying the scenario, this timestamp
is checked and gives an idea of a delay to wait before consuming the first
event.
 2016-03-23 11:42:47 +02:00
Daniel Zaoui b5900b27af Don't record an event with incorrect timestamp 2016-03-23 11:41:53 +02:00
Daniel Zaoui 1a35f7e8ba Remove struct member that has no reason to be 2016-03-23 09:06:08 +02:00
Stefan Schmidt 33787ceb6a Revert "replace "compare" utility with custom compare function using only EFL." 
This reverts commit 7989552b29.

This change introduces segfaults on my machine as well as Jenkins every time a
test fails and a comparison of the images is needed. We might want to bring this
back later but for now a working solution is preferred.
 2016-03-22 14:13:56 +01:00
Daniel Zaoui 06811238a1 Recording: stop recording consecutive duplicates events 
A lot of events caught by Exactness preload are repeated with the same
information, such as mouse move on the same coordinates and with the
same timestamp. This adds a lot of noise into the recording file.

This patch checks if the current caught event is the same as the last
stored and skips it if they are the same.
 2016-03-17 11:48:35 +02:00
Daniel Zaoui 4b2887721b Force scale and finger size 
These two environment variables need to be forced to the standard
values to make sure scenarios are well applied.
Without this forcing, mouse clicks are not done at the right
coordinates, leading to a different behavior of the application. In
addition, shots comparison will always fail if the series of images are
based on different values of these variables.
 2016-03-02 12:46:26 +02:00
Daniel Zaoui ef0b0ae89b Modify the verbose rectangle color on clicked and shot 
This is useful when looking at recorded scenarios to understand what is
done.
Sometimes, when scenarios are too old, click is not done on the right
area, leading to weird behavior.
 2016-02-28 15:00:40 +02:00
Daniel Zaoui 83b9e632dc Add F3 key to record scenario 
During ecore_shutdown, when the refcount reached 0, the scenario record
has to be done. The problem is that the ecore termination never happens
because of ecore modules loaded during init that references ecore
refcount.
The solution, until this is fixed, is to trigger the scenario recording
from a key press.
 2016-02-28 15:00:40 +02:00
kabeer khan 7989552b29 replace "compare" utility with custom compare function using only EFL. 
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Reviewed By: cedric, tasn

Subscribers: tasn

Differential Revision: https://phab.enlightenment.org/D2684

Signed-off-by: Cedric BAIL <cedric@osg.samsung.com>
 2015-07-29 23:27:29 +02:00
kabeer khan bb051fce2b Prevent deletion of shots having same prefix as test name 
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn

Differential Revision: https://phab.enlightenment.org/D2629
 2015-06-09 13:52:53 +01:00
kabeer khan 773e539083 Avoid comparing of tests in play step having common prefix 
Summary:
Currently genlist_group is also running in play step even if it is
commented in tests.txt. Fixed this issue

Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, stefan_schmidt, tasn

Subscribers: stefan_schmidt

Differential Revision: https://phab.enlightenment.org/D2604
 2015-06-04 10:50:33 +01:00
kabeer khan 834021b743 Enabled exactness to use efl beta API's 
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Differential Revision: https://phab.enlightenment.org/D2583
 2015-05-27 13:12:40 +01:00
kabeer khan e02ad005f1 Using sha1 to compare two images in play step instead of md5 
Summary:
Using using emile to calculate image sha1 instead of md5 to compare
two images, hence making exactness independant of md5.

Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Differential Revision: https://phab.enlightenment.org/D2569
 2015-05-27 11:41:28 +01:00
kabeer khan a701d336ca Make exactness independant of elementary 
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn

Differential Revision: https://phab.enlightenment.org/D2105
 2015-03-05 13:03:08 +00:00
Tom Hacohen e2c1fa0636 Remove unused variable. 2015-03-05 12:03:55 +00:00
kabeer khan 079dbb6dd5 added code to enable shots capturing of ecore_evas and evas examples 
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Reviewed By: tasn

Differential Revision: https://phab.enlightenment.org/D2082
 2015-03-04 15:00:05 +00:00
kabeer khan 450d2888eb Add key up/down with keycode event handler 
Summary:
To catch key press event added key up/down with keycode event handler

Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: cedric, tasn

Differential Revision: https://phab.enlightenment.org/D2052
 2015-03-04 14:55:17 +00:00
kabeer khan c883067d4b Added .gitignore in bin folder to ignore exactness binary 
Summary: Signed-off-by: kabeer khan <kabeer.khan@samsung.com>

Reviewers: tasn

Differential Revision: https://phab.enlightenment.org/D2057
 2015-02-26 13:10:01 +00:00
Tom Hacohen 3b0eb3b873 Fixed a bug preventing it from working on some setups. 2013-10-20 11:21:12 +01:00
Tom Hacohen 163567f0cc Added a more verbose "Shot taken" message. 
Include the filename in the message.
 2013-06-14 14:41:55 +01:00
Tom Hacohen a2c36ec82a Fix memory leak of filename when running in simulation mode. 2013-06-14 14:41:04 +01:00
Tom Hacohen 7f40296382 Sort exactness errors. 2013-06-14 13:33:32 +01:00
Tom Hacohen 4b8326ad60 Change image files naming template: name_%d.png -> name_%03d.png. 2013-06-14 13:33:23 +01:00
Tom Hacohen 5500a3c0b1 Add an hook to evas_event_input_mouse_move. 
Apparently this one is what the new function that is used by ecore_input
(and should be used by input providers) to get input to Evas.
 2013-06-13 15:38:03 +01:00
Tom Hacohen b606de65cc Hook on evas_new instead of elm_win_add when tracking Evas. 
This makes it more general and thus suitable for non-elm applications.
 2013-06-13 13:48:28 +01:00
Tom Hacohen b4b7e65edd Fix initialization issues (and thus some segfaults). 
Init ecore before using it, shutdown after done.
Init eet, as we need it as well.
 2013-06-13 13:47:22 +01:00
Tom Hacohen b5523094af Print an error if report file can't be opened for writing. 2013-06-12 15:15:02 +01:00
Tom Hacohen 2d5cc83ed5 Also fail if exit signal is non-zero. 
We should fail if we segfault, or exit because of another error that
ecore_exe reports a zero exit code for.
 2013-06-10 16:57:48 +01:00
Daniel Willmann f94850e84a ecore_init/shutdown: Proper refcounting for wrappers 
Signed-off-by: Daniel Willmann <d.willmann@samsung.com>
 2013-06-10 16:57:48 +01:00
Tom Hacohen ed1d015b8f Added more verbose output to test buildbot. 2013-06-10 13:44:36 +01:00
Tom Hacohen afb0cd3cd1 Added the 'wrap' parameter, to use a wrapping command around the tests. 
A good example would be valgrind.
 2013-05-21 15:35:35 +01:00
Tom Hacohen c99fdfb239 Added some verbose support (including cursor in simulation). 2013-05-17 15:47:08 +01:00
Tom Hacohen 36fe181d8e Moved recordings to exactness-data-elm. 2013-05-17 11:23:24 +01:00
Tom Hacohen 3e4c93bd83 Make the Exactness error report valid XHTML 1.0 Strict. 2013-05-15 17:20:00 +01:00
Tom Hacohen 11cc575120 Added html output for easier viewing of the errors. 2013-05-15 16:48:04 +01:00
Daniel Willmann feac36f368 Fix destdir usage for destdir != ./ 
Some more checks would be good, but this fixes basic usage for now.

Signed-off-by: Daniel Willmann <d.willmann@samsung.com>
 2013-05-09 13:59:58 +01:00
Tom Hacohen 93ed31024e Removed accidentally added printf. 2013-05-08 15:48:21 +01:00
Tom Hacohen c5860fc6e6 Fixed exactness compilation. Thanks seoz. 2013-05-08 15:43:19 +01:00
Tom Hacohen c2547c0199 Made the exactness script a C program (with improvements). 
It's now considerably faster thanks to concurrency.
It's cleaner (almost the same loc).
Better error output.
Easier to use.
 2013-05-08 11:47:59 +01:00
Tom Hacohen 6d474175e2 More clean-ups. 2013-04-30 10:35:52 +01:00
Tom Hacohen a1b35c44ac Reduced some code duplicity. 2013-04-29 18:05:49 +01:00
Tom Hacohen 2a31033738 Fixed info message. 2013-04-29 18:05:49 +01:00
Tom Hacohen c00c3aaa29 Added explanations to the flags to the help message. 
Also fixed indentation.
 2013-04-26 14:19:05 +01:00
Tom Hacohen 33df8ecb2c Get rid of the compare option, useless. 2013-04-26 14:15:41 +01:00
Tom Hacohen 381bd401f8 Get rid of the useless TSUITE_BASE_DIR env var. 2013-04-26 14:11:43 +01:00
Tom Hacohen 6873cad582 Implement VERBOSE the same way as DEBUG. 2013-04-26 14:11:31 +01:00
Tom Hacohen 50cef78346 Fixed usage of backtick that broke in a previous commit. 
commit that broke it: 802baf489f
 2013-04-26 14:10:29 +01:00
Tom Hacohen fdb791a421 Changed base dir to a sane default. 2013-04-26 13:54:39 +01:00
Tom Hacohen bf5f589310 Fixed up indentation and some general style. 2013-04-26 10:25:57 +01:00
Tom Hacohen 802baf489f Cleaned up script generation and got rid of the atrocious write.sh 2013-04-19 17:12:00 +01:00
Tom Hacohen 7b1df1a40f Fixed out of source builds. 2013-03-18 16:36:10 +00:00
Aharon Hillel eed1c5afdb exactness: Fixed warnings. 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 68338
 2012-02-23 13:59:44 +00:00
Aharon Hillel 8afb58e764 exactness: Fixed evas function in tsuite_shot_do 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 68273
 2012-02-22 13:44:12 +00:00
Aharon Hillel 52bc4e785e exactness: added -v (verbose) option 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 68272
 2012-02-22 13:44:08 +00:00
Aharon Hillel 6d68ce3439 exactness: Make it possible to run only selected tests from list file. 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67970
 2012-02-15 09:56:07 +00:00
Tom Hacohen f51a7e4835 Exactness: Removed useless bin dir. Merging that into elm_test. 
SVN revision: 67934
 2012-02-14 13:52:58 +00:00
Aharon Hillel 7a99abbbb0 exactness: Fixed test command Using eval to handle test-names containing spaces 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67931
 2012-02-14 13:52:49 +00:00
Aharon Hillel 733147a272 exactness: removed debug message 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67930
 2012-02-14 13:52:46 +00:00
Aharon Hillel 63b9b57ec4 exactness: fixed HELP shown with exactness -h 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67929
 2012-02-14 13:52:43 +00:00
Aharon Hillel eb03cf9f84 exactness: Fixed Multuple-evas support 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67928
 2012-02-14 13:52:41 +00:00
Aharon Hillel 64137e1da6 exactness: added report of executable return code 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67927
 2012-02-14 13:52:38 +00:00
Aharon Hillel b5bfa0f8aa exactness: Changed script to work with command-file 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67926
 2012-02-14 13:52:35 +00:00
Aharon Hillel f31c5c0234 Exactness: First version of script working with env-vars 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67925
 2012-02-14 13:52:31 +00:00
Aharon Hillel 2ece837725 Exactness: Avoid allocating strings when NOT recording 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67924
 2012-02-14 13:52:28 +00:00
Aharon Hillel 9ab15c434c Exactness: Evas now is taken from elm_win_add 
Because tsuite_shot_do creates Evas and we cant use evas_new
without doing ugly hacks.

Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67923
 2012-02-14 13:52:25 +00:00
Aharon Hillel b9406b348a exactness: Cleaned tsuite_evas_hook 
TODO: Need to add support of multiple evas for messaging

Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67922
 2012-02-14 13:52:22 +00:00
Aharon Hillel 034738063c exactness: Initial version of recording lib. 
TODO: Need to refine, clean code. TODO: Later fix tests issues.

Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67921
 2012-02-14 13:52:17 +00:00
Aharon Hillel 9c25a64c18 exactness: Added hooking-stabs of ecore,evas funcs. 
TODO: need to move tsuite.c record, play functionality to those funcs.

Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67920
 2012-02-14 13:52:14 +00:00
Aharon Hillel f0ce78d98a exactness: Added support to run user-app - first commit. 
TODO: Currently it accepts apps as argument, the problem: We still fail to record or play because before recording I need to have the Evas *e pointer of the app-window to be able to inject events to window evas object. Review my attempts in tsuite.c.evas_new, tsuite_evas_hook.c.evas_new

Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 67919
 2012-02-14 13:52:10 +00:00
WooHyun Jung c22a29b392 [exactness/test_entry] Change elm_entry_text_filter_append to 
elm_entry_markup_filter_append.


SVN revision: 67750
 2012-02-08 07:53:33 +00:00
ChunEon Park e91d180b9f exactness - Elm_Genlist_Item -> Elm_Object_Item 
SVN revision: 67384
 2012-01-20 10:29:35 +00:00
ChunEon Park 24ef320096 exactness - Elm_List_Item -> Elm_Object_Item 
SVN revision: 67121
 2012-01-12 06:29:09 +00:00
Daniel Juyung Seo 5df77cb4a5 exactness: Applied recent elm toolbar API changes. elm_toolbar_mode_shrink_set -> elm_toolbar_shrink_mode_set 
SVN revision: 66942
 2012-01-06 11:49:05 +00:00
Daniel Juyung Seo 4e61501e3f exactness: Sync with recent elm. Fixed build break. 
SVN revision: 66775
 2012-01-03 05:20:38 +00:00
Martin Jansa 140e3018df replace remaining delete-request usages with delete,request which is emited by elm_win, update focus callback names in comments too 
Signed-Off-By: Martin Jansa <martin.jansa@gmail.com>



SVN revision: 66729
 2012-01-02 05:38:18 +00:00
ChunEon Park fe8c1befc5 exactness - Elm_Diskselector -> Elm_Object_Item 
SVN revision: 66678
 2011-12-30 09:07:09 +00:00
ChunEon Park 8b880869f5 exactness - Elm_Index_Item -> Elm_Object_Item 
+ indentation fix



SVN revision: 66660
 2011-12-30 05:02:03 +00:00
Aharon Hillel 87c02c6117 exactness: Changed user message. 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66392
 2011-12-20 13:41:39 +00:00
Aharon Hillel e0f368a947 exactness: removed redundent tests 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66391
 2011-12-20 13:41:36 +00:00
Aharon Hillel 1be85311bc exactness: Fixed test 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66390
 2011-12-20 13:41:34 +00:00
Aharon Hillel 0d2d5f4510 exactness: Removed redundent (NA) tests 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66388
 2011-12-20 13:41:25 +00:00
Daniel Juyung Seo 70a75738ee exactness: Applied recent elm changes. 
SVN revision: 66380
 2011-12-20 09:37:52 +00:00
Aharon Hillel 17815fa441 exactness: added simulate mode 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66378
 2011-12-20 09:12:18 +00:00
Aharon Hillel 17db9e1237 exactness: Fixed total-tests count 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66376
 2011-12-20 09:09:05 +00:00
Aharon Hillel 164f920c36 exactness: Fixed test errors. TODO: still need to fix two errors in test_index.c, result of API state 3 Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com> 
SVN revision: 66375
 2011-12-20 09:08:53 +00:00
Aharon Hillel 5e172d447b exactness: Added EAPI for funcs 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66373
 2011-12-20 09:05:40 +00:00
Aharon Hillel 979d50831d exactness: Added message notifying about rec file error 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66371
 2011-12-20 08:58:02 +00:00
Aharon Hillel 21b1c61796 exactness: Refined error-summery messages 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66370
 2011-12-20 08:54:49 +00:00
Aharon Hillel 111c5f2259 exactness: reteruning non-zero value on failure 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66369
 2011-12-20 08:53:38 +00:00
Aharon Hillel d4e0182e05 exactness: Automatically compare outputs when running "play". 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66313
 2011-12-18 14:12:01 +00:00
Aharon Hillel 059b2933cf exactness: removed force-flag on file removal 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66249
 2011-12-15 10:00:27 +00:00
Aharon Hillel 6b7bf9ee9f exactness: Fixed test-handling in case no REC file 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66240
 2011-12-15 09:04:38 +00:00
Aharon Hillel 4cf2e20323 exactness: fixed file-removal to be more safe 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66239
 2011-12-15 09:04:34 +00:00
Aharon Hillel 85ffe5ac15 exactness: Added BaseDir arg,using GETOPT to process command line 1. Added BaseDir argument [-b BaseDir] to tell exactness where to find rec 2. tsuite.c now using ecore getopt to process command line args 
Signed-off-by: Aharon Hillel <aharon@aharon-linux-sm.(none)>

SVN revision: 66117
 2011-12-12 13:55:05 +00:00
Aharon Hillel b771ef56bc exactness: Added basedir argument for rec. 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 66116
 2011-12-12 13:55:02 +00:00
Aharon Hillel e08558e527 exactness: fixed warnings of deprecated funcs 
Signed-off-by: Aharon Hillel <a.hillel@partner.samsung.com>

SVN revision: 65984
 2011-12-07 09:23:56 +00:00
Daniel Juyung Seo 897589476e exactness: Fixed build break with latest elementary. 
(elm_list_item_toolip_xxx)


SVN revision: 65979
 2011-12-07 00:06:52 +00:00