Roman Donchenko
e65eb4e042
Updated Google Test to 1.7.0.
2013-10-02 14:41:00 +04:00
Andrey Pavlenko
75d89f4331
Merge pull request #1533 from alalek:perf_test_update_relative_error_message
2013-10-01 20:17:52 +04:00
Alexander Alekhin
66e4aead97
perf tests: added SANITY_CHECK_NOTHING()
2013-10-01 16:49:11 +04:00
Alexander Alekhin
958604a68e
perf test: update error message about relative error
2013-09-30 20:11:39 +04:00
Roman Donchenko
e9a28f66ee
Normalized file endings.
2013-08-21 18:59:25 +04:00
Vladislav Vinogradov
2899d558ac
record cuda gpu name to output report
2013-08-21 10:12:44 +04:00
Vladislav Vinogradov
b7ec673001
added cvconfig.h header, because ts_perf.cpp uses HAVE_CUDA macros
2013-08-21 10:00:40 +04:00
Roman Donchenko
dc06d47f1c
Merge pull request #1241 from SpecLad:redundant-precomps
2013-08-12 17:19:53 +04:00
Roman Donchenko
167abf0dae
Merge pull request #1244 from vkocheganov:bugfix_3179
2013-08-09 11:49:27 +04:00
kocheganovvm
e4b201be25
Fix unsequenced modifications (Bug #3179 ).
2013-08-08 18:55:47 +04:00
Roman Donchenko
d9f71b762f
Deleted almost all of the precomp.cpp files.
...
Looks like we don't actually use them; when creating precompiled headers
with Visual C++, a dummy .cpp is created at build time.
2013-08-08 12:43:07 +04:00
Roman Donchenko
e23f31311d
xls-report.py: separated image width and height for easier analysis.
2013-08-07 13:43:03 +04:00
Roman Donchenko
131458847b
Make ts always static.
...
This allows us to forget about the GTEST_(CREATE|LINKED_AS)_SHARED_LIBRARY
macros and to get rid of the dependency on cvconfig.h.
2013-08-06 17:56:25 +04:00
Alexander Smorkalov
63786c389f
Warning and review notes fixes.
...
WITH_WINRT -> ENABLE_WINRT_MODE;
Some temporary char* replaced with Ptr<char>;
Build fix for regular WIN32;
Windows Platform SDK and MSVC search added to cmake;
Warinig fixes.
2013-08-02 04:10:56 -07:00
Andrey Pavlenko
f7ce70f70a
Merge pull request #1110 from SpecLad:config-cleanup
2013-07-30 17:39:35 +04:00
Roman Donchenko
1432f3a82c
Fix xls-report.py not working with more than one comparison.
2013-07-22 12:48:43 +04:00
Vladislav Vinogradov
f87ef77269
removed GPU_/CPU_ prefix from gpu's sanity test
2013-07-18 13:41:27 +04:00
Roman Donchenko
ac39bfb4cc
Remove HAVE_CVCONFIG_H - it's always defined.
2013-07-10 16:02:07 +04:00
Roman Donchenko
ea3239a00e
xls-report.py: Added an option to show per-pixel times
2013-07-10 14:58:51 +04:00
Roman Donchenko
5b2dc26f2c
Made the crude ability less crude.
2013-07-10 14:58:51 +04:00
Roman Donchenko
215b3e749f
Added to the test log parser a crude ability to detect non-implemented tests.
2013-07-10 14:58:51 +04:00
Roman Donchenko
1080c4295a
xls-report.py: removed image size and type from the list of other parameters.
...
Also, shrunk the corresponding column and the test name column.
2013-07-10 14:58:18 +04:00
Roman Donchenko
63d151a29c
xls-report.py: add ability to specify arbitrary sheet properties
2013-07-10 14:58:17 +04:00
Roman Donchenko
2b44172026
xls-report.py: make behaviour more intelligent in case of repeated results
2013-07-04 20:01:27 +04:00
Roman Donchenko
0732905cff
xls-report.py: write tests in sorted order
2013-07-04 20:01:27 +04:00
Roman Donchenko
ea054e2888
xls-report.py: made most columns a little wider
2013-07-04 20:01:27 +04:00
Roman Donchenko
4e939e2fce
xls-report.py: added an option to include data from unrecognized XMLs
2013-07-04 20:00:59 +04:00
Roman Donchenko
83fd385bbd
xls-report.py: don't eat all errors when reading sheet.conf
2013-07-04 18:03:03 +04:00
Roman Donchenko
664b720e4d
Extended Google Test to allow filtering by parameter value.
2013-06-27 13:14:37 +04:00
Roman Donchenko
1cfe5aa41e
Merge pull request #1048 from SpecLad:xls-conf
2013-06-26 16:53:50 +04:00
Roman Donchenko
f8e187e1e1
Merge pull request #1035 from SpecLad:cv-concurrency
2013-06-25 11:33:16 +04:00
Roman Donchenko
c244f000ab
Merge pull request #1030 from SpecLad:ts-impl-variants
2013-06-24 18:28:13 +04:00
Roman Donchenko
c16316c4b4
Replaced the semi-public CV_PARALLEL_FRAMEWORK macro with a function.
...
That way, core/internal.hpp doesn't have to depend on cvconfig.h, which we
don't ship.
2013-06-24 12:57:14 +04:00
Roman Donchenko
5fa200763f
Merge pull request #1026 from SpecLad:ts-version-prop
2013-06-21 18:00:59 +04:00
Roman Donchenko
d4a8b87645
Wrote relevant docs.
2013-06-21 16:45:17 +04:00
Roman Donchenko
0e3a9eaf98
Made Collector render property sets as dicts instead of tuples of pairs.
2013-06-21 13:43:16 +04:00
Roman Donchenko
2688e22cb5
Made xls-report.py use global properties in XML files.
...
Now it can determine, without looking at the file name, both the module
name and the configuration name (the latter with a little help from the
configuration file).
2013-06-20 19:57:45 +04:00
Roman Donchenko
57317c3196
Use log formatting as intended.
2013-06-20 19:39:02 +04:00
Roman Donchenko
3ea4836a0a
Changed the impls argument to be an array name.
...
Turns out, you can't use preprocessor directives inside macro arguments.
Who'd have thought?
2013-06-20 15:18:35 +04:00
Roman Donchenko
3e2c456313
A few minor improvements to the XLS report generator.
...
* In comparison column headers, switched the order of labels, so that
it's "to" vs "from".
* When a test was present, but not run successfully, put its status in
the corresponding cell instead of coloring it gray.
2013-06-20 14:38:01 +04:00
Roman Donchenko
7a104d2793
Added an option to print available implementation variants.
2013-06-19 18:47:15 +04:00
Roman Donchenko
b581f27249
Made perf tests record module name, selected implementation and number of threads.
2013-06-19 17:55:42 +04:00
Roman Donchenko
936236e4b1
Extended the CPU/GPU selection mechanism in performance tests.
...
Now it allows choosing between arbitrary implementation variants.
2013-06-19 17:55:42 +04:00
Roman Donchenko
d58421c08e
Make version-related test properties more useful.
...
Namely, normalize their names to a common convention and remove useless text
from their values.
2013-06-19 14:45:03 +04:00
Roman Donchenko
fa158304fe
Merge pull request #1016 from SpecLad:xls-report
2013-06-19 12:24:34 +04:00
Roman Donchenko
4af7d65224
Made tests record information about CPU features and Tegra optimization status.
2013-06-18 18:26:53 +04:00
Roman Donchenko
24d84a45b1
Made tests record in the XML output which parallel framework was used.
2013-06-18 18:26:53 +04:00
Roman Donchenko
584f0745d0
Made xls-report.py ignore tests that were not successful.
2013-06-18 13:41:41 +04:00
Roman Donchenko
0f1156bbb6
Made the order of tests in XLS reports deterministic.
2013-06-18 13:37:40 +04:00
Roman Donchenko
4d7b1b5ede
In the XLS report, enabled word wrapping for header cells.
...
Otherwise, Excel ignores line breaks in them.
2013-06-18 12:31:43 +04:00
Roman Donchenko
6ff207b53a
Added a new and improved version of the XLS report generator.
2013-06-18 12:31:43 +04:00
Roman Donchenko
f003e29dc0
Updated testlog_parser.py to the latest version from the private repo.
2013-06-18 12:31:43 +04:00
Andrey Pavlenko
4af104aaae
'aapt' tool moved in SDK r22, adding support to run.py
2013-05-19 14:57:21 +04:00
Andrey Pavlenko
d5881bc00a
adding version info to test log
2013-05-12 18:36:55 +04:00
Andrey Kamaev
96b008cd29
Eliminate the need of ::testsing::ValuesIn() for CV_ENUM
...
Also cv::, cv::gpu:: and cv::ocl:: namespace prefixes can be safely omitted
inside CV_ENUM and CV_FLAGS
2013-04-15 19:39:49 +04:00
Andrey Kamaev
802d004bbb
Fix build issues
2013-04-13 16:53:59 +04:00
Andrey Kamaev
9deea80b83
Update gtest to upstream r652
...
It is already marked as a gtest 1.7.0
2013-04-13 16:29:05 +04:00
Roman Donchenko
57d4c86b2b
Fixed the shebang lines on the Python scripts.
...
Also, removed the one from modules/python/src2/cv.py and cleared its
executable bit, since it's not a script.
2013-04-11 18:37:23 +04:00
Vladislav Vinogradov
f0b19d4659
updated license header in whole gpu module
2013-03-22 14:03:15 +04:00
Vladislav Vinogradov
3b065e38be
fixed warnings
2013-03-18 14:06:29 +04:00
Vladislav Vinogradov
abc9ef6809
moved utility functions from gpu_perf_test and gpu_test to ts module
2013-03-18 14:06:19 +04:00
Andrey Kamaev
a5d2253be8
Merge pull request #544 from AnnaKogan8:added-regressions-only-option
2013-02-28 00:38:47 +04:00
Andrey Kamaev
4d2c864bea
Add option --with-score to summary.py to automatically classify speedups
...
Legend for new column is:
* FASTER - strong speedup
* faster - spedup is detected but it is unreliable
* <empty> - no change in speed
* slower - slowdown is detected but it is unreliable
* SLOWER - strong slowdown
2013-02-26 19:42:51 +04:00
Anna Kogan
a9b1c5db78
Added --regressions-only=X-FACTOR option
2013-02-26 11:09:17 +04:00
Alexander Smorkalov
e21a1d3124
Test system refactoring
...
cmpEps replaced on cmpEps2 to reduce code dublication;
Constants for cmpEps return values added.
2013-02-21 12:07:04 +04:00
Andrey Kamaev
2a98c1f89c
Merge pull request #446 from AnnaKogan8:updated-perf-timing-script
2013-02-11 14:02:39 +04:00
Alexey Spizhevoy
e0ead7b606
fixed assertion failure (vector out of range) for the 'vc10,debug' build ( #2775 )
2013-02-08 17:44:57 +04:00
Anna Kogan
51e58aeb25
Added --failed-only option and multiple input files support
2013-02-07 19:08:31 +04:00
Andrey Kamaev
4f1913ed26
Correct tolerance value for sanity checks with ERROR_RELATIVE
...
Use min/max bounds instead of local value to calculate acceptance threshold.
Threshold based on local values somethimes does not work because cancellation
of big values may produce error bigger than local value.
2013-01-31 15:47:14 +04:00
Andrey Kamaev
e79e81c6cd
Fix Windows build warnings
2013-01-30 13:24:49 +04:00
cuda-geek
11dfceb2c9
Merge pull request #328 from jet47:new-gpu-fixes
2013-01-29 11:00:37 +04:00
Ivan Korolev
6385b0f7ed
Fixed a formula to calculate the relative error
2013-01-25 11:19:38 +04:00
Andrey Kamaev
3c4cfccc88
Merge pull request #321 from apavlenko:warp_sanity_check
2013-01-24 13:05:54 +04:00
Vladislav Vinogradov
b7e6b5af1b
fixed tests (call resetDevice, if there was a gpu failure)
2013-01-23 21:05:04 +04:00
Andrey Kamaev
0773ab4d07
Merge pull request #315 from taka-no-me:java_on
2013-01-23 19:02:27 +04:00
Andrey Pavlenko
e287dea91b
fixing build warnings
2013-01-23 18:45:06 +04:00
Andrey Kamaev
3889b34ec3
Add option to run java tests with run.py
2013-01-23 18:08:08 +04:00
Andrey Pavlenko
81721d0dce
enabling sanity checks for warp and resize functions on Android
...
- add syntetic images generation function to ts
- use generated syntetic images
2013-01-23 17:25:30 +04:00
Anna Kogan
0587bef667
Switched time from seconds to minutes
2013-01-15 15:32:22 +04:00
Anna Kogan
3cdfa654ae
Added 'Num of tests' col, changed headers, added 'overall time' row
2013-01-15 15:26:43 +04:00
Anna Kogan
3271e395c8
Improved console output
2013-01-10 13:19:59 +04:00
Anna Kogan
0d7ce141aa
Cleaned code
2013-01-10 13:18:26 +04:00
Anna Kogan
0334cf11cc
Fixed last testsuit disregarding
2013-01-10 13:16:46 +04:00
Andrey Kamaev
02d1e68c64
Merge pull request #257 from AnnaKogan8:perf-tests-timing-script
2012-12-24 19:38:49 +04:00
Anna Kogan
f57d692cd7
Improved code
2012-12-24 17:09:04 +04:00
Anna Kogan
e1331b44f5
Wrote script generating timing table
2012-12-24 17:09:04 +04:00
Andrey Kamaev
9944282b09
Fix build with STLPort from NDK r8d
2012-12-22 00:59:56 +04:00
Andrey Kamaev
b6efec5f8b
Add support for Android NDK r8d
2012-12-21 15:39:23 +04:00
Andrey Kamaev
80a1d569ca
Add support for multidimentional matrices into the sanity checks
2012-12-15 20:15:34 +04:00
Andrey Kamaev
817a4c0c30
Merge branch 2.4 into perf_verify_sanity
2012-12-12 20:14:25 +04:00
Andrey Kamaev
e1afb1409f
Add --perf_verify_sanity option to performance tests
...
This option provides an easy way to identify tests having no regression data
for sanity checks
2012-12-12 19:42:24 +04:00
Andrey Kamaev
6e244c83cd
Corrected sanity checks in several perf tests
...
Also fixed a typo in performance testing framework and removed hardcoded
temporary file name from highgui perf test
2012-12-12 01:00:47 +04:00
Andrey Kamaev
7c6191ec11
Refactored run.py script and temporary file generation logic
...
* use OPENCV_TEMP_PATH environment variable on all platforms
* fix cleanup after OpenCV tests on Windows
* add --list flag to output names of all tests found
* do not override user-passed --perf_min_samples and --perf_force_samples
options by --check flag
* fix complier checks inside run.py
2012-12-08 15:43:23 +04:00
Andrey Kamaev
b0d3830399
Update gtest to upstream r629
2012-12-05 03:02:37 +04:00
Andrey Kamaev
157cdeb443
Merge pull request #175 from taka-no-me:run_py
2012-11-28 12:44:05 +04:00
Andrey Kamaev
8daebeac8a
run.py: add --check option for easy run of sanity checks
2012-11-24 14:12:32 +04:00
Andrey Kamaev
9db1d9ba13
run.py: improve handling of multiple Android devices
...
* do not lose auto-selected device while running several tests
* reduce output noise
* list available devices if unable to auto-select device
* fix error message when no devices connected
2012-11-24 14:11:07 +04:00
marina.kolpakova
285d6320be
add #/usr/bin/env python to all python files
2012-11-23 22:57:22 +04:00
Andrey Kamaev
7267d518d5
Fix build in Visual Studio 2005
2012-11-01 12:42:51 +04:00
Andrey Kamaev
0072078857
Hide non-windows variable in gtest
2012-10-23 18:09:49 +04:00