Roman Donchenko
3e2c456313
A few minor improvements to the XLS report generator.
...
* In comparison column headers, switched the order of labels, so that
it's "to" vs "from".
* When a test was present, but not run successfully, put its status in
the corresponding cell instead of coloring it gray.
2013-06-20 14:38:01 +04:00
Roman Donchenko
7a104d2793
Added an option to print available implementation variants.
2013-06-19 18:47:15 +04:00
Roman Donchenko
b581f27249
Made perf tests record module name, selected implementation and number of threads.
2013-06-19 17:55:42 +04:00
Roman Donchenko
936236e4b1
Extended the CPU/GPU selection mechanism in performance tests.
...
Now it allows choosing between arbitrary implementation variants.
2013-06-19 17:55:42 +04:00
Roman Donchenko
d58421c08e
Make version-related test properties more useful.
...
Namely, normalize their names to a common convention and remove useless text
from their values.
2013-06-19 14:45:03 +04:00
Roman Donchenko
fa158304fe
Merge pull request #1016 from SpecLad:xls-report
2013-06-19 12:24:34 +04:00
Roman Donchenko
4af7d65224
Made tests record information about CPU features and Tegra optimization status.
2013-06-18 18:26:53 +04:00
Roman Donchenko
24d84a45b1
Made tests record in the XML output which parallel framework was used.
2013-06-18 18:26:53 +04:00
Roman Donchenko
584f0745d0
Made xls-report.py ignore tests that were not successful.
2013-06-18 13:41:41 +04:00
Roman Donchenko
0f1156bbb6
Made the order of tests in XLS reports deterministic.
2013-06-18 13:37:40 +04:00
Roman Donchenko
4d7b1b5ede
In the XLS report, enabled word wrapping for header cells.
...
Otherwise, Excel ignores line breaks in them.
2013-06-18 12:31:43 +04:00
Roman Donchenko
6ff207b53a
Added a new and improved version of the XLS report generator.
2013-06-18 12:31:43 +04:00
Roman Donchenko
f003e29dc0
Updated testlog_parser.py to the latest version from the private repo.
2013-06-18 12:31:43 +04:00
Andrey Pavlenko
4af104aaae
'aapt' tool moved in SDK r22, adding support to run.py
2013-05-19 14:57:21 +04:00
Andrey Pavlenko
d5881bc00a
adding version info to test log
2013-05-12 18:36:55 +04:00
Andrey Kamaev
96b008cd29
Eliminate the need of ::testsing::ValuesIn() for CV_ENUM
...
Also cv::, cv::gpu:: and cv::ocl:: namespace prefixes can be safely omitted
inside CV_ENUM and CV_FLAGS
2013-04-15 19:39:49 +04:00
Andrey Kamaev
802d004bbb
Fix build issues
2013-04-13 16:53:59 +04:00
Andrey Kamaev
9deea80b83
Update gtest to upstream r652
...
It is already marked as a gtest 1.7.0
2013-04-13 16:29:05 +04:00
Roman Donchenko
57d4c86b2b
Fixed the shebang lines on the Python scripts.
...
Also, removed the one from modules/python/src2/cv.py and cleared its
executable bit, since it's not a script.
2013-04-11 18:37:23 +04:00
Vladislav Vinogradov
f0b19d4659
updated license header in whole gpu module
2013-03-22 14:03:15 +04:00
Vladislav Vinogradov
3b065e38be
fixed warnings
2013-03-18 14:06:29 +04:00
Vladislav Vinogradov
abc9ef6809
moved utility functions from gpu_perf_test and gpu_test to ts module
2013-03-18 14:06:19 +04:00
Andrey Kamaev
a5d2253be8
Merge pull request #544 from AnnaKogan8:added-regressions-only-option
2013-02-28 00:38:47 +04:00
Andrey Kamaev
4d2c864bea
Add option --with-score to summary.py to automatically classify speedups
...
Legend for new column is:
* FASTER - strong speedup
* faster - spedup is detected but it is unreliable
* <empty> - no change in speed
* slower - slowdown is detected but it is unreliable
* SLOWER - strong slowdown
2013-02-26 19:42:51 +04:00
Anna Kogan
a9b1c5db78
Added --regressions-only=X-FACTOR option
2013-02-26 11:09:17 +04:00
Alexander Smorkalov
e21a1d3124
Test system refactoring
...
cmpEps replaced on cmpEps2 to reduce code dublication;
Constants for cmpEps return values added.
2013-02-21 12:07:04 +04:00
Andrey Kamaev
2a98c1f89c
Merge pull request #446 from AnnaKogan8:updated-perf-timing-script
2013-02-11 14:02:39 +04:00
Alexey Spizhevoy
e0ead7b606
fixed assertion failure (vector out of range) for the 'vc10,debug' build ( #2775 )
2013-02-08 17:44:57 +04:00
Anna Kogan
51e58aeb25
Added --failed-only option and multiple input files support
2013-02-07 19:08:31 +04:00
Andrey Kamaev
4f1913ed26
Correct tolerance value for sanity checks with ERROR_RELATIVE
...
Use min/max bounds instead of local value to calculate acceptance threshold.
Threshold based on local values somethimes does not work because cancellation
of big values may produce error bigger than local value.
2013-01-31 15:47:14 +04:00
Andrey Kamaev
e79e81c6cd
Fix Windows build warnings
2013-01-30 13:24:49 +04:00
cuda-geek
11dfceb2c9
Merge pull request #328 from jet47:new-gpu-fixes
2013-01-29 11:00:37 +04:00
Ivan Korolev
6385b0f7ed
Fixed a formula to calculate the relative error
2013-01-25 11:19:38 +04:00
Andrey Kamaev
3c4cfccc88
Merge pull request #321 from apavlenko:warp_sanity_check
2013-01-24 13:05:54 +04:00
Vladislav Vinogradov
b7e6b5af1b
fixed tests (call resetDevice, if there was a gpu failure)
2013-01-23 21:05:04 +04:00
Andrey Kamaev
0773ab4d07
Merge pull request #315 from taka-no-me:java_on
2013-01-23 19:02:27 +04:00
Andrey Pavlenko
e287dea91b
fixing build warnings
2013-01-23 18:45:06 +04:00
Andrey Kamaev
3889b34ec3
Add option to run java tests with run.py
2013-01-23 18:08:08 +04:00
Andrey Pavlenko
81721d0dce
enabling sanity checks for warp and resize functions on Android
...
- add syntetic images generation function to ts
- use generated syntetic images
2013-01-23 17:25:30 +04:00
Anna Kogan
0587bef667
Switched time from seconds to minutes
2013-01-15 15:32:22 +04:00
Anna Kogan
3cdfa654ae
Added 'Num of tests' col, changed headers, added 'overall time' row
2013-01-15 15:26:43 +04:00
Anna Kogan
3271e395c8
Improved console output
2013-01-10 13:19:59 +04:00
Anna Kogan
0d7ce141aa
Cleaned code
2013-01-10 13:18:26 +04:00
Anna Kogan
0334cf11cc
Fixed last testsuit disregarding
2013-01-10 13:16:46 +04:00
Andrey Kamaev
02d1e68c64
Merge pull request #257 from AnnaKogan8:perf-tests-timing-script
2012-12-24 19:38:49 +04:00
Anna Kogan
f57d692cd7
Improved code
2012-12-24 17:09:04 +04:00
Anna Kogan
e1331b44f5
Wrote script generating timing table
2012-12-24 17:09:04 +04:00
Andrey Kamaev
9944282b09
Fix build with STLPort from NDK r8d
2012-12-22 00:59:56 +04:00
Andrey Kamaev
b6efec5f8b
Add support for Android NDK r8d
2012-12-21 15:39:23 +04:00
Andrey Kamaev
80a1d569ca
Add support for multidimentional matrices into the sanity checks
2012-12-15 20:15:34 +04:00
Andrey Kamaev
817a4c0c30
Merge branch 2.4 into perf_verify_sanity
2012-12-12 20:14:25 +04:00
Andrey Kamaev
e1afb1409f
Add --perf_verify_sanity option to performance tests
...
This option provides an easy way to identify tests having no regression data
for sanity checks
2012-12-12 19:42:24 +04:00
Andrey Kamaev
6e244c83cd
Corrected sanity checks in several perf tests
...
Also fixed a typo in performance testing framework and removed hardcoded
temporary file name from highgui perf test
2012-12-12 01:00:47 +04:00
Andrey Kamaev
7c6191ec11
Refactored run.py script and temporary file generation logic
...
* use OPENCV_TEMP_PATH environment variable on all platforms
* fix cleanup after OpenCV tests on Windows
* add --list flag to output names of all tests found
* do not override user-passed --perf_min_samples and --perf_force_samples
options by --check flag
* fix complier checks inside run.py
2012-12-08 15:43:23 +04:00
Andrey Kamaev
b0d3830399
Update gtest to upstream r629
2012-12-05 03:02:37 +04:00
Andrey Kamaev
157cdeb443
Merge pull request #175 from taka-no-me:run_py
2012-11-28 12:44:05 +04:00
Andrey Kamaev
8daebeac8a
run.py: add --check option for easy run of sanity checks
2012-11-24 14:12:32 +04:00
Andrey Kamaev
9db1d9ba13
run.py: improve handling of multiple Android devices
...
* do not lose auto-selected device while running several tests
* reduce output noise
* list available devices if unable to auto-select device
* fix error message when no devices connected
2012-11-24 14:11:07 +04:00
marina.kolpakova
285d6320be
add #/usr/bin/env python to all python files
2012-11-23 22:57:22 +04:00
Andrey Kamaev
7267d518d5
Fix build in Visual Studio 2005
2012-11-01 12:42:51 +04:00
Andrey Kamaev
0072078857
Hide non-windows variable in gtest
2012-10-23 18:09:49 +04:00
Andrey Kamaev
c13eb07d47
Fix argument parsing for old command line parser
2012-10-23 12:07:01 +04:00
OpenCV Buildbot
04384a71e4
Normalize line endings and whitespace
2012-10-17 15:32:23 +04:00
Andrey Kamaev
d566c6bc86
Revert "add new version of CommandLineParser. add empty docs"
...
This reverts commit 54a202b3d5
.
Conflicts:
modules/core/doc/command_line_parser.rst
modules/core/include/opencv2/core/core.hpp
modules/core/src/cmdparser.cpp
modules/gpu/perf/main.cpp
modules/gpu/test/main.cpp
modules/ts/src/ts_perf.cpp
2012-10-15 20:01:44 +04:00
Andrey Kamaev
52e490ef88
Revert "fixed compile error under linux"
...
This reverts commit e2d9fc4dcc
.
2012-10-15 20:01:44 +04:00
Andrey Kamaev
3ffe0f0117
Remove unused tbb::task_scheduler_init from perf tests
2012-10-15 16:25:06 +04:00
Andrey Kamaev
c3881ede62
Refactor thread management in performance tests
2012-10-15 16:14:11 +04:00
Kirill Kornyakov
84176fa027
Added perf test for warpPerpsective with large resolutions
2012-10-12 17:14:23 +04:00
marina.kolpakova
800cb9d0e6
allow gpu module write sanity data for GPU and CPU tests in one xml
2012-10-12 14:46:18 +04:00
Andrey Kamaev
a3a658c034
Quiet MSVC warning
2012-10-12 12:19:34 +04:00
Andrey Kamaev
97640847c5
Add methods to sort keypoints and corresponding descriptors
2012-10-11 18:25:45 +04:00
Andrey Kamaev
18295bc778
Improve performance tests failures formatting
2012-10-11 17:41:02 +04:00
Andrey Kamaev
423837ddae
Restore theRNG seed reset on test SetUp as it is still needed
2012-10-10 18:07:03 +04:00
Oleg Sklyarov
3f61b9792b
fixed bug #2407 : run.py now understands android device names with spaces
2012-10-10 16:59:00 +04:00
marina.kolpakova
b28acfc12e
add GPU module specific command line arguments
2012-10-10 16:13:25 +04:00
marina.kolpakova
f88be98ec4
print information message about target device for GPU module tests
2012-10-10 16:13:25 +04:00
marina.kolpakova
f5d6367ea1
GPU module performance tests are aligned with other OpenCV pefrofmance tests
2012-10-10 16:13:24 +04:00
Andrey Kamaev
39d6eb7312
Add sanity check support for vector<DMatch>
2012-10-09 19:17:58 +04:00
Andrey Kamaev
95b6a103b5
Add sanity checks support for vertor<KeyPoint>
2012-10-09 18:41:26 +04:00
Andrey Kamaev
5a5c477be6
Make performance tests for solvePnPRansec more determenistic
2012-10-09 18:41:26 +04:00
Andrey Kamaev
e2ff0ed1fb
Add sanity checks to objdetect module perf tests
2012-10-09 15:28:51 +04:00
Andrey Kamaev
c146c54bcd
Fix sanity checks for empty objects
2012-10-09 15:28:51 +04:00
Andrey Kamaev
a3ab6d147d
Fix CV_ENUM macro instability
2012-10-08 21:37:58 +04:00
Andrey Kamaev
6151a6ea0b
Make SANITY_CHECK required for all performance tests
2012-10-08 17:17:42 +04:00
marina.kolpakova
23699acca0
fix for bug 2264
...
fix compilation OpenCV with cxx11 under Ubuntu with clang and gcc 4.7
2012-10-08 02:37:22 +04:00
Kirill Kornyakov
494ae1562d
Added 240p resolution alias for perf tests
2012-09-24 15:44:11 +04:00
Oleg Sklyarov
bbe418427e
Added WQHD = 1444p frame size
2012-09-18 18:02:29 +04:00
Andrey Morozov
e2d9fc4dcc
fixed compile error under linux
2012-09-07 18:01:06 +04:00
AoD314
54a202b3d5
add new version of CommandLineParser. add empty docs
2012-09-07 13:24:48 +04:00
Andrey Kamaev
b8adc04545
Fix Android build warnings
2012-09-06 18:54:38 +04:00
Andrey Kamaev
3d9018f019
Fix run.py version control detection when used outide of OpenCV build
2012-08-29 19:17:18 +04:00
Vadim Pisarevsky
0bd68a70f1
fixed #2297 , #2300 ; fixed several warnings
2012-08-28 13:45:35 +04:00
Andrey Kamaev
a840d929ac
#2170 fix warning of undefined GTEST_HAS_DEATH_TEST
2012-08-21 18:59:51 +04:00
Vladislav Vinogradov
81d6400f45
fixed compilation under windows
2012-08-21 14:28:40 +04:00
Daniil Osokin
e37b9469da
Added perf tests
2012-08-10 17:17:09 +04:00
Andrey Kamaev
a3527fc4d8
Add git support to run.py
2012-08-07 14:30:36 +04:00
Andrey Kamaev
50d13ba5c4
Fixed xml name generation in run.py
2012-08-06 19:10:55 +04:00
Andrey Kamaev
cfc593eb0d
Fixed run.py bugs
2012-07-02 21:07:32 +00:00
Andrey Kamaev
565a8dc30d
Fixed automatic temporary files cleaning with run.py on Windows
2012-07-02 12:23:57 +00:00
Andrey Kamaev
d9c74f63e1
All tests writing temporary files are updated to use cv::tempfile() function
2012-06-25 11:24:06 +00:00