mirror of
https://github.com/opencv/opencv.git
synced 2024-12-04 16:59:12 +08:00
c7ec0d599a
OpenVINO backend for INT8 models #23987 ### Pull Request Readiness Checklist TODO: - [x] DetectionOutput layer (https://github.com/opencv/opencv/pull/24069) - [x] Less FP32 fallbacks (i.e. Sigmoid, eltwise sum) - [x] Accuracy, performance tests (https://github.com/opencv/opencv/pull/24039) - [x] Single layer tests (convolution) - [x] ~~Fixes for OpenVINO 2022.1 (https://pullrequest.opencv.org/buildbot/builders/precommit_custom_linux/builds/100334)~~ Performace results for object detection model `coco_efficientdet_lite0_v1_1.0_quant_2021_09_06.tflite`: | backend | performance (median time) | |---|---| | OpenCV | 77.42ms | | OpenVINO 2023.0 | 10.90ms | CPU: `11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz` Serialized model per-layer stats (note that Convolution should use `*_I8` primitives if they are quantized correctly): https://gist.github.com/dkurt/7772bbf1907035441bb5454f19f0feef --- See details at https://github.com/opencv/opencv/wiki/How_to_contribute#making-a-good-pull-request - [x] I agree to contribute to the project under Apache 2 License. - [x] To the best of my knowledge, the proposed patch is not based on a code under GPL or another license that is incompatible with OpenCV - [x] The PR is proposed to the proper branch - [x] There is a reference to the original bug report and related work - [x] There is accuracy test, performance test and test data in opencv_extra repository, if applicable Patch to opencv_extra has the same branch name. - [x] The feature is well documented and sample code can be built with the project CMake |
||
|---|---|---|
| .. | ||
| cityscapes_semsegm_test_enet.py | ||
| imagenet_cls_test_alexnet.py | ||
| imagenet_cls_test_googlenet.py | ||
| imagenet_cls_test_inception.py | ||
| npy_blob.cpp | ||
| npy_blob.hpp | ||
| pascal_semsegm_test_fcn.py | ||
| test_backends.cpp | ||
| test_caffe_importer.cpp | ||
| test_common.cpp | ||
| test_common.hpp | ||
| test_common.impl.hpp | ||
| test_darknet_importer.cpp | ||
| test_googlenet.cpp | ||
| test_ie_models.cpp | ||
| test_int8_layers.cpp | ||
| test_layers.cpp | ||
| test_main.cpp | ||
| test_misc.cpp | ||
| test_model.cpp | ||
| test_nms.cpp | ||
| test_onnx_conformance_layer_filter__cuda_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter__halide_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter__openvino.inl.hpp | ||
| test_onnx_conformance_layer_filter__vulkan_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter_opencv_all_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter_opencv_cpu_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter_opencv_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter_opencv_ocl_fp16_denylist.inl.hpp | ||
| test_onnx_conformance_layer_filter_opencv_ocl_fp32_denylist.inl.hpp | ||
| test_onnx_conformance_layer_parser_denylist.inl.hpp | ||
| test_onnx_conformance.cpp | ||
| test_onnx_importer.cpp | ||
| test_precomp.hpp | ||
| test_tf_importer.cpp | ||
| test_tflite_importer.cpp | ||
| test_torch_importer.cpp | ||