opencv/modules/dnn
Yuantao Feng 4d918ba40b
Merge pull request #23047 from fengyuentau:layer_norm
dnn: add layer normalization for vision transformers

* add layer norm onnx parser, impl and tests

* add onnx graph simplifier for layer norm expanded

* handle the case when constants are of type Initializer

* add test case for layer norm expanded with initializers

* use CV_Assert & CV_CheckType in place of CV_Assert_N; use forward_fallback for OCL_FP16

* use const ref / ref in parameters of invoker::run; extract inner const if from nested loop; use size_t in place of ull

* template hasBias

* remove trailing whitespace

* use pointer parameter with null check; move normSize division & mean_square division outside of loop; use std::max to ensure positive value before std::sqrt

* refactor implementation, optimize parallel_for

* disable layer norm expanded

* remove the removal of layer norm optional outputs
2023-01-27 16:35:59 +03:00
..
cmake dnn: plugin support for OpenVINO 2022-10-07 16:57:31 +00:00
include/opencv2 Merge pull request #23047 from fengyuentau:layer_norm 2023-01-27 16:35:59 +03:00
misc dnn: plugin support for OpenVINO 2022-10-07 16:57:31 +00:00
perf Merge pull request #23047 from fengyuentau:layer_norm 2023-01-27 16:35:59 +03:00
src Merge pull request #23047 from fengyuentau:layer_norm 2023-01-27 16:35:59 +03:00
test Merge pull request #23047 from fengyuentau:layer_norm 2023-01-27 16:35:59 +03:00
CMakeLists.txt dnn: add the CANN backend (#22634) 2022-12-21 09:04:41 +03:00