create_dl_layer_activation T_create_dl_layer_activation CreateDlLayerActivation CreateDlLayerActivation create_dl_layer_activation (Operator)
create_dl_layer_activation T_create_dl_layer_activation CreateDlLayerActivation CreateDlLayerActivation create_dl_layer_activation
— Create an activation layer.
Signature
void CreateDlLayerActivation (const HTuple& DLLayerInput , const HTuple& LayerName , const HTuple& ActivationType , const HTuple& GenParamName , const HTuple& GenParamValue , HTuple* DLLayerActivation )
HDlLayer HDlLayer ::CreateDlLayerActivation (const HString& LayerName , const HString& ActivationType , const HTuple& GenParamName , const HTuple& GenParamValue ) const
HDlLayer HDlLayer ::CreateDlLayerActivation (const HString& LayerName , const HString& ActivationType , const HString& GenParamName , const HString& GenParamValue ) const
HDlLayer HDlLayer ::CreateDlLayerActivation (const char* LayerName , const char* ActivationType , const char* GenParamName , const char* GenParamValue ) const
HDlLayer HDlLayer ::CreateDlLayerActivation (const wchar_t* LayerName , const wchar_t* ActivationType , const wchar_t* GenParamName , const wchar_t* GenParamValue ) const
(
Windows only)
static void HOperatorSet .CreateDlLayerActivation (HTuple DLLayerInput , HTuple layerName , HTuple activationType , HTuple genParamName , HTuple genParamValue , out HTuple DLLayerActivation )
HDlLayer HDlLayer .CreateDlLayerActivation (string layerName , string activationType , HTuple genParamName , HTuple genParamValue )
HDlLayer HDlLayer .CreateDlLayerActivation (string layerName , string activationType , string genParamName , string genParamValue )
Description
The operator create_dl_layer_activation create_dl_layer_activation CreateDlLayerActivation CreateDlLayerActivation create_dl_layer_activation
creates an activation layer
whose handle is returned in DLLayerActivation DLLayerActivation DLLayerActivation DLLayerActivation dllayer_activation
.
The parameter DLLayerInput DLLayerInput DLLayerInput DLLayerInput dllayer_input
determines the feeding input layer and
expects the layer handle as value.
The parameter LayerName LayerName LayerName layerName layer_name
sets an individual layer name.
Note that if creating a model using create_dl_model create_dl_model CreateDlModel CreateDlModel create_dl_model
each layer of
the created network must have a unique name.
The parameter ActivationType ActivationType ActivationType activationType activation_type
sets the type of the activation.
Supported activation types are:
'relu' "relu" "relu" "relu" "relu" :
Rectified linear unit (ReLU) activation.
By setting a specific ReLU parameter, another type can be specified
instead of the standard ReLU:
Standard ReLU, defined as follows:
Bounded ReLU, defined as follows:
Setting the generic parameter 'upper_bound' "upper_bound" "upper_bound" "upper_bound" "upper_bound" will result in a
bounded ReLU and determines the value of
.
Leaky ReLU:, defined as follows:
Setting the generic parameter 'leaky_relu_alpha' "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" results in a leaky ReLU
and determines the value
.
'sigmoid' "sigmoid" "sigmoid" "sigmoid" "sigmoid" :
Sigmoid activation, which is defined as follows.
The following generic parameters GenParamName GenParamName GenParamName genParamName gen_param_name
and the corresponding
values GenParamValue GenParamValue GenParamValue genParamValue gen_param_value
are supported:
'is_inference_output' "is_inference_output" "is_inference_output" "is_inference_output" "is_inference_output" :
Determines whether apply_dl_model apply_dl_model ApplyDlModel ApplyDlModel apply_dl_model
will include the output of this
layer in the dictionary DLResultBatch DLResultBatch DLResultBatch DLResultBatch dlresult_batch
even without specifying this
layer in Outputs Outputs Outputs outputs outputs
('true' "true" "true" "true" "true" ) or not ('false' "false" "false" "false" "false" ).
Default:
'false' "false" "false" "false" "false"
'upper_bound' "upper_bound" "upper_bound" "upper_bound" "upper_bound" :
Float value defining an upper bound for a rectified linear unit.
If the activation layer is part of a model which has been created using
create_dl_model create_dl_model CreateDlModel CreateDlModel create_dl_model
, the upper bound can be unset. To do so, use
set_dl_model_layer_param set_dl_model_layer_param SetDlModelLayerParam SetDlModelLayerParam set_dl_model_layer_param
and set an empty tuple for
'upper_bound' "upper_bound" "upper_bound" "upper_bound" "upper_bound" .
Default:
[]
'leaky_relu_alpha' "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" :
Float value defining the alpha parameter of a leaky ReLU.
Restriction:
The value of 'leaky_relu_alpha' "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" must be
positive or zero.
Default:
0.0
Certain parameters of layers created using this operator
create_dl_layer_activation create_dl_layer_activation CreateDlLayerActivation CreateDlLayerActivation create_dl_layer_activation
can be set and retrieved using
further operators.
The following tables give an overview, which parameters can be set
using set_dl_model_layer_param set_dl_model_layer_param SetDlModelLayerParam SetDlModelLayerParam set_dl_model_layer_param
and which ones can be retrieved
using get_dl_model_layer_param get_dl_model_layer_param GetDlModelLayerParam GetDlModelLayerParam get_dl_model_layer_param
or get_dl_layer_param get_dl_layer_param GetDlLayerParam GetDlLayerParam get_dl_layer_param
. Note, the
operators set_dl_model_layer_param set_dl_model_layer_param SetDlModelLayerParam SetDlModelLayerParam set_dl_model_layer_param
and get_dl_model_layer_param get_dl_model_layer_param GetDlModelLayerParam GetDlModelLayerParam get_dl_model_layer_param
require a model created by create_dl_model create_dl_model CreateDlModel CreateDlModel create_dl_model
.
Generic Layer Parameters
set
get
'is_inference_output' "is_inference_output" "is_inference_output" "is_inference_output" "is_inference_output"
x
x
'leaky_relu_alpha' "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha"
x
x
'num_trainable_params' "num_trainable_params" "num_trainable_params" "num_trainable_params" "num_trainable_params"
x
'upper_bound' "upper_bound" "upper_bound" "upper_bound" "upper_bound"
x
x
Execution Information
Multithreading type: reentrant (runs in parallel with non-exclusive operators).
Multithreading scope: global (may be called from any thread).
Processed without parallelization.
Parameters
DLLayerInput DLLayerInput DLLayerInput DLLayerInput dllayer_input
(input_control) dl_layer →
HDlLayer , HTuple HHandle HTuple Htuple (handle) (IntPtr ) (HHandle ) (handle )
Feeding layer.
LayerName LayerName LayerName layerName layer_name
(input_control) string →
HTuple str HTuple Htuple (string) (string ) (HString ) (char* )
Name of the output layer.
ActivationType ActivationType ActivationType activationType activation_type
(input_control) string →
HTuple str HTuple Htuple (string) (string ) (HString ) (char* )
Activation type.
Default:
'relu'
"relu"
"relu"
"relu"
"relu"
List of values:
'relu' "relu" "relu" "relu" "relu" , 'sigmoid' "sigmoid" "sigmoid" "sigmoid" "sigmoid"
GenParamName GenParamName GenParamName genParamName gen_param_name
(input_control) attribute.name(-array) →
HTuple MaybeSequence[str] HTuple Htuple (string) (string ) (HString ) (char* )
Generic input parameter names.
Default:
[]
List of values:
'is_inference_output' "is_inference_output" "is_inference_output" "is_inference_output" "is_inference_output" , 'leaky_relu_alpha' "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" "leaky_relu_alpha" , 'upper_bound' "upper_bound" "upper_bound" "upper_bound" "upper_bound"
GenParamValue GenParamValue GenParamValue genParamValue gen_param_value
(input_control) attribute.value(-array) →
HTuple MaybeSequence[Union[int, float, str]] HTuple Htuple (string / integer / real) (string / int / long / double) (HString / Hlong / double) (char* / Hlong / double)
Generic input parameter values.
Default:
[]
Suggested values:
'true' "true" "true" "true" "true" , 'false' "false" "false" "false" "false"
DLLayerActivation DLLayerActivation DLLayerActivation DLLayerActivation dllayer_activation
(output_control) dl_layer →
HDlLayer , HTuple HHandle HTuple Htuple (handle) (IntPtr ) (HHandle ) (handle )
Activation layer.
Module
Deep Learning Professional