MyCaffe  1.12.2.41
Deep learning software for Windows C# programmers.
MyCaffe.param.tft.GateAddNormParameter Class Reference

Specifies the parameters for the GetAddNormLayer (Gate Add Norm).
More...

Inheritance diagram for MyCaffe.param.tft.GateAddNormParameter:
MyCaffe.param.LayerParameterBase MyCaffe.basecode.BaseParameter MyCaffe.basecode.IBinaryPersist

Public Member Functions

 GateAddNormParameter ()
 Constructor for the parameter. More...
 
override object Load (System.IO.BinaryReader br, bool bNewInstance=true)
 Load the parameter from a binary reader. More...
 
override void Copy (LayerParameterBase src)
 Copy on parameter to another. More...
 
override LayerParameterBase Clone ()
 Creates a new copy of this instance of the parameter. More...
 
override RawProto ToProto (string strName)
 Convert the parameter into a RawProto. More...
 
- Public Member Functions inherited from MyCaffe.param.LayerParameterBase
 LayerParameterBase ()
 Constructor for the parameter. More...
 
virtual string PrepareRunModelInputs ()
 This method gives derivative classes a chance specify model inputs required by the run model. More...
 
virtual void PrepareRunModel (LayerParameter p)
 This method gives derivative classes a chance to prepare the layer for a run-model. More...
 
void Save (BinaryWriter bw)
 Save this parameter to a binary writer. More...
 
abstract object Load (BinaryReader br, bool bNewInstance=true)
 Load the parameter from a binary reader. More...
 
- Public Member Functions inherited from MyCaffe.basecode.BaseParameter
 BaseParameter ()
 Constructor for the parameter. More...
 
virtual bool Compare (BaseParameter p)
 Compare this parameter to another parameter. More...
 

Static Public Member Functions

static GateAddNormParameter FromProto (RawProto rp)
 Parses the parameter from a RawProto. More...
 
- Static Public Member Functions inherited from MyCaffe.basecode.BaseParameter
static double ParseDouble (string strVal)
 Parse double values using the US culture if the decimal separator = '.', then using the native culture, and if then lastly trying the US culture to handle prototypes containing '.' as the separator, yet parsed in a culture that does not use '.' as a decimal. More...
 
static bool TryParse (string strVal, out double df)
 Parse double values using the US culture if the decimal separator = '.', then using the native culture, and if then lastly trying the US culture to handle prototypes containing '.' as the separator, yet parsed in a culture that does not use '.' as a decimal. More...
 
static float ParseFloat (string strVal)
 Parse float values using the US culture if the decimal separator = '.', then using the native culture, and if then lastly trying the US culture to handle prototypes containing '.' as the separator, yet parsed in a culture that does not use '.' as a decimal. More...
 
static bool TryParse (string strVal, out float f)
 Parse doufloatble values using the US culture if the decimal separator = '.', then using the native culture, and if then lastly trying the US culture to handle prototypes containing '.' as the separator, yet parsed in a culture that does not use '.' as a decimal. More...
 

Properties

int residual_channel_offset [getset]
 Specifies the residual channel offset used to copy only the latter portions of the residual (default = 0 which uses all of the residual). More...
 

Additional Inherited Members

- Public Types inherited from MyCaffe.param.LayerParameterBase
enum  LABEL_TYPE { NONE , SINGLE , MULTIPLE , ONLY_ONE }
 Defines the label type. More...
 

Detailed Description

Specifies the parameters for the GetAddNormLayer (Gate Add Norm).

The composite operation includes: a. Dropout b. Gating using GLU (Gated Linear Unit) c. A residual connection to 'earlier' signal from the forward pass of the parent model. d. Layer Normalization.

See also
Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting by Bryan Lim, Sercan O. Arik, Nicolas Loeff, and Tomas Pfister, 2019, arXiv 1912.09363
Github - PlaytikaOSS/tft-torch by Playtika Research, 2021.
Github - PlaytikaOSS/tft-torch tft.py by Playtika Research, 2021.

Definition at line 27 of file GateAddNormParameter.cs.

Constructor & Destructor Documentation

◆ GateAddNormParameter()

MyCaffe.param.tft.GateAddNormParameter.GateAddNormParameter ( )

Constructor for the parameter.

Definition at line 32 of file GateAddNormParameter.cs.

Member Function Documentation

◆ Clone()

override LayerParameterBase MyCaffe.param.tft.GateAddNormParameter.Clone ( )
virtual

Creates a new copy of this instance of the parameter.

Returns
A new instance of this parameter is returned.

Implements MyCaffe.param.LayerParameterBase.

Definition at line 67 of file GateAddNormParameter.cs.

◆ Copy()

override void MyCaffe.param.tft.GateAddNormParameter.Copy ( LayerParameterBase  src)
virtual

Copy on parameter to another.

Parameters
srcSpecifies the parameter to copy.

Implements MyCaffe.param.LayerParameterBase.

Definition at line 59 of file GateAddNormParameter.cs.

◆ FromProto()

static GateAddNormParameter MyCaffe.param.tft.GateAddNormParameter.FromProto ( RawProto  rp)
static

Parses the parameter from a RawProto.

Parameters
rpSpecifies the RawProto to parse.
Returns
A new instance of the parameter is returned.

Definition at line 93 of file GateAddNormParameter.cs.

◆ Load()

override object MyCaffe.param.tft.GateAddNormParameter.Load ( System.IO.BinaryReader  br,
bool  bNewInstance = true 
)

Load the parameter from a binary reader.

Parameters
brSpecifies the binary reader.
bNewInstanceWhen true a new instance is created (the default), otherwise the existing instance is loaded from the binary reader.
Returns
Returns an instance of the parameter.

Definition at line 47 of file GateAddNormParameter.cs.

◆ ToProto()

override RawProto MyCaffe.param.tft.GateAddNormParameter.ToProto ( string  strName)
virtual

Convert the parameter into a RawProto.

Parameters
strNameSpecifies the name to associate with the RawProto.
Returns
The new RawProto is returned.

Implements MyCaffe.basecode.BaseParameter.

Definition at line 79 of file GateAddNormParameter.cs.

Property Documentation

◆ residual_channel_offset

int MyCaffe.param.tft.GateAddNormParameter.residual_channel_offset
getset

Specifies the residual channel offset used to copy only the latter portions of the residual (default = 0 which uses all of the residual).

Definition at line 40 of file GateAddNormParameter.cs.


The documentation for this class was generated from the following file: