The RawFileData object is used to load raw NPY file data. More...

Inheritance diagram for MyCaffe.layers.tft.RawFileData< T >:

Public Member Functions
	RawFileData (uint? nSeed, bool bOutputTargetHistorical)
	The constructor. More...

void	VerifyFiles (Phase phase, string strPath)
	Verify that the data files exist. More...

override bool	LoadData (Phase phase, string strPath, bool bShuffleData, int nBatchSize, int nHistoricalSteps, int nFutureSteps, double dfPctMaxLoad, int nDripRefreshRateInSec, uint nChunkCount, Log log, CancelEvent evtCancel)
	Loads all data values for the phase specified. More...

Public Member Functions inherited from MyCaffe.layers.tft.RawData< T >
	RawData (uint? nSeed, bool bOutputTargetHistorical)
	The constructor. More...

virtual int[,]	LoadBatch (Phase phase, int nBatchSize, BlobCollection< T > col, bool bEnableDebug=false, string strDebugPath=null)
	Loads a batch of data items into the BlobCollection. More...

virtual void	Add (LossArgs e, int[,] rgIdx)
	Adds the selected indexes along with the loss data (used by the BatchPerfSet to select worst cases). More...

virtual int	GetTotalSize ()
	Returns the total size of the data. More...

virtual int[]	GetShape (DataNpy< T >.OUTPUT_TYPE ot)
	Returns the shape of a given output type. More...

Protected Member Functions
override void	loadDataFunction (object obj)
	The virtual load data function override by the derived class to load the data in the background. More...

Additional Inherited Members
Protected Attributes inherited from MyCaffe.layers.tft.RawData< T >
Data< T >	m_data
	Specifies the base data object used to store data blocks loaded from disk or database. More...

Random	m_random
	Specifies the random number generator used to shuffle the data. More...

int	m_nBatchSize
	Specifies the batch size. More...

bool	m_bOutputTargetHistorical
	Specifies to output the target historical data. More...

Properties inherited from MyCaffe.layers.tft.RawData< T >
Random	Random `[get]`
	Specifies the random number generator used. More...

Detailed Description

The RawFileData object is used to load raw NPY file data.

Template Parameters

T	Specifies the base data type of 'float' or 'double'.

Definition at line 705 of file DataTemporalLayer.cs.

Constructor & Destructor Documentation

◆ RawFileData()

MyCaffe.layers.tft.RawFileData< T >.RawFileData	(	uint?	nSeed,
		bool	bOutputTargetHistorical
	)

The constructor.

Parameters

nSeed	Specifies the random number generator seed.
bOutputTargetHistorical	Specifies to output the target historical data.

Definition at line 712 of file DataTemporalLayer.cs.

Member Function Documentation

◆ LoadData()

override bool MyCaffe.layers.tft.RawFileData< T >.LoadData	(	Phase	phase,
		string	strPath,
		bool	bShuffleData,
		int	nBatchSize,
		int	nHistoricalSteps,
		int	nFutureSteps,
		double	dfPctMaxLoad,
		int	nDripRefreshRateInSec,
		uint	nChunkCount,
		Log	log,
		CancelEvent	evtCancel
	)

virtual

Loads all data values for the phase specified.

Parameters

phase	Specifies the phase to load.
strPath	Specifies the base path for all data.
bShuffleData	Specifies to randomly select from the data.
nBatchSize	Specifies the batch size.
nHistoricalSteps	Specifies the number of historical steps.
nFutureSteps	Specifies the number of future steps.
dfPctMaxLoad	Specifies the percent of total items to load in background (default = 1, or 100%).
nDripRefreshRateInSec	Specifies the rate in seconds to refresh the data.
nChunkCount	Specifies the number of items to load on each cycle.
log	Specifies the output log.
evtCancel	Specifies the cancel event.

Reimplemented from MyCaffe.layers.tft.RawData< T >.

Definition at line 759 of file DataTemporalLayer.cs.

◆ loadDataFunction()

override void MyCaffe.layers.tft.RawFileData< T >.loadDataFunction ( object obj )

protectedvirtual

The virtual load data function override by the derived class to load the data in the background.

Parameters

obj	Specifies the user state.

Reimplemented from MyCaffe.layers.tft.RawData< T >.

Definition at line 766 of file DataTemporalLayer.cs.

◆ VerifyFiles()

void MyCaffe.layers.tft.RawFileData< T >.VerifyFiles	(	Phase	phase,
		string	strPath
	)

Verify that the data files exist.

Parameters

phase	Specifies the phase.
strPath	Specifies the file path.

Exceptions

Exception An exception is thrown if the file is missing.

Definition at line 722 of file DataTemporalLayer.cs.

The documentation for this class was generated from the following file:

C:/Data/Data/SS_Projects/Intelligence/GitHub/MyCaffe/MyCaffe.layers.tft/layers.tft/DataTemporalLayer.cs

Public Member Functions

Protected Member Functions

Additional Inherited Members

Detailed Description

Constructor & Destructor Documentation

◆ RawFileData()

Member Function Documentation

◆ LoadData()

◆ loadDataFunction()

◆ VerifyFiles()