edu.unh.sdb.datasource

Class DynamicChunking

java.lang.Object

edu.unh.sdb.datasource.DataCollection

edu.unh.sdb.datasource.DataSource

edu.unh.sdb.datasource.DynamicChunking

All Implemented Interfaces:

Indexable

public class DynamicChunking
extends DataSource

Abstract class for a dynamic chunking data source that provides methods that either read data from memory if the block that contained it is loaded, or loads the block, eventually discards an already loaded block in LRU fashion and then returns the data from the loaded block. Each time a block is accessed, it it moved at the begining of the LRU list.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	DynamicChunking.BlockAccessCallback
class	DynamicChunking.CacheThrashingError

Field Summary

Fields inherited from class edu.unh.sdb.datasource.DataSource

fdlDescriptor, isActivated, name, wsName

Fields inherited from class edu.unh.sdb.datasource.DataCollection

attributeOrder, axisOrdering, axisWeights, bounds, dataOrder, dimensionality, numAttributes, pointOrder, recordDesc

Constructor Summary

Constructors

Constructor and Description
DynamicChunking(DataSource dataSource) Creates a DynamicChunking object which views a 'dataSource' through a DynamicChunking memory manager and it has the same interface as a DataSource.

Method Summary

Methods

Modifier and Type	Method and Description
void	activate() Activates the cache for the given memory and block size.
void	datum(Datum datum, IndexSpaceID dataId) Given an IndexSpaceID, copy the values of the Datum at that position to the argument Datum.
void	datum(Datum dtm, IndexSpaceID did, FieldIDMapper mp) not implemented
void	deactivate() Dealocate all resources used for the DynamicChunking.
java.util.Iterator<ISBounds>	getBlockBoundsIterator()
IndexSpaceID	getBlockDimensions()
DataSource	getDataSource()
ISBounds	getIterationSubvolume()
int	getMaxMemoryBlockCount()
long	getMemory()
java.lang.String	getStatistics() Generate a string indicating statistics for performance evaluation.
boolean	isOptimizedBlockSizeAdaptive()
boolean	isOptimizedBlockSizeSlice()
boolean	isOptimizedBlockTable()
void	partitionRatio2blockDimensions()
void	setBlockAccessedCallback(DynamicChunking.BlockAccessCallback blockAccessed) Sets up a callback function that is called each time a block is accessed.
void	setBlockDimensions(IndexSpaceID dimensions)
void	setBlockSizeAdaptiveOptimization(ISBounds iterationSubvolume, java.lang.String iterationId)
void	setBlockSizeSliceOptimization(EulerAngles eulerAngles, ISBounds iterationSubvolume) Uses the maximum block size given the amount of available memory.
void	setIterationSubvolume(ISBounds bounds) If the application specifies the iteration subvolume, the block table is set to cover only the subvolume not the entire dataset.
void	setMemory(long memory)
void	setPartitionRatio(IndexSpaceID partitionRatio)
void	subblock(DataBlock dstBlock, ISBounds dstBounds, ISBounds srcBounds) Reads a subblock defined by srcBounds into the region of the Datablock argument defined by dstBounds.
void	subblock(DataBlock theBlock, ISBounds dstBounds, ISBounds srcBounds, FieldIDMapper mp) not implemented

Methods inherited from class edu.unh.sdb.datasource.DataSource

checkActivated, clearCache, copyBestID, create, create, create, createRemote, createRemote, createRemoteClient, createRemoteClient, createRemoteDataSource, createRemoteDataSource, createRemoteDataSourceUDP, createRemoteUDP, createRemoteUDP, dumpData, equals, getFDLDescriptor, getMetadataCollection, getName, getValues, isActivated, main, setMetadataCollection, toString, toString

Methods inherited from class edu.unh.sdb.datasource.DataCollection

byteSize, computeOffset, computeOffset, copyBounds, createDataBlock, createDataBlock, createDataBlock, createDatum, createDatum, createDatum, createDatum, createDatum, createDatum, datum, datum, datum, datum, datum, dim, getAttributeNames, getAxisOrdering, getAxisWeight, getAxisWeights, getBounds, getByte, getBytes, getBytes, getBytes, getBytes, getBytes, getBytes, getBytesByAttribute, getBytesByAttribute, getBytesByPoint, getBytesByPoint, getDataOrder, getDimensionsArray, getDouble, getDoubles, getDoubles, getDoubles, getDoubles, getDoubles, getDoubles, getDoublesByAttribute, getDoublesByAttribute, getDoublesByPoint, getDoublesByPoint, getFloat, getFloats, getFloats, getFloats, getFloats, getFloats, getFloats, getFloatsByAttribute, getFloatsByAttribute, getFloatsByPoint, getFloatsByPoint, getInt, getInts, getInts, getInts, getInts, getInts, getInts, getIntsByAttribute, getIntsByAttribute, getIntsByPoint, getIntsByPoint, getLowerBoundsArray, getNumAttributes, getRecordDescriptor, getShort, getShorts, getShorts, getShorts, getShorts, getShorts, getShorts, getShortsByAttribute, getShortsByAttribute, getShortsByPoint, getShortsByPoint, getStorageType, getUpperBoundsArray, getValues, getValuesByAttribute, getValuesByPoint, longVolume, setAxisOrdering, setBounds, setRecordDescriptor, size, subblock, subblock, subblock, subblock, subblock, subblock, subblock, subblock, subblock, subblock, useBytesOnly, volume

Methods inherited from class java.lang.Object

clone, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DynamicChunking

public DynamicChunking(DataSource dataSource)

Creates a DynamicChunking object which views a 'dataSource' through a DynamicChunking memory manager and it has the same interface as a DataSource.

Method Detail

getDataSource

public DataSource getDataSource()

setMemory

public void setMemory(long memory)

getMemory

public long getMemory()

setIterationSubvolume

public void setIterationSubvolume(ISBounds bounds)

If the application specifies the iteration subvolume, the block table is set to cover only the subvolume not the entire dataset.

Parameters:

bounds -

setBlockSizeSliceOptimization

public void setBlockSizeSliceOptimization(EulerAngles eulerAngles,
                                 ISBounds iterationSubvolume)

Uses the maximum block size given the amount of available memory. Calculates the block size analytically for a slicing application.

Parameters:

eulerAngles -

iterationSubvolume -

setBlockSizeAdaptiveOptimization

public void setBlockSizeAdaptiveOptimization(ISBounds iterationSubvolume,
                                    java.lang.String iterationId)

getIterationSubvolume

public ISBounds getIterationSubvolume()

setBlockAccessedCallback

public void setBlockAccessedCallback(DynamicChunking.BlockAccessCallback blockAccessed)

Sets up a callback function that is called each time a block is accessed.

Parameters:

blockAccessed - function to be called, if null no function is called.

setBlockDimensions

public void setBlockDimensions(IndexSpaceID dimensions)

setPartitionRatio

public void setPartitionRatio(IndexSpaceID partitionRatio)

getBlockDimensions

public IndexSpaceID getBlockDimensions()

getStatistics

public java.lang.String getStatistics()

Description copied from class: DataSource

Generate a string indicating statistics for performance evaluation.

Overrides:

getStatistics in class DataSource

activate

public void activate()

Activates the cache for the given memory and block size. If the memory is 0, it frees any memory that was previously used, if any.

Overrides:

activate in class DataSource

deactivate

public void deactivate()

Dealocate all resources used for the DynamicChunking. If blockSizeAdaptiveOptimization is enabled, it saves information about the current iteration which will be used in future iterations.

Overrides:

deactivate in class DataSource

getMaxMemoryBlockCount

public int getMaxMemoryBlockCount()

datum

public void datum(Datum datum,
         IndexSpaceID dataId)

Description copied from class: DataCollection

Given an IndexSpaceID, copy the values of the Datum at that position to the argument Datum. TODO Define error conditions

Specified by:

datum in interface Indexable

Overrides:

datum in class DataCollection

datum

public void datum(Datum dtm,
         IndexSpaceID did,
         FieldIDMapper mp)

not implemented

Specified by:

datum in interface Indexable

Specified by:

datum in class DataCollection

subblock

public void subblock(DataBlock dstBlock,
            ISBounds dstBounds,
            ISBounds srcBounds)

Description copied from class: DataCollection

Reads a subblock defined by srcBounds into the region of the Datablock argument defined by dstBounds.

Specified by:

subblock in interface Indexable

Specified by:

subblock in class DataCollection

subblock

public void subblock(DataBlock theBlock,
            ISBounds dstBounds,
            ISBounds srcBounds,
            FieldIDMapper mp)

not implemented

Specified by:

subblock in interface Indexable

Specified by:

subblock in class DataCollection

getBlockBoundsIterator

public java.util.Iterator<ISBounds> getBlockBoundsIterator()

isOptimizedBlockTable

public boolean isOptimizedBlockTable()

isOptimizedBlockSizeSlice

public boolean isOptimizedBlockSizeSlice()

isOptimizedBlockSizeAdaptive

public boolean isOptimizedBlockSizeAdaptive()

partitionRatio2blockDimensions

public void partitionRatio2blockDimensions()