DfsBlockCoordinatorTItem MethodsNaiad Help

[This is preliminary documentation and is subject to change.]

The DfsBlockCoordinatorTItem generic type exposes the following members.

Methods

  NameDescription
Protected methodEnumerateFileWork
called to convert an input file into a list of blocks
(Overrides DfsBaseCoordinatorTWorkDescriptionEnumerateFileWork(HdfsFile).)
Protected methodEnumerateWork
given an input string of a file or directory, expand it into a set of files, and then expand each file into a set of matches using the derived-class implementation of EnumerateFileWork
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Protected methodExpandWorkItem
Called when a work item is going to be sent to a worker. If usedMatchingQueue is true then dataNode is the endpoint of the dataNode that matches the worker
(Overrides MatchingCoordinatorTInput, TCategory, TWorkStub, TWorkDescription, TWorkerDescriptionExpandWorkItem(Boolean, TCategory, TWorkStub).)
Protected methodMakeBaseMatches
For a given file, map a sequence of locations to a sequence of "base" matches, where the workStub component of the match has any filetype-specific metadata filled in and the categories component of the match has been set to the locations of that block. The HdfsBlock fields will all be filled in later after this sequence has been returned
Protected methodMapWorkerToQueue
Called when a worker announces that it is ready for another work item, to find a work item on the worker's matching queue, if any. The worker may have multiple IP addresses, so it returns them all, and if any matches an address the datanode is listening on, then the worker is matched to that datanode
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Protected methodNotifyQueueAddition
called whenever a queue is added: keep our index of addresses up to date
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Protected methodNotifyQueueRemoval
called whenever a queue is removed: keep our index of addresses up to date
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Top
See Also

Reference