DfsFileCoordinator MethodsNaiad Help

[This is preliminary documentation and is subject to change.]

The DfsFileCoordinator type exposes the following members.

Methods

  NameDescription
Protected methodEnumerateFileWork
given a file, determine how much of that file's data are stored on each datanode. Return every datanode that stores a threshold percentage of the file's data as a candidate match for that file
(Overrides DfsBaseCoordinatorTWorkDescriptionEnumerateFileWork(HdfsFile).)
Protected methodEnumerateWork
given an input string of a file or directory, expand it into a set of files, and then expand each file into a set of matches using the derived-class implementation of EnumerateFileWork
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Protected methodExpandWorkItem
if the work item was matched to a worker on the same computer, fill in the datanode endpoint before sending the work item
(Overrides MatchingCoordinatorTInput, TCategory, TWorkStub, TWorkDescription, TWorkerDescriptionExpandWorkItem(Boolean, TCategory, TWorkStub).)
Protected methodMapWorkerToQueue
Called when a worker announces that it is ready for another work item, to find a work item on the worker's matching queue, if any. The worker may have multiple IP addresses, so it returns them all, and if any matches an address the datanode is listening on, then the worker is matched to that datanode
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Protected methodNotifyQueueAddition
called whenever a queue is added: keep our index of addresses up to date
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Protected methodNotifyQueueRemoval
called whenever a queue is removed: keep our index of addresses up to date
(Inherited from DfsBaseCoordinatorTWorkDescription.)
Top
See Also

Reference