DfsFileWorkerTOutput ClassNaiad Help

[This is preliminary documentation and is subject to change.]

base worker implementation for the worker to read Hdfs files an entire file at a time, rather than block by block
Inheritance Hierarchy

SystemObject
  Microsoft.Research.Naiad.Frameworks.Storage.DfsDfsFileWorkerTOutput

Namespace: Microsoft.Research.Naiad.Frameworks.Storage.Dfs
Assembly: Microsoft.Research.Naiad.Storage (in Microsoft.Research.Naiad.Storage.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax

C#
public class DfsFileWorker<TOutput> : IWorker<DfsBlock, IPAddress[], TOutput>

Type Parameters

TOutput
the type of records to be read

The DfsFileWorkerTOutput type exposes the following members.

Constructors

  NameDescription
Public methodDfsFileWorkerTOutput
create a worker for a file-at-a-time hdfs reader
Top
Methods

  NameDescription
Public methodDescribeWorker
Return a description of the worker that the coordinator will use when matching work items to workers. This is called once before any work item has been assigned, and once after each work item is performed.
Public methodDoWork
Execute a work item, reading an HDFS file and generating a sequence of output records
Top
Fields

  NameDescription
Protected fieldclient
the Hdfs client used to read files
Top
See Also

Reference