[This is preliminary documentation and is subject to change.]
base worker implementation for the worker to read Hdfs files an entire file at a time, rather than block by block
Inheritance Hierarchy
Microsoft.Research.Naiad.Frameworks.Storage.DfsDfsFileWorkerTOutput
Namespace: Microsoft.Research.Naiad.Frameworks.Storage.Dfs
Assembly: Microsoft.Research.Naiad.Storage (in Microsoft.Research.Naiad.Storage.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public class DfsFileWorker<TOutput> : IWorker<DfsBlock, IPAddress[], TOutput>
Type Parameters
- TOutput
- the type of records to be read
The DfsFileWorkerTOutput type exposes the following members.
Constructors
| Name | Description | |
|---|---|---|
 | DfsFileWorkerTOutput |
create a worker for a file-at-a-time hdfs reader
|
Methods
| Name | Description | |
|---|---|---|
| DescribeWorker |
Return a description of the worker that the coordinator will use when matching work items to workers. This is called
once before any work item has been assigned, and once after each work item is performed.
|
| DoWork |
Execute a work item, reading an HDFS file and generating a sequence of output records
|
Fields
| Name | Description | |
|---|---|---|
 | client |
the Hdfs client used to read files
|
See Also