[This is preliminary documentation and is subject to change.]
the worker class for a text reader for files with fixed-length blocks and text records. It uses DfsBlocks as work
items, and parses data into lines represented as strings
Inheritance Hierarchy
Microsoft.Research.Naiad.Frameworks.Storage.DfsDfsBlockWorkerDfsBlock, String
Microsoft.Research.Naiad.Frameworks.Storage.DfsDfsTextWorker
Namespace: Microsoft.Research.Naiad.Frameworks.Storage.Dfs
Assembly: Microsoft.Research.Naiad.Storage (in Microsoft.Research.Naiad.Storage.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public class DfsTextWorker : DfsBlockWorker<DfsBlock, string>
The DfsTextWorker type exposes the following members.
Constructors
Name | Description | |
---|---|---|
DfsTextWorker |
create a worker for deserializing lines of text from an Hdfs file
|
Methods
Name | Description | |
---|---|---|
DescribeWorker |
the IWorker implementation used to identify this worker to the WebHdfs coordinator, so that it can be sent work items
of blocks stored at the same machine
(Inherited from DfsBlockWorkerTItem, TOutput.) | |
DoWork |
find the range of valid records in the block (those that start within the block), deserialize them, and return them in batches
(Inherited from DfsBlockWorkerTItem, TOutput.) |
Fields
Name | Description | |
---|---|---|
client |
the client used for reading Hdfs data
(Inherited from DfsBlockWorkerTItem, TOutput.) |
See Also