ExtensionMethodsFromWebHdfsTOutput, TTime Method (StreamUri, TTime, FuncStream, IEnumerableArraySegmentTOutput)Naiad Help

[This is preliminary documentation and is subject to change.]

Read a stream of path names (file or directory names) each of which corresponds to a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output, in an unspecified order.

Namespace: Microsoft.Research.Naiad.Frameworks.WebHdfs
Assembly: Microsoft.Research.Naiad.WebHdfsSupport (in Microsoft.Research.Naiad.WebHdfsSupport.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax

C#
public static Stream<TOutput, TTime> FromWebHdfs<TOutput, TTime>(
	this Stream<Uri, TTime> input,
	Func<Stream, IEnumerable<ArraySegment<TOutput>>> deserialize
)
where TTime : Object, Time<TTime>

Parameters

input
Type: Microsoft.Research.NaiadStreamUri, TTime
stream of input paths
deserialize
Type: SystemFuncStream, IEnumerableArraySegmentTOutput
custom deserializer function to convert a stream of bytes into a sequence of records

Type Parameters

TOutput
output record type
TTime
time of the input and output records

Return Value

Type: StreamTOutput, TTime
stream of records in the hdfs files

Usage Note

In Visual Basic and C#, you can call this method as an instance method on any object of type StreamUri, TTime. When you use instance method syntax to call this method, omit the first parameter. For more information, see Extension Methods (Visual Basic) or Extension Methods (C# Programming Guide).
See Also

Reference