[This is preliminary documentation and is subject to change.]
Read a stream of path names (file or directory names) each of which corresponds to a collection of HDFS files
serialized as lines of text. Concatenate all the lines of the files to the output, in an unspecified order.
Namespace: Microsoft.Research.Naiad.Frameworks.WebHdfs
Assembly: Microsoft.Research.Naiad.WebHdfsSupport (in Microsoft.Research.Naiad.WebHdfsSupport.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public static Stream<string, TTime> FromWebHdfsText<TTime>( this Stream<Uri, TTime> input, string user, int webPort ) where TTime : Object, Time<TTime>
Parameters
- input
- Type: Microsoft.Research.NaiadStreamUri, TTime
stream of input paths - user
- Type: SystemString
hdfs user - webPort
- Type: SystemInt32
webhdfs protocol port
Type Parameters
- TTime
- time of the input and output records
Return Value
Type: StreamString, TTimestream of text lines in the hdfs files
Usage Note
In Visual Basic and C#, you can call this method as an instance method on any object of type StreamUri, TTime. When you use instance method syntax to call this method, omit the first parameter. For more information, see Extension Methods (Visual Basic) or Extension Methods (C# Programming Guide).See Also