[This is preliminary documentation and is subject to change.]
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
Namespace: Microsoft.Research.Naiad.Frameworks.WebHdfs
Assembly: Microsoft.Research.Naiad.WebHdfsSupport (in Microsoft.Research.Naiad.WebHdfsSupport.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public static Stream<TOutput, Epoch> ReadWebHdfsBinaryCollection<TOutput>( this Computation manager, Uri fileOrDirectoryPath, string user, int webPort )
Parameters
- manager
- Type: Microsoft.Research.Naiad.Computation
Naiad computation - fileOrDirectoryPath
- Type: System.Uri
path of the file or directory to read - user
- Type: System.String
hdfs user - webPort
- Type: System.Int32
webhdfs protocol port
Type Parameters
- TOutput
- output record type
Return Value
Type: Stream<TOutput, Epoch>stream of records in the hdfs files
Usage Note
In Visual Basic and C#, you can call this method as an instance method on any object of type Computation. When you use instance method syntax to call this method, omit the first parameter. For more information, see Extension Methods (Visual Basic) or Extension Methods (C# Programming Guide).See Also