[This is preliminary documentation and is subject to change.]
Manages the construction and execution of an individual dataflow computation.
Namespace: Microsoft.Research.Naiad
Assembly: Microsoft.Research.Naiad (in Microsoft.Research.Naiad.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public interface Computation : IDisposable
The Computation type exposes the following members.
Methods
Name | Description | |
---|---|---|
Activate |
Starts computation in this graph.
| |
Join |
Blocks until all computation in this graph has termintaed.
| |
NewInputTRecord(DataSourceTRecord) |
Creates a new input stage from the given DataSource.
| |
NewInputTRecord(DataSourceTRecord, String) |
Creates a new input stage from the given DataSource.
| |
Sync |
Blocks until all subscriptions have processed all inputs up to the supplied epoch.
If the computation has no subscriptions, no synchronization occurs.
|
Extension Methods
Name | Description | |
---|---|---|
DefaultAccount |
Returns the default CloudStorageAccount for this computation.
(Defined by ExtensionMethods.) | |
DefaultBlobContainer |
Returns a reference to the CloudBlobContainer with the given containerName
in the default account for this computation. The container will be created if it does not exist.
(Defined by ExtensionMethods.) | |
NewInputCollectionTRecord |
Creates a new InputCollectionTRecord in the given computation.
(Defined by InputCollectionExtensionMethods.) | |
ReadBinaryFromAzureBlobsTRecord |
Reads the contents of all files in an Azure directory into a Naiad stream.
The serialization format is the same as WriteBinaryToAzureBlobs, and based on the Naiad message format.
(Defined by ExtensionMethods.) | |
ReadCustomBinaryFromAzureBlobsR |
Reads the contents of all binary files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
ReadFromAzureBlobsTRecord |
Reads the contents of all files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
ReadFromAzureTableTEntity |
Reads the entities from the given Azure table, filtered by the given query.
(Defined by ExtensionMethods.) | |
ReadHdfsBinaryCollectionTOutput |
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadHdfsCollectionTOutput |
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadHdfsTextCollection |
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadTextFromAzureBlobs |
Reads the contents of all text files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
ReadWebHdfsBinaryCollectionTOutput(Uri) | Overloaded.
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsBinaryCollectionTOutput(Uri, String, Int32) | Overloaded.
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsCollectionTOutput(Uri, FuncStream, IEnumerableArraySegmentTOutput) | Overloaded.
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsCollectionTOutput(Uri, FuncStream, IEnumerableArraySegmentTOutput, String, Int32) | Overloaded.
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsTextCollection(Uri) | Overloaded.
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsTextCollection(Uri, String, Int32) | Overloaded.
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) |
Properties
Name | Description | |
---|---|---|
Controller |
The Controller that hosts this graph.
|
Events
Name | Description | |
---|---|---|
OnFrontierChange |
An event that is raised each time the frontier changes.
| |
OnShutdown |
An event that is raised once the graph is shut down.
| |
OnStartup |
An event that is raised once the graph is started.
|
Remarks
See Also