[This is preliminary documentation and is subject to change.]
Manages the construction and execution of an individual dataflow computation.
Namespace: Microsoft.Research.Naiad
Assembly: Microsoft.Research.Naiad (in Microsoft.Research.Naiad.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public interface Computation : IDisposable
The Computation type exposes the following members.
Methods
| Name | Description | |
|---|---|---|
| Activate |
Starts computation in this graph.
| |
| Join |
Blocks until all computation in this graph has termintaed.
| |
| NewInputTRecord(DataSourceTRecord) |
Creates a new input stage from the given DataSource.
| |
| NewInputTRecord(DataSourceTRecord, String) |
Creates a new input stage from the given DataSource.
| |
| Sync |
Blocks until all subscriptions have processed all inputs up to the supplied epoch.
If the computation has no subscriptions, no synchronization occurs.
|
Extension Methods
| Name | Description | |
|---|---|---|
| DefaultAccount |
Returns the default CloudStorageAccount for this computation.
(Defined by ExtensionMethods.) | |
| DefaultBlobContainer |
Returns a reference to the CloudBlobContainer with the given containerName
in the default account for this computation. The container will be created if it does not exist.
(Defined by ExtensionMethods.) | |
| NewInputCollectionTRecord |
Creates a new InputCollectionTRecord in the given computation.
(Defined by InputCollectionExtensionMethods.) | |
| ReadBinaryFromAzureBlobsTRecord |
Reads the contents of all files in an Azure directory into a Naiad stream.
The serialization format is the same as WriteBinaryToAzureBlobs, and based on the Naiad message format.
(Defined by ExtensionMethods.) | |
| ReadCustomBinaryFromAzureBlobsR |
Reads the contents of all binary files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
| ReadFromAzureBlobsTRecord |
Reads the contents of all files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
| ReadFromAzureTableTEntity |
Reads the entities from the given Azure table, filtered by the given query.
(Defined by ExtensionMethods.) | |
| ReadHdfsBinaryCollectionTOutput |
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadHdfsCollectionTOutput |
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadHdfsTextCollection |
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadTextFromAzureBlobs |
Reads the contents of all text files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
| ReadWebHdfsBinaryCollectionTOutput(Uri) | Overloaded.
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadWebHdfsBinaryCollectionTOutput(Uri, String, Int32) | Overloaded.
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadWebHdfsCollectionTOutput(Uri, FuncStream, IEnumerableArraySegmentTOutput) | Overloaded.
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadWebHdfsCollectionTOutput(Uri, FuncStream, IEnumerableArraySegmentTOutput, String, Int32) | Overloaded.
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadWebHdfsTextCollection(Uri) | Overloaded.
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
| ReadWebHdfsTextCollection(Uri, String, Int32) | Overloaded.
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) |
Properties
| Name | Description | |
|---|---|---|
| Controller |
The Controller that hosts this graph.
|
Events
| Name | Description | |
|---|---|---|
| OnFrontierChange |
An event that is raised each time the frontier changes.
| |
| OnShutdown |
An event that is raised once the graph is shut down.
| |
| OnStartup |
An event that is raised once the graph is started.
|
Remarks
See Also