[This is preliminary documentation and is subject to change.]
Manages the construction and execution of an individual dataflow computation.
Namespace: Microsoft.Research.Naiad
Assembly: Microsoft.Research.Naiad (in Microsoft.Research.Naiad.dll) Version: 0.5.0.0 (0.5.0.0)
Syntax
C#
public interface Computation : IDisposable
The Computation type exposes the following members.
Methods
Name | Description | |
---|---|---|
Activate |
Starts computation in this graph.
| |
Join |
Blocks until all computation in this graph has termintaed.
| |
NewInput<TRecord>(DataSource<TRecord>) |
Creates a new input stage from the given DataSource.
| |
NewInput<TRecord>(DataSource<TRecord>, String) |
Creates a new input stage from the given DataSource.
| |
Sync |
Blocks until all subscriptions have processed all inputs up to the supplied epoch.
If the computation has no subscriptions, no synchronization occurs.
|
Extension Methods
Name | Description | |
---|---|---|
DefaultAccount |
Returns the default CloudStorageAccount for this computation.
(Defined by ExtensionMethods.) | |
DefaultBlobContainer |
Returns a reference to the CloudBlobContainer with the given containerName
in the default account for this computation. The container will be created if it does not exist.
(Defined by ExtensionMethods.) | |
NewInputCollection<TRecord> |
Creates a new InputCollection<TRecord> in the given computation.
(Defined by InputCollectionExtensionMethods.) | |
ReadBinaryFromAzureBlobs<TRecord> |
Reads the contents of all files in an Azure directory into a Naiad stream.
The serialization format is the same as WriteBinaryToAzureBlobs, and based on the Naiad message format.
(Defined by ExtensionMethods.) | |
ReadCustomBinaryFromAzureBlobs<R> |
Reads the contents of all binary files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
ReadFromAzureBlobs<TRecord> |
Reads the contents of all files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
ReadFromAzureTable<TEntity> |
Reads the entities from the given Azure table, filtered by the given query.
(Defined by ExtensionMethods.) | |
ReadHdfsBinaryCollection<TOutput> |
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadHdfsCollection<TOutput> |
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadHdfsTextCollection |
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadTextFromAzureBlobs |
Reads the contents of all text files in an Azure directory into a Naiad stream.
(Defined by ExtensionMethods.) | |
ReadWebHdfsBinaryCollection<TOutput>(Uri) | Overloaded.
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsBinaryCollection<TOutput>(Uri, String, Int32) | Overloaded.
Read a collection of HDFS files serialized in the default Naiad binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsCollection<TOutput>(Uri, Func<Stream, IEnumerable<ArraySegment<TOutput>>>) | Overloaded.
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsCollection<TOutput>(Uri, Func<Stream, IEnumerable<ArraySegment<TOutput>>>, String, Int32) | Overloaded.
Read a collection of HDFS files serialized in a custom binary format. Concatenate all the records to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsTextCollection(Uri) | Overloaded.
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) | |
ReadWebHdfsTextCollection(Uri, String, Int32) | Overloaded.
Read a collection of HDFS files serialized as lines of text. Concatenate all the lines of the files to the output,
in an unspecified order.
(Defined by ExtensionMethods.) |
Properties
Name | Description | |
---|---|---|
Controller |
The Controller that hosts this graph.
|
Events
Name | Description | |
---|---|---|
OnFrontierChange |
An event that is raised each time the frontier changes.
| |
OnShutdown |
An event that is raised once the graph is shut down.
| |
OnStartup |
An event that is raised once the graph is started.
|
Remarks
See Also