Represents the context necessary to prepare and execute a DryadLinq Query,
Inheritance Hierarchy
Microsoft.Research.DryadLinqDryadLinqContext
Namespace: Microsoft.Research.DryadLinq
Assembly: Microsoft.Research.DryadLinq (in Microsoft.Research.DryadLinq.dll) Version: 0.2.1.0 (0.2.1.0)
Syntax
The DryadLinqContext type exposes the following members.
Constructors
Name | Description | |
---|---|---|
DryadLinqContext(DryadLinqCluster) |
Initializes a new instance of the DryadLinqContext class for a specified cluster.
| |
DryadLinqContext(Int32, String) |
Initializes a new instance of the DryadLinqContext class for local execution.
| |
DryadLinqContext(String, PlatformKind) |
Initializes a new instance of the DryadLinqContext class for a YARN cluster.
|
Methods
Name | Description | |
---|---|---|
AzureAccountKey |
Get the key associated with a named account, or null if it is not registered or auto-detected from
the subscriptions
| |
ClientVersion |
Version of the DryadLinq client components
| |
Dispose |
Releases all resources used by the DryadLinqContext.
| |
Equals(Object) | (Inherited from Object.) | |
Equals(DryadLinqContext) |
Determines whether this instance of DryadLinqContext is equal to another instance
of DryadLinqContext.
| |
Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) | |
FromEnumerableT |
Converts an IEnumerable{T} to a DryadLinq specialized IQueryable{T}.
| |
FromStoreT(String, ExpressionFuncStream, IEnumerableT) |
Open a dataset as a DryadLinq specialized IQueryable{T}.
| |
FromStoreT(Uri, ExpressionFuncStream, IEnumerableT) |
Open a dataset as a DryadLinq specialized IQueryable{T}.
| |
GetHashCode | Serves as a hash function for a particular type. (Inherited from Object.) | |
GetType | Gets the Type of the current instance. (Inherited from Object.) | |
MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) | |
RegisterAzureAccount |
Register a named account with the specified storage key, so that key won't need to be specified in Azure blob URIs
| |
ToString | Returns a string that represents the current object. (Inherited from Object.) |
Properties
Name | Description | |
---|---|---|
ApplicationMasterMbMemory |
Gets or sets the amount of memory in Megabytes requested for the Application Master container.
| |
CompileForVertexDebugging |
Gets or sets the value specifying whether to compile code with debugging support.
| |
ContainerMbMemory |
Gets or sets the amount of memory in Megabytes requested for the worker containers.
| |
DebugBreak |
Gets and sets the value specifying whether a vertex should break into the debugger
| |
DryadHomeDirectory |
Gets or sets the bin directory for Dryad.
| |
EnableSpeculativeDuplication |
Enables or disables speculative duplication of vertices based on runtime performance analysis.
| |
ExecutorKind |
Gets and sets the job executor. The current release only supports Dryad.
| |
ForceGC |
Gets or sets whether to run GC after Moxie runs each task.
| |
GraphManagerNode |
Gets or sets the node that should be used for running the Dryad Graph Manager task.
| |
HeadNode |
Gets or sets the head node for executing a DryadLinq query.
| |
IntermediateDataCompressionScheme |
Gets or sets the value specifying whether data passed between stages will be compressed.
| |
JobEnvironmentVariables |
Gets the collection of environment variables associated with the DryadLINQ job.
| |
JobFriendlyName |
Gets or sets the descriptive name used to describe the DryadLINQ job.
| |
JobMaxNodes |
Gets or sets the maximum number of cluster nodes for the DryadLINQ job.
| |
JobMinNodes |
Gets or sets the minimum number of cluster nodes for the DryadLINQ job.
| |
JobPassword |
Gets or sets the RunAs password for jobs submitted to the cluster.
| |
JobRuntimeLimit |
Gets or sets the maximum execution time for the DryadLINQ job, in seconds.
| |
JobUsername |
Gets or sets the RunAs password for jobs submitted to the cluster.
| |
LocalDebug |
Gets or sets the value specifying whether to use Local debugging mode.
| |
MatchClientNetFrameworkVersion |
Configures query jobs to be launched on the cluster nodes against a .NET framework version
matching that of the client process. This should only be set if all cluster nodes are known to have
the same .NET version as the client.
When set to false (default), the vertex code will be compiled and run against .NET Framework 3.5.
| |
NodeGroup |
Gets or sets the name of the compute node group when running on the cluster.
| |
OutputDataCompressionScheme |
Gets or sets the value specifying the compression scheme for output data.
| |
PartitionUncPath |
Gets or sets the partition UNC path used when constructing a partitioned table.
| |
PeloponneseHomeDirectory |
Gets or sets the bin directory for Peloponnese.
| |
PlatformKind |
Gets or sets the service platform
| |
Queue |
The Queue that should be used for job submission. The default queue is the default value.
| |
ResourcesToAdd |
Get the list of resources to add to the DryadLINQ job.
| |
ResourcesToRemove |
Get the list of resources to be excluded from the DryadLINQ job.
| |
RuntimeLoggingLevel |
Gets or sets the logging level to use for DryadLINQ Query jobs.
| |
SelectOrderPreserving |
Gets or sets whether certain operators will preserve item ordering.
When true, the Select, SelectMany and Where operators will preserve item ordering;
otherwise, they may shuffle the input items as they are processed.
| |
ThreadsPerWorker |
Gets or sets the number of threads each DryadLINQ worker vertex will use
|
Remarks
DryadLinqContext is the main entry point for the DryadLINQ framework. The context that is maintained by a DryadLinqContext instance includes configuration information.
A DryadLinqContext may be reused by multiple queries and query executions.
A DryadLinqContext may hold open connections to cluster services. To release these connections, call DryadLinqContext.Dispose().
See Also