DryadLinqContext ClassDryadLINQ documentation
Represents the context necessary to prepare and execute a DryadLinq Query,
Inheritance Hierarchy

SystemObject
  Microsoft.Research.DryadLinqDryadLinqContext

Namespace: Microsoft.Research.DryadLinq
Assembly: Microsoft.Research.DryadLinq (in Microsoft.Research.DryadLinq.dll) Version: 0.2.1.0 (0.2.1.0)
Syntax

public class DryadLinqContext : IDisposable, 
	IEquatable<DryadLinqContext>

The DryadLinqContext type exposes the following members.

Constructors

  NameDescription
Public methodDryadLinqContext(DryadLinqCluster)
Initializes a new instance of the DryadLinqContext class for a specified cluster.
Public methodDryadLinqContext(Int32, String)
Initializes a new instance of the DryadLinqContext class for local execution.
Public methodDryadLinqContext(String, PlatformKind)
Initializes a new instance of the DryadLinqContext class for a YARN cluster.
Top
Methods

  NameDescription
Public methodAzureAccountKey
Get the key associated with a named account, or null if it is not registered or auto-detected from the subscriptions
Public methodClientVersion
Version of the DryadLinq client components
Public methodDispose
Releases all resources used by the DryadLinqContext.
Public methodEquals(Object)
Determines whether the specified Object is equal to the current Object.
(Inherited from Object.)
Public methodEquals(DryadLinqContext)
Determines whether this instance of DryadLinqContext is equal to another instance of DryadLinqContext.
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodFromEnumerableT
Converts an IEnumerable{T} to a DryadLinq specialized IQueryable{T}.
Public methodFromStoreT(String, ExpressionFuncStream, IEnumerableT)
Open a dataset as a DryadLinq specialized IQueryable{T}.
Public methodFromStoreT(Uri, ExpressionFuncStream, IEnumerableT)
Open a dataset as a DryadLinq specialized IQueryable{T}.
Public methodGetHashCode
Serves as a hash function for a particular type.
(Inherited from Object.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodRegisterAzureAccount
Register a named account with the specified storage key, so that key won't need to be specified in Azure blob URIs
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Top
Properties

  NameDescription
Public propertyApplicationMasterMbMemory
Gets or sets the amount of memory in Megabytes requested for the Application Master container.
Public propertyCompileForVertexDebugging
Gets or sets the value specifying whether to compile code with debugging support.
Public propertyContainerMbMemory
Gets or sets the amount of memory in Megabytes requested for the worker containers.
Public propertyDebugBreak
Gets and sets the value specifying whether a vertex should break into the debugger
Public propertyDryadHomeDirectory
Gets or sets the bin directory for Dryad.
Public propertyEnableSpeculativeDuplication
Enables or disables speculative duplication of vertices based on runtime performance analysis.
Public propertyExecutorKind
Gets and sets the job executor. The current release only supports Dryad.
Public propertyForceGC
Gets or sets whether to run GC after Moxie runs each task.
Public propertyGraphManagerNode
Gets or sets the node that should be used for running the Dryad Graph Manager task.
Public propertyHeadNode
Gets or sets the head node for executing a DryadLinq query.
Public propertyIntermediateDataCompressionScheme
Gets or sets the value specifying whether data passed between stages will be compressed.
Public propertyJobEnvironmentVariables
Gets the collection of environment variables associated with the DryadLINQ job.
Public propertyJobFriendlyName
Gets or sets the descriptive name used to describe the DryadLINQ job.
Public propertyJobMaxNodes
Gets or sets the maximum number of cluster nodes for the DryadLINQ job.
Public propertyJobMinNodes
Gets or sets the minimum number of cluster nodes for the DryadLINQ job.
Public propertyJobPassword
Gets or sets the RunAs password for jobs submitted to the cluster.
Public propertyJobRuntimeLimit
Gets or sets the maximum execution time for the DryadLINQ job, in seconds.
Public propertyJobUsername
Gets or sets the RunAs password for jobs submitted to the cluster.
Public propertyLocalDebug
Gets or sets the value specifying whether to use Local debugging mode.
Public propertyMatchClientNetFrameworkVersion
Configures query jobs to be launched on the cluster nodes against a .NET framework version matching that of the client process. This should only be set if all cluster nodes are known to have the same .NET version as the client. When set to false (default), the vertex code will be compiled and run against .NET Framework 3.5.
Public propertyNodeGroup
Gets or sets the name of the compute node group when running on the cluster.
Public propertyOutputDataCompressionScheme
Gets or sets the value specifying the compression scheme for output data.
Public propertyPartitionUncPath
Gets or sets the partition UNC path used when constructing a partitioned table.
Public propertyPeloponneseHomeDirectory
Gets or sets the bin directory for Peloponnese.
Public propertyPlatformKind
Gets or sets the service platform
Public propertyQueue
The Queue that should be used for job submission. The default queue is the default value.
Public propertyResourcesToAdd
Get the list of resources to add to the DryadLINQ job.
Public propertyResourcesToRemove
Get the list of resources to be excluded from the DryadLINQ job.
Public propertyRuntimeLoggingLevel
Gets or sets the logging level to use for DryadLINQ Query jobs.
Public propertySelectOrderPreserving
Gets or sets whether certain operators will preserve item ordering. When true, the Select, SelectMany and Where operators will preserve item ordering; otherwise, they may shuffle the input items as they are processed.
Public propertyThreadsPerWorker
Gets or sets the number of threads each DryadLINQ worker vertex will use
Top
Remarks

DryadLinqContext is the main entry point for the DryadLINQ framework. The context that is maintained by a DryadLinqContext instance includes configuration information.

A DryadLinqContext may be reused by multiple queries and query executions.

A DryadLinqContext may hold open connections to cluster services. To release these connections, call DryadLinqContext.Dispose().

See Also

Reference