The interface for a YARN native cluster.
Inheritance Hierarchy
Microsoft.Research.DryadLinqDryadLinqYarnCluster
Namespace: Microsoft.Research.DryadLinq
Assembly: Microsoft.Research.DryadLinq (in Microsoft.Research.DryadLinq.dll) Version: 0.2.1.0 (0.2.1.0)
Syntax
The DryadLinqYarnCluster type exposes the following members.
Constructors
| Name | Description | |
|---|---|---|
| DryadLinqYarnCluster(String, Int32, Int32, Int32, String, String, Int32, String, Int32) |
Make a new cluster object representing a YARN cluster with default ports for a client with Java installed
| |
| DryadLinqYarnCluster(String, Int32, Int32, Int32, String, String, Int32, String, Int32, Int32, String, Int32) |
Make a new cluster object representing a YARN cluster with default ports for a client without Java installed
|
Methods
| Name | Description | |
|---|---|---|
| Client |
Gets the client cluster interface.
| |
| Equals | (Inherited from Object.) | |
| Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) | |
| GetHashCode | Serves as a hash function for a particular type. (Inherited from Object.) | |
| GetType | Gets the Type of the current instance. (Inherited from Object.) | |
| MakeInternalClusterUri |
Makes a new URI for storing a dataset in the DFS.
| |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) | |
| ToString | Returns a string that represents the current object. (Inherited from Object.) |
Fields
| Name | Description | |
|---|---|---|
| ApplicationMasterMbMemory |
The amount of memory to be requested for the Application Master container
| |
| ContainerMbMemory |
The amount of memory to be requested for each container other than the Application Master
| |
| DefaultNumberOfContainers |
The number of containers a job should ask for, if JobMaxNodes and JobMinNodes are not overwritten in
the DryadLinqContext
| |
| HdfsPort |
The port that the Hdfs protocol is listening on
| |
| LauncherNode |
The hostname of the computer where the DryadLINQ YARN launcher is running, or null if Java/YARN are
present on the client
| |
| LauncherPort |
The port where the DryadLINQ Yarn launcher is listening, or -1 if Java/YARN are
present on the client
| |
| NameNode |
The hostname of the computer where the HDFS instance for resource staging is running
| |
| User |
The username for the job on the YARN cluster
| |
| WebHdfsPort |
The port that the WebHdfs protocol is listening on, or -1 if Java/YARN are present on the client
| |
| YarnPort |
The port that the YARN Resource Node is listening on
|
Properties
| Name | Description | |
|---|---|---|
| DefaultMaxNodes |
The maximum number of nodes to use for a job if JobMinNodes is not set in DryadLinqContext
| |
| DfsClient |
Gets the client DFS interface.
| |
| HeadNode |
The hostname of the computer where the YARN Resource Node is running
| |
| Kind |
Gets the service platform of this cluster.
| |
| Queue |
The queue that should be used on the cluster
|
See Also