The interface for a YARN native cluster.
Inheritance Hierarchy
Microsoft.Research.DryadLinqDryadLinqYarnCluster
Namespace: Microsoft.Research.DryadLinq
Assembly: Microsoft.Research.DryadLinq (in Microsoft.Research.DryadLinq.dll) Version: 0.2.1.0 (0.2.1.0)
Syntax
The DryadLinqYarnCluster type exposes the following members.
Constructors
Name | Description | |
---|---|---|
DryadLinqYarnCluster(String, Int32, Int32, Int32, String, String, Int32, String, Int32) |
Make a new cluster object representing a YARN cluster with default ports for a client with Java installed
| |
DryadLinqYarnCluster(String, Int32, Int32, Int32, String, String, Int32, String, Int32, Int32, String, Int32) |
Make a new cluster object representing a YARN cluster with default ports for a client without Java installed
|
Methods
Name | Description | |
---|---|---|
Client |
Gets the client cluster interface.
| |
Equals | (Inherited from Object.) | |
Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) | |
GetHashCode | Serves as a hash function for a particular type. (Inherited from Object.) | |
GetType | Gets the Type of the current instance. (Inherited from Object.) | |
MakeInternalClusterUri |
Makes a new URI for storing a dataset in the DFS.
| |
MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) | |
ToString | Returns a string that represents the current object. (Inherited from Object.) |
Fields
Name | Description | |
---|---|---|
ApplicationMasterMbMemory |
The amount of memory to be requested for the Application Master container
| |
ContainerMbMemory |
The amount of memory to be requested for each container other than the Application Master
| |
DefaultNumberOfContainers |
The number of containers a job should ask for, if JobMaxNodes and JobMinNodes are not overwritten in
the DryadLinqContext
| |
HdfsPort |
The port that the Hdfs protocol is listening on
| |
LauncherNode |
The hostname of the computer where the DryadLINQ YARN launcher is running, or null if Java/YARN are
present on the client
| |
LauncherPort |
The port where the DryadLINQ Yarn launcher is listening, or -1 if Java/YARN are
present on the client
| |
NameNode |
The hostname of the computer where the HDFS instance for resource staging is running
| |
User |
The username for the job on the YARN cluster
| |
WebHdfsPort |
The port that the WebHdfs protocol is listening on, or -1 if Java/YARN are present on the client
| |
YarnPort |
The port that the YARN Resource Node is listening on
|
Properties
Name | Description | |
---|---|---|
DefaultMaxNodes |
The maximum number of nodes to use for a job if JobMinNodes is not set in DryadLinqContext
| |
DfsClient |
Gets the client DFS interface.
| |
HeadNode |
The hostname of the computer where the YARN Resource Node is running
| |
Kind |
Gets the service platform of this cluster.
| |
Queue |
The queue that should be used on the cluster
|
See Also