org.apache.drill.yarn.appMaster

Class AbstractScheduler

java.lang.Object

org.apache.drill.yarn.appMaster.AbstractScheduler

All Implemented Interfaces:

Scheduler

Direct Known Subclasses:

BatchScheduler, PersistentTaskScheduler

public abstract class AbstractScheduler
extends Object
implements Scheduler

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.drill.yarn.appMaster.Scheduler

Scheduler.TaskManager

Field Summary

Fields

Modifier and Type	Field and Description
protected int	failCount
protected boolean	isTracked
protected int	priority
protected SchedulerState	state
protected Scheduler.TaskManager	taskManager
protected TaskSpec	taskSpec

Constructor Summary

Constructors

Constructor and Description
AbstractScheduler(String type, String name)

Method Summary

Modifier and Type	Method and Description
protected void	addTasks(int n)
void	change(int delta) Increase (positive) or decrease (negative) the number of desired tasks by the given amount.
String	getName()
int	getRequestTimeoutSec() Maximum amount of time to wait when cancelling a job in the REQUESTING state.
ContainerRequestSpec	getResource() For reporting, get the YARN resources requested by processes in this pool.
Scheduler.TaskManager	getTaskManager()
String	getType()
boolean	isTracked() Whether tasks from this scheduler should incorporate app startup/shutdown acknowledgements (acks) into the task lifecycle.
void	limitContainerSize(org.apache.hadoop.yarn.api.records.Resource maxResource)
void	registerState(SchedulerState state) Register the state object that tracks tasks launched by this scheduler.
void	setPriority(int priority) Controller-assigned priority for this scheduler.
void	setTaskManager(Scheduler.TaskManager taskManager)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.drill.yarn.appMaster.Scheduler

adjust, completed, getProgress, getTarget, hasMoreTasks, requestTimedOut, resize

Field Detail

taskSpec

protected TaskSpec taskSpec

priority

protected int priority

failCount

protected int failCount

taskManager

protected Scheduler.TaskManager taskManager

state

protected SchedulerState state

isTracked

protected boolean isTracked

Constructor Detail

AbstractScheduler

public AbstractScheduler(String type,
                         String name)

Method Detail

setTaskManager

public void setTaskManager(Scheduler.TaskManager taskManager)

registerState

public void registerState(SchedulerState state)

Description copied from interface: Scheduler

Register the state object that tracks tasks launched by this scheduler.

Specified by:

registerState in interface Scheduler

setPriority

public void setPriority(int priority)

Description copied from interface: Scheduler

Controller-assigned priority for this scheduler. Used to differentiate container requests by scheduler.

Specified by:

setPriority in interface Scheduler

getName

public String getName()

Specified by:

getName in interface Scheduler

getType

public String getType()

Specified by:

getType in interface Scheduler

getTaskManager

public Scheduler.TaskManager getTaskManager()

Specified by:

getTaskManager in interface Scheduler

change

public void change(int delta)

Description copied from interface: Scheduler

Increase (positive) or decrease (negative) the number of desired tasks by the given amount.

Specified by:

change in interface Scheduler

addTasks

protected void addTasks(int n)

isTracked

public boolean isTracked()

Description copied from interface: Scheduler

Whether tasks from this scheduler should incorporate app startup/shutdown acknowledgements (acks) into the task lifecycle.

Specified by:

isTracked in interface Scheduler

getResource

public ContainerRequestSpec getResource()

Description copied from interface: Scheduler

For reporting, get the YARN resources requested by processes in this pool.

Specified by:

getResource in interface Scheduler

Returns:

The request spec.

limitContainerSize

public void limitContainerSize(org.apache.hadoop.yarn.api.records.Resource maxResource)
                        throws AMException

Specified by:

limitContainerSize in interface Scheduler

Throws:

AMException

getRequestTimeoutSec

public int getRequestTimeoutSec()

Description copied from interface: Scheduler

Maximum amount of time to wait when cancelling a job in the REQUESTING state. YARN will happily wait forever for a resource, this setting forcibly cancels the request at timeout.

Specified by:

getRequestTimeoutSec in interface Scheduler

Returns:

the number of seconds to wait for timeout. 0 means no timeout