org.apache.drill.exec.work.foreman.rm

Class ThrottledResourceManager

java.lang.Object

org.apache.drill.exec.work.foreman.rm.AbstractResourceManager

org.apache.drill.exec.work.foreman.rm.ThrottledResourceManager

All Implemented Interfaces:

ResourceManager

public class ThrottledResourceManager
extends AbstractResourceManager

Global resource manager that provides basic admission control (AC) via a configured queue: either the Zookeeper-based distributed queue or the in-process embedded Drillbit queue. The queue places an upper limit on the number of running queries. This limit then "slices" memory and CPU between queries: each gets the same share of resources.

This is a "basic" implementation. Clearly, a more advanced implementation could look at query cost to determine whether to give a given query more or less than the "standard" share. That is left as a future exercise; in this version we just want to get the basics working.

This is the resource manager level. This resource manager is paired with a queue implementation to produce a complete solution. This composition-based approach allows sharing of functionality across queue implementations.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ThrottledResourceManager.QueuedQueryResourceManager Per-query resource manager.
static class	ThrottledResourceManager.QueuedResourceAllocator

Field Summary

Fields inherited from class org.apache.drill.exec.work.foreman.rm.AbstractResourceManager

context

Constructor Summary

Constructors

Constructor and Description
ThrottledResourceManager(DrillbitContext drillbitContext, QueryQueue queue)

Method Summary

Modifier and Type	Method and Description
void	close()
long	defaultQueryMemoryPerNode(double cost)
long	minimumOperatorMemory()
QueryResourceManager	newQueryRM(Foreman foreman) Create a resource manager to execute a query.
QueryResourceAllocator	newResourceAllocator(QueryContext queryContext) Create a resource manager to prepare or describe a query.
QueryQueue	queue()

Methods inherited from class org.apache.drill.exec.work.foreman.rm.AbstractResourceManager

cpusPerNode, memoryPerNode

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ThrottledResourceManager

public ThrottledResourceManager(DrillbitContext drillbitContext,
                                QueryQueue queue)

Method Detail

minimumOperatorMemory

public long minimumOperatorMemory()

defaultQueryMemoryPerNode

public long defaultQueryMemoryPerNode(double cost)

queue

public QueryQueue queue()

newResourceAllocator

public QueryResourceAllocator newResourceAllocator(QueryContext queryContext)

Description copied from interface: ResourceManager

Create a resource manager to prepare or describe a query. In this form, no queuing is done, but the plan is created as if queuing had been done. Used when executing EXPLAIN PLAN.

Returns:

a resource manager for the query

newQueryRM

public QueryResourceManager newQueryRM(Foreman foreman)

Description copied from interface: ResourceManager

Create a resource manager to execute a query.

Parameters:

foreman - Foreman which manages the execution

Returns:

a resource manager for the query

close

public void close()