• Paul E. McKenney's avatar
    rcu: Enforce expedited-GP fairness via funnel wait queue · f6a12f34
    Paul E. McKenney authored
    The current mutex-based funnel-locking approach used by expedited grace
    periods is subject to severe unfairness.  The problem arises when a
    few tasks, making a path from leaves to root, all wake up before other
    tasks do.  A new task can then follow this path all the way to the root,
    which needlessly delays tasks whose grace period is done, but who do
    not happen to acquire the lock quickly enough.
    This commit avoids this problem by maintaining per-rcu_node wait queues,
    along with a per-rcu_node counter that tracks the latest grace period
    sought by an earlier task to visit this node.  If that grace period
    would satisfy the current task, instead of proceeding up the tree,
    it waits on the current rcu_node structure using a pair of wait queues
    provided for that purpose.  This decouples awakening of old tasks from
    the arrival of new tasks.
    If the wakeups prove to be a bottleneck, additional kthreads can be
    brought to bear for that purpose.
    Signed-off-by: default avatarPaul E. McKenney <paulmck@linux.vnet.ibm.com>
rcu.h 24.1 KB