A Few Words on Amortized Analysis

See Chapter 5.1 of the Okasaki textbook for a summary of two approaches to amortized analysis, the banker’s method and the physicist’s method. Here, we will say just a few extra words about the accounting for the FastQueue implementation from before.

Recall that when evaluating the running times of functions, we often use symbolic constants instead of concrete units (such as seconds) in order to abstract away from low-level, incidental, and variable characteristics of an execution environment. And because Big-O analysis, furthermore, abstracts away the particular constants of a function, symbolic constants (such as k) are often replaced by particular small constants (such as 1).

Once comfortable with such reasoning, we can often jump directly to saying things like “the amortized cost of enqueue is 2” and “the amortized cost of dequeue is 1”. In the meantime, let us spend the extra effort to explicitly account for the actual (symbolic) costs of operations before reducing them to their asymptotic characteristics.

Actual Costs (t_i)

To avoid confusion with the notation c for credits from the textbook, here we will use the metavariable k to range over constants. Let the following constants stand for actual costs of the various operations on a Queue that contains m elements in the back list:

• k₁ is the cost of enqueue;
• k₂ is the cost of peek;
• k₃ is the cost of dequeue when List.reverse is not called (the cheap case); and
• k₄m + k₅ is the cost of dequeue when List.reverse is called (the expensive case).

Notice the actual cost of dequeue in the expensive case is linear in the size of the back list.

Amortized Costs (a_i)

We now revisit the amortized analyses from the textbook using the symbolic costs above.

Banker’s Method (a_i = t_i + c_i - c_i)

We allocate k₄ credits for each element added to the back, where k₄ was the cost for List.reverse to process one element.

• enqueue: k₁ + k₄ - 0 = k₁ + k₄
• peek: k₂ + 0 - 0 = k₂
• dequeue (cheap): k₃ + 0 - 0 = k₃
• dequeue (expensive): (k₄m + k₅) + 0 - k₄m = k₅

Thus, all of the operations run in O(1) amortized time.

Physicist’s Method (a_i = t_i + Φ(d_i) - Φ(d_i-1))

We define the potential to be k₄m where m is the length of the back.

• enqueue: k₁ + k₄(m+1) - k₄m = k₁ + k₄
• peek: k₂ + k₄m - k₄m = k₂
• dequeue (cheap): k₃ + k₄m - k₄m = k₃
• dequeue (expensive): (k₄m + k₅) + k₄0 - k₄m = k₅

Thus, all of the operations run in O(1) amortized time.

Reading

Required

• Okasaki, Chapter 5.1 and 5.6

Optional

• Okasaki, Chapter 5.3 (BinomialHeap.insert runs in O(1) amortized time.)