Welcome to our community

Be a part of something great, join today!

Markov Chain Problem


New member
Nov 29, 2018
I am new to Markov chain, i want to model this as a continuous-time Markov chain.

A wind turbine manufacturer would like to increase the throughput of its production system. For this purpose it intends to install a buffer between the pre-assembly and the final assembly of the wind turbines. The manufacturer can generate a profi t of 10.000 Euro per wind turbine. However, buffer spaces are also fairly expensive. The company estimates that one buffer space costs 5000 Euro per month. The production times for one turbine in the pre-assembly and in the final assembly are both exponentially distributed with a rate of 50. Again we assume that no failures occur, neither in the pre-assembly nor in the final production.

a) What is the optimal amount of buffer spaces the company should install? Determine the corresponding monthly pro ts.

b) Imagine the company realises that failures can occur in both, prea-ssembly and fi nal production. How would you model this production system?

The transition(production) rate of moving from a pre-assembly to final assembly is 50.

I really don`t know how to model this problem.


Staff member
Jan 26, 2012
Hi there,

Welcome to MHB!

I'm trying to think through this problem as it's not immediately clear to me but I have a hunch. It sounds like we have two exponential processes and this extra part is a bridge between the two. The best case would be that there is no waiting time in the buffer for the $(n-1)$ iteration to complete in the final-assembly. The worst case would be that all the buffer spaces are filled and that the pre-assembly needs to stop in order for the final-assembly to complete the $(n-1)$ iteration and for another buffer space to open up. The trade off between the two is the cost of the buffer.

Does that sound like a correct framing of the process?