The other day I posted this math question Coin Toss Games with Changing Coin Probabilities but I think it was too long. I am now trying to make a shortened and simpler version.
- Suppose there is a machine with 5 engines.
- At turn=0, the probability of each engine failing is 0.5
- Each turn, the probability of a given engine failing increases by p_current+0.01
- Once an engine has failed, it can never be repaired.
- The machine stops working when all 5 engines have failed
Question: Given the current state of the system (e.g. turn = $k$, number_of_working_engines = $j$ , $P_1 = p_1, P_2 = p_2, ... P_j = p_j$), is it possible to derive a probability distribution for the expected number of turns before the entire machine fails?
I tried to represent this problem mathematically in 3 parts:
Part 1: Probability of each engine ($E_i$) working (1 = working) at time $t+1$ given the state at $t$
$$ P(E_{i,t+1} = 1 | E_{i,t} = 1) = 1 - (p_t - 0.01) \quad \text{for} \quad i = 1, 2, 3, 4, 5 $$
$$ P(E_{i,t+1} = 0 | E_{i,t} = 1) = p_t - 0.01 \quad \text{for} \quad i = 1, 2, 3, 4, 5 $$
$$ P(E_{i,t+1} = 0 | E_{i,t} = 0) = 1 \quad \text{for} \quad i = 1, 2, 3, 4, 5 $$
Part 2: Probability of having $k$ working engines at time $t+1$ given the state at $t$
$$ P(N_{t+1} = k | N_t = k) = 1 - k \cdot (p_t - 0.01) \quad \text{for} \quad k = 1, 2, 3, 4, 5 $$
$$ P(N_{t+1} = k-1 | N_t = k) = k \cdot (p_t - 0.01) \quad \text{for} \quad k = 1, 2, 3, 4, 5 $$
Part 3: Probability of the machine ($M$) working in general at time $t+1$ given the state at $t$
$$ P(M_{t+1} = 1 | N_t = k) = 1 - (k \cdot (p_t - 0.01))^k \quad \text{for} \quad k = 1, 2, 3, 4, 5 $$
But from here, I am unsure how to solve this problem apart from numerical simulation. Perhaps a Birth-Death process can be used to model this problem?
Can someone please show me how to start working on this problem from a theoretical perspective?