9

Suppose there is a test with $n\geq1$ questions. For each question, there are no descriptions for either the questions or the choices for the answer, just $k\geq1$ choices to choose from, in which exactly one of them is correct. (This condition is to make sure that the answers can only be guessed.) For each submission of the test, any number of questions can be answered, and the score for that submission would be announced, but not which answers are correct or wrong. What are the optimal strategy and the maximum number of submissions in the worst case needed to get a full mark for any $n$ and $k$?

  • Interesting question ! I think this is very similar to the following problem. You are given a graph, and want to find a "hidden" vertex by asking queries about how far the "hidden" vertex is from specific vertices. In this case our graph would be the one with vertices ${1,\dots,k}^n$ where edges exists between tuples that differn inexactly one coordinate. – Asinomás May 09 '21 at 16:41
  • 1
    Oh, this is also similar to https://en.wikipedia.org/wiki/Mastermind_(board_game) now I think about it – Asinomás May 09 '21 at 16:42
  • 1
    what is the best strategy you have right now? – Asinomás May 09 '21 at 17:03
  • 1
    @HereToRelax In mastermind, the order doesn't matter. In this, it does. – Calvin Lin May 09 '21 at 17:12
  • 3
    See https://math.stackexchange.com/q/1058194/177399 for the $k=2$ case, i.e. a True/False exam. – Mike Earnest May 09 '21 at 17:13
  • Mike's linked solution to the $k=2$ case gives at least an upper bound, since a multiple choice test has weakly fewer possibilities than a true false test where each question corresponds to one of the multiple choice answers. – Frank Seidl May 09 '21 at 18:36

1 Answers1

3

For $k=3$, I think this gives $(m+3)×3^{m-1}$ questions using $2×3^m$ practice exams. By tripling the number of practice exams, I can triple the number of questions, and sneak in one more question for each block of six practice tests. It follows the idea in @MikeEarnest reference.
Let the three answers be $a,b,c$.
If $T$ is a practice test, let $S(T)$ be the test with all a's replaced by b's, all b's replaced by c's and all c's replaced by a's. Let $P(T)$ be test with a's replaced by c's, b's by a's and c's by b's.
Let w(T) be the number of correct answers in T, called the weight of $T$. Let $|T|$ be the number of questions in T. Then $$w(T)+w(S(T))+w(P(T))=|T|$$ So, if we know two of the weights of $T, S(T)$ and $P(T)$, we know the third.
Let A,B,C be three sets of $M$ questions each. We want the weights of 2N tests for A, namely $A_i, S(A_i),i=1..N$, and similar for B and C.

Let $D_i$ be a single question. There will be a total of $N$ $D_i$.

Do the following six tests on $3M+1$ questions:
$$W_{1,1}=w(A_i+B_i+C_i+D_i)\\ W_{1,2}=w(S(A_i)+S(B_i)+S(C_i)+S(D_i))\\ W_{2,1}=w(A_i+S(B_i)+P(C_i))\\ W_{2,2}=w(S(A_i)+P(B_i)+C_i))\\ W_{3,1}=w(A_i+P(B_i)+S(C_i))\\ W_{3,2}=w(S(A_i)+B_i+P(C_i))$$ Now $$W_{1,1}+W_{2,1}+W_{3,1}=3w(A_i)+|B|+|C|+w(D_i)\\ W_{1,2}+W_{2,2}+W_{3,2}=3w(S(A_i))+|B|+|C|+w(S(D_i))$$ so from $\pmod3$ we know the answer to $D_i$ and can remove it from $W_{1,1}$ and $W_{1,2}$. Then we know $w(A_i)$ and $w(S(A_i))$.
The weights for $B_i$ and $C_i$ can be found similarly because we know $w(B_i)+w(S(B_i))+w(P(B_i))=|B|$.

So, from $M$ questions solved in $2N$ tests, we get $3M+N$ questions solved in $6N$ tests. Starting with one question solved in two tests, that gives $(m+3)3^{m-1}$ questions solved in $2×3^m$ tests.

This works for prime $k$.
If $k\ge5$ then we can put in a second extra question, add $E_i$ to $W_{1,1}$ and $W_{2,1}$, and $S(E_i)$ to $W_{1,2}$ and $W_{2,2}$, $SS(E_i)$ to $W_{1,3}$ and $W_{2,3}$ and so on.
Working $\pmod k$, we get $$ \text{$0$ if $D_i$ and $E_i$ are wrong,}\\ \text{ $1$ if $D_i$ is right and $E_i$ wrong,}\\ \text{ $2$ if $E_i$ is right and $D_i$ is wrong, and}\\ \text{ $3$ if both $D_i$ and $E_i$ are right.}$$

In general, this gives $(\lfloor\log_2 k\rfloor m+k)k^{m-1}$ questions from $(k-1)k^m$ tests.

Empy2
  • 52,372