Here is my reasoning so far: $A$ is a infinite set and $B$ is a finite subset of $A$, therefore $B\subset A$.
If $C=A\setminus B$ that means that $C$ also is infinite and also, $C\subset A$.
Though, how could one prove that there is a bijection between $A$ and $C$?