The correct definition is this:
For each cell $C$ of $X$ there exists a map $\phi_C : D^n \to X$ such that $\phi_C$ maps $\mathring{D^n}$ homeomorphically onto $C$. The map $\phi_C$ is called the characteristic map of $C$.
Some authors call the cells of a CW-complex "open cells". However, this may lead to confusion because the cells are in general no open subspaces of $X$. The reason for this notation is that they homeomorpic to open disks.
A closed cell is usually defined as the closure $\overline C$ of a cell $C$.
- Each closed cell $\overline C$ is compact.
Proof. $\phi_C(D^n)$ is compact, it is closed in $X$. Since $C \subset \phi_C(D^n)$, we conclude that $\overline C \subset \phi_C(D^n)$. Hence $\overline C$ is a closed subset of a compact space, thus compact.
- $\overline C = \phi_C(D^n)$. Thus the closed cells are the images of the characteristic maps of the cells. [This result can be taken as an alternative definition of closed cells.]
Proof. We already know that $\overline C \subset \phi_C(D^n)$. Since $\phi_C$ is continuous, we conclude (see eg. here)
$$\phi_C(D^n) = \phi_C(\overline{\mathring{D^n}})\subset \overline{\phi_C(\mathring{D^n})} = \overline C .$$
- For $n > 0$, the $n$-cells $C$ of $X$ are not closed in $X$. Thus $C \subsetneqq \overline C$.
Proof. $C \approx \mathring{D^n}$ is not compact. If $C$ were closed then it would be compact (as a closed subset of $\phi_C(D^n)$ which is compact), a contradiction.
Remark. The $0$-cells are closed one-point sets. This comes from the fact that $\mathring{D^0} = D^0$ which is a one-point space.