Let $X$ be a topological space and let $A \subseteq X$.
Definition 1. $A$ is relatively compact in $X$ if the closure of $A$ in $X$ is a compact subspace.
The above is standard, but there are some prima facie weaker conditions that are sometimes useful. For example:
Definition 2: $A$ is relatively compact in $X$ if there exists a compact $K$ such that $A \subseteq K$ and $K$ is contained in the closure of $A$ in $X$.
Definition 2'. $A$ is relatively compact in $X$ if there exists a compact $K \subseteq X$ with $A \subseteq K$.
We could even not bother having an actual compact subspace:
Definition 3. $A$ is relatively compact in $X$ if every open cover of $X$ has a finite subset that covers $A$, i.e. given open $U_i \subseteq X$ ($i \in I$) such that $X = \bigcup_{i \in I} U_i$, there is a finite $I' \subseteq I$ such that $A \subseteq \bigcup_{i \in I'} U_i$.
Clearly, definition 1 implies definition 2, and definition 2 implies definition 3. Furthermore, definition 2 and 2' are equivalent because closed subspaces of compact spaces are compact. Compact subspaces of Hausdorff spaces are closed, so if $X$ is Hausdorff, then definitions 1 and 2 are equivalent.
Question. Does definition 3 imply definition 1 in general? What if $X$ is Hausdorff, or $A$ is open?
Definition 3 is closely related to exponentiability: $X$ is exponentiable if and only if for every open $V \subseteq X$ and every $x \in V$ there is an open $U \subseteq V$ such that $x \in U$ and $U$ is relatively compact in $V$ in the sense of definition 3. When $X$ is Hausdorff, $X$ is exponentiable if and only if $X$ is locally compact.