Yes, they are. Let $A$ be stochastic square matrix as below and $\operatorname{perm}(A) = 1$. Observe that
$$1 = \operatorname{perm}(A) = \sum _{f \in S_n} \prod_{i=1}^n a_{i, f(i)} \leq \sum_{f \colon [n] \to [n]} \prod_{i=1}^n a_{i, f(i)} = \sum _{f_1, \ldots, f_n = 1}^n \prod_{i=1}^n a_{i, f_i}
= \prod_{i=1}^n \left(\sum _{j=1}^n a_{k,j}\right) \leq 1 $$
where we fist just added more (positive) elements to the sum, and use the fact that $\sum\limits_{j=1}^n a_{k,j} \leq 1$.
Subtract $1$ of both sides of inequality, and get
$$0 \leq \sum _{f \colon [n] \to [n]\\f \notin S_n} \prod_{i=1}^n a_{i, f(i)} \leq 0$$
For every pair $i \neq j$, and any column index $k$. we can prove that (at least) one of $a_{i,k}$ and $a_{j, k}$ must be zero:
It follows from the inequality above that
$0 = \prod_{i=1}^n a_{i, f(i)} $
for any $f$, which is not bijective.
Take such $f$, that $f(i)=f(j)=k$ and $a_{s, f(s)} \neq 0$ for $s \notin \{i, j\}$ (such function exists, because at least one element in each row must be nonzero).
That means that one of $a_{i,k}$ or $a_{j,k}$ must be zero. From that it is clear to see that in each column, no more than one element must be nonzero.