Does limit means replacing $x$ for a number? I don't understand limit so much. For example I see $\lim_{x \to -3}$. And I always just put $-3$ everywhere I see $x$. I feel like I'm doing something wrong, but it seems correct all the time.

Substitution "works" many times; it works but not always: $$\lim_{x\to a} f(x) = f(a)\quad \text{${\bf only}$ when $f(x)$ is defined and continuous at $a$}$$
and this is why understanding the limit of a function as the limiting value (or lack of one) when $x$ is approaching a particular value: getting very very near that value, is crucial. That is, $$\lim_{x \to a} f(x) \not\equiv f(a) \qquad\qquad\tag{"$\not \equiv$"$\;$ here meaning "not identically"}$$
E.g., your "method" won't work for $\;\;\lim_{x\to -3} \dfrac{x^2 - 9}{x + 3}\;\;$ straight off.
Immediate substitution $f(-3)$ evaluates to $\dfrac 00$ which is indeterminate: More work is required. Other examples are given in the comments. 
When we seek to find the limit of a function $f(x)$ as $x \to a$, we are seeking the "limiting value" of $f(x)$ as the distance between $x$ and $a$ grows increasingly small. That value is not necessarily the value $f(a)$.
And understanding the "limit" as the "limiting value" or lack there of, of a function is crucial to understanding, e.g. that $\lim_{x \to +\infty} f(x)$ requires examining the behavior of $f(x)$ as $x$ gets arbitrarily (increasingly) large, where evaluating $f(\infty)$ to find the limit makes no sense and has no meaning.  
