If $G$ is a finite group, $H$ is a subgroup of $G$, and $H\cong Z(G)$, can we conclude that $H=Z(G) $? 
If $G$ is a finite group, $H$ is a subgroup of $G$, and $H\cong Z(G)$, can we conclude that $H=Z(G) $?

I learnt that if two subgroups are isomorphic then it's not true that they act in the same way when this action is related to outside groups or elements.  For example, if $H \cong K $ and both $H,K$ are normal of $G$ then it's not true that $G/H \cong G/K$.  Also, there is sufficient condition (but not necessary, as I read after that) for there to be an automorphism that, when restricted to $H$, induces an isomorphism between $H$ and $K$.
Now, is this true in this case? or is the statement about center and its isomorphic subgroups always true? 

No. A subgroup may be isomorphic to the center of a group without being the center of the group.
The dihedral group of order 8 provides a counter-example. It has many subgroups of order 2, but only one of them is the center.
More specifically, take $G=\langle (1,2,3,4), (1,3) \rangle \leq X = S_4$. Then $Z(G) = \langle (1,3)(2,4) \rangle$ is conjugate to $H = \langle (1,2)(3,4) \rangle \leq G$. Not only are $Z(G)$ and $H$ isomorphic subgroups of $G$, but they are even conjugate in $X$.
This is a very strange thing! An automorphism of $G$ must take the center of $G$ to the center of $G$. If $G$ is a normal subgroup of $X$, then conjugation by any element of $X$ takes the center of $G$ to the center of $G$. We might suspect that conjugation (a special type of isomorphism) does a better job of respecting the center than an arbitrary isomorphism.
In this case $G$ is not normal in $X$, but $(2,3) \in G$ conjugates $Z(G)$ to $H$ and acts as an automorphism of the subgroup $H \times Z(G) = \langle (1,2)(3,4), (1,3)(2,4) \rangle = K_4 \unlhd X$.
A group $X$ is called $p$-normal, if whenever $G$ is a Sylow $p$-subgroup of $X$, $x \in X$, and $Z(G)^x \leq G$ then $Z(G)^x = Z(G)$. They were studied by Grün in some fundamental work on fusion which says in a $p$-normal group, all conjugation by $X$ of subgroups of $G$ is in some sense controlled by those $x$ that leave $Z(G)$ alone. That is, if $H$ and $H^x$ are both subgroups of $G$, then $H^x = H^y$ for some $y \in N_X(Z(G))$. Groupprops has a similar statement, and so do most textbooks on finite groups. Alperin's fusion theorem is a version that works for all groups. It says we only have to look in $N_G(Q)$ for $Q \leq P$ that are big enough to hold conjugates of $H$. In our example, we only had to look at $N_G(Q)$ for $Q=K_4 = H \times Z(G)$.
