Solve the integeral equation (C.S.I.R) Let $\lambda_1, \lambda_2$ be the eigen value and $f_1 , f_2$ be the coressponding eigen  functions for the homogeneous integeral equation
$$ \phi(x) - \lambda \int_0^1 (xt +2x^2) \phi(t) dt = 0 $$
Then


*

*$\lambda_1 = -18 - 6 \sqrt{10} , \lambda_2 = -18 + 6 \sqrt{10}$

*$\lambda_1 = -36 - 12 \sqrt{10} , \lambda_2 = -36 + 12 \sqrt{10}$

*$\int_0^1f_1(x)f_2(x) dx = 1$

*$\int_0^1f_1(x)f_2(x) dx = 0$
I have solved simply and get the values of $\lambda_1 \ \ and \ \ \lambda_2$ belong to (1).
Please tell me about (3) and (4) option.
Thank you.

Let's rewrite your equation in the following form:
\begin{align}
\frac{1}{\lambda}\phi(x) = x\int_{0}^{1}t\phi(t) \mathrm{d}t + 2x^{2}\int_{0}^{1} \phi(t) \mathrm{d}t = c_{1}x + c_{2}x^{2}
\end{align}
for $c_{1}: = \int_{0}^{1}t\phi(t) \, \mathrm{d}t$ and $c_{2}:= 2\int_{0}\phi(t)\, \mathrm{d}t$. From this we can see that $\phi$ is a quadratic polynomial with no constant term.
Substituting $\phi(x) = c_{1}x + c_{2}x^{2}$, we find that 
\begin{align}
\frac{c_{1}}{\lambda} x + \frac{c_{2}}{\lambda}x^{2} 
&=x \int_{0}^{1} t(c_{1}t+ c_{2}t^{2}) \, \mathrm{d}t + 2x^{2} \int_{0}^{1} c_{1}t + c_{2}t^{2} \, \mathrm{d}t \\
&=x(c_{1}/3 + c_{2}/4) + 2x^{2}(c_{1}/2 + c_{2}/3)
\end{align}
so that 
\begin{align}
\frac{c_{1}}{\lambda} &= \frac{c_{1}}{3} + \frac{c_{2}}{4} \\
\frac{c_{2}}{\lambda} &= c_{1} + \frac{2c_{2}}{3} \\
\end{align}
It can be verified that if both $c_{1}$ and $c_{2}$ are nonzero, then $\lambda = -18 \pm 6\sqrt{10}$. 
Since $c_{1} = \left(\frac{1}{\lambda} - \frac{2}{3}  \right)c_{2}$
\begin{align}
f_{1}(x) &= -\left(\frac{1}{18+6\sqrt{10}} + \frac{2}{3}\right)c_{2}x + c_{2}x^{2}
= -\frac{1}{6}(1+\sqrt{10})c_{2}x + c_{2}x^{2} \\
f_{2}(x) &= -\left(\frac{1}{18-6\sqrt{10}} + \frac{2}{3}\right)c_{2}'x + c_{2}'x^{2} = -\frac{1}{6}(1-\sqrt{10})c_{2}'x + c_{2}'x^{2}
\end{align}
so that 
\begin{align}
\int_{0}^{1} f_{1}(x)f_{2}(x) \, \mathrm{d}x
&=
c_{2}c_{2}' \int_{0}^{1} x^{4} -\frac{1}{3}x^{3} - \frac{1}{4}x^{4} \, \mathrm{d}x = \frac{c_{2}c_{2}'}{30}
\end{align}
So we can't claim that these eigenfunctions are orthogonal, or that their inner product is 1, unless we choose a scaling such that $c_{2}c_{2}' = 30$. 
