This question arose from a discussion between me and TimWescott in the comments here. The question is:
Does \$H(j\omega) \$ exist for systems with poles in the RHP (unstable poles)?
My own answer to this question is no. If there is even one pole in the RHP, then the Laplace integral doesn't converge for \$s=j\omega \$, the system is unstable and \$H(j\omega) \$ is meaningless. A quote from signal processing and linear systems by Lathi seems to support me.
Math example
Say we have a system \$F(s)=\frac{1}{2-s} \$ with a pole at \$s=2 \$. In the time domain this function is \$f(t) = -e^{2t} \$. Let's try to evaluate the Laplace integral for this function.
$$F(s) = \int_{0}^{\infty}f(t)e^{-st} \: dt= \int_{0}^{\infty} -e^{2t}e^{(-\sigma-j\omega)t} \: dt$$ $$F(s) = \int_{0}^{\infty}-e^{(2-\sigma-j\omega)t} \: dt $$ If we want to find the frequency response for the system, we need to evaluate the integral on the imaginary axis, where \$\sigma = 0 \Rightarrow s=j\omega \$. $$F(j\omega) = \int_{0}^{\infty}-e^{(2-j\omega)t} \: dt $$ As can be seen, we end up with a growing exponential term inside the integral, and \$-e^{2t}\rightarrow -\infty \: \text{for} \: t\rightarrow \infty \$ which causes the integral to not converge, and therefore \$F(j\omega) \$ is meaningless.
It might be that my reasoning is wrong, and if so, I would appreciate being corrected. I just want to understand the premise and prerequisites of the Laplace transformation.