Along with re-usability, I've been wondering if horiontally oriented vertical launches would create a major cost-savings.
No. It is not feasible and a bad idea. The engines for supporting the front of the vehicle would be useless mass after rotation. The launch vehicles are not designed to loads horizontally. They can't even support themselves horizontally when loaded with propellant.