From HostThyself

How to tuning Apache for optimum performance in a memory limited VPS is very different from a full muscle dedicated server with loads of memory.

The Apache Performance Tuning documentation is a good place to start understanding the various parameters that you can tune in the configuration file.