I my self am partial to camping. I found this really great website, it gives you some of the best camp grounds in california. Im pretty sure these camp grounds have nothing to do with RV's. In many of these places it looks like there is hiking and fishing. Here is the link
http://www.camprrm.com/California%20Campgrounds.htm.