Most web sites on "ancient computers" don't go back far enough in time for my tastes. Read about the truly pioneering days.
Freely downloadable RAND Research Memorandum The History of the JOHNNIAC (http://www.rand.org/pubs/research_memoranda/RM5654/) (about 6.4M).