JoErNanO's answer should be seen as a canonical reference point for obtaining hard-copy rail/tube maps. With his permission I am submitting another answer that provides an alternative source for hard-copy maps that show National Rail connections.
Free Glossy Visitor Magazines
These are magazines that are given away for free at train stations, airports, kiosks, hotel lobbies, and so on. They have great rail/tube maps and surface maps in the back section.
In addition to transport maps and surface maps, these magazines will also usually provide...
- The Santander Bicycle Hire locations for people who want to gad about
on a bicycle
- Tube stations with toilets (quite valuable sometimes)
- An explanation of the zones in the Transport for London system
- An explanation of how Oyster Cards work
- Instructions on how to reach Heathrow, Gatwick, Luton, and Stansted
- Integration with National Rail services (see 'London Planner' below)
The tube map is always the iconic schematic map originally conceived by Harry Beck in 1933. The surface maps show the transport stations (including National Rail) along with prominent features of interest to a visitor.
I will give two examples of 'free glossy visitor magazines'...
Where London - available in hotel lobbies or by asking the concierge. The tube map is displayed on a single page along with tips and contact information. See the reduced image below for a view of how it is presented...
The surface maps show the physical site of each tube station. National Rail connections have a special symbol. Below is a highly cropped image showing some of the symbols and how transport stations are presented...
London Planner - available at train stations (including Eurostar stations on the continent), hotels, bus companies, tourist hotspots, and so on.
This magazine uses two pages to present the tube map.
They also provide a bus map and a river services map ('water buses' are part of the Transport for London system and you can travel on these with an Oyster Card. One such route very popular with tourists who know about it is the boat ride from Canary Wharf/Docklands to the Embankment)...
The surface maps combine every conceivable type of transport available to the public. This includes the transfer points for National Rail services presented as one integrated network. They also print a stand-alone 'Overground Map' which is devoted to National Rail and uses the same Harry Beck design.
The above map (reduced from actual size) shows THREE national rail stations: Marylebone, Paddington, and Shepherd's Bush.
And finally, Time Out Magazine is handed out on Tuesday mornings by individuals wearing orange jerkins. This is also free and contains the Harry Beck Tube Map along with several variants.
That gives you three samples of how to find rail and tube maps if you are not near a train station. As mentioned some of these are available on the continent and at Heathrow/Gatwick. There are lots more, but these three are most well known.
For your purposes, I would go with the 'London Planner' (because of the overground map); you can subscribe on their site or just pick up a copy for free. Since you are interested in the static part of the magazine and not buzzy part you will be able to use a back issue for a long time.
Note: images taken from the August issues (the physical real magazines and not the downloadable versions on the net) and reduced. Copyright Morris Visitor Publications and London Partners, fair use.
Note: I have no connection to the commercial enterprises listed in this article, economic, personal, or otherwise
Per commentary I recognize that people may have difficulty recognizing a national rail station when it is depicted on a map. Consider this snap shot from 'London Planner'...
In this fragment, there are two national rail stations shown: Charing Cross and Waterloo. They can be distinguished by their medium blue colour and the national rail icon. In case you forget, you can always refer to the map legend, which contains the symbols...