I never had any French lessons and I have been traveling in France, often solo, every now and again in the last 35 years or so.
I never ran into trouble, the only time I was told to speak French (as an order rather than as a request) it was by French Canadians being loud in the hostel at night (and in that case I am pretty sure they did understand my English.)
Sometimes people ask if I do speak French and when I say no, we find a way to communicate. Often by finding someone who speaks English as well as French (or Dutch as well as French as Dutch is my native language) or we struggle with what each of us knows in the languages the other can understand.
Dealing with travel officials, you will notice that these days almost all speak some English, in the past you would find one person with a button 'I speak English' in the information office in the main station in Paris for trains to the north of France, Belgium, the Netherlands and to the ferries to England (no tunnel yet.) On my last visit all in the office spoke English and mostly at a high level.
My impression is that all of France has gone through that change. In the 1980's and 1990's the people were willing but most of them did not speak any English or not enough to dare speak with a foreigner.
I think I have been in Toulouse, in the '90's but it did not stand out as special language wise. I have been in many smaller and bigger villages and towns, as well as in some of the cities and I see the same pattern all over.
If tourists are common, English is spoken in most shops and public transport. If it is a town or part of town where fewer tourists come, you may have to find younger people to help you translate. Young French people also use the world wide internet sites the English and other Europeans do, and I think they are picking up and improving their English as a result.
These days almost all young people speak some English and a lot of them speak it well, and many people who were young in the '80 and '90 are secure enough in their English to be happy to use it.
In the last 10 years or so I have been part of a group having a meeting in France once a year. As part of the meeting we set up a show in a local museum or community center or some such.
And invite the local people in.
Our group is mostly French but has a strong English and Dutch membership. Some of our English and Dutch do speak French and speak it well, the rest does not speak French much or at all. Some of our French people do speak English (and some also German) as well as French, so people who can translate are mostly not far away.
But it is amazing how few people in France can not handle a simple face to face talk about what is on show, with only a few words of French from me and a few of English from them.
I have had a few people who just look and walk on but I have never had people getting angry because us foreigners took over their local museum or hall. Mostly they do express gratefulness that foreigners have taken the time and effort to come to them and share their passion.
The general level of English in France is way better than the general level of French in England.