Edit:
Yes, as of this week I did have internet access through the on-board Wi-Fi on an ICE train while in France. The connection quality was not great, but neither was reception on my phone at the same time.
Old answer:
No, as of today no Wi-Fi/Internet is available yet on the parts of the journey of these trains that are outside of Germany.
Sources:
- personal experience
- DB support confirmed via Twitter, but added that the service shall be extended to some international connections this year. No more info was available