There are two sources of travel rights involved:
- Those you have because you're a family member of a union citizen.
- Those you have because you hold a residence permit from a Schengen country.
The rights from part (1) generally depend on you accompanying or joining the union citizen.
The rights from part (2) don't. You may have your residence permit because you're a family member, but a residence permit is still a residence permit, and gives you the same rights other residence permit do.
Part of the rights from part (2) is to make short trips within the Schengen area up to 90 days of every 180. Since this is triggered purely by having a residence permit, you do not need to accompany your wife to use that.
For comparison, if you want to go to an EU state that is not in Schengen, such as Ireland, you'd need to depend on the rights that are only triggered by accompanying or joining a union citizen. (Due to your Article 10 residence card they may not require a visa from you, but as far as I understand the directive they could still decide not to let you in when you're traveling alone, same as they can refuse entry to any visa-free national who arrives at the border).