I would like to rent a car in Yerevan airport, drive it through Armenia, go to Georgia and leave the car in Tbilisi.
Are there any companies who offer that kind of service?
Hertz does, although I haven't tried myself. You can check Hertz's Armenian website (in English), where you'll also get the price and be able to book this exact service.
Hertz's Terms and Conditions even has a special section on renting in One Direction specifically for Georgia.
From my experience I will like to advise you NANIKO car rental in Armenia. You can rent a car in Yerevan and leave it in Tbilisi. Also as I compared early (5 month ago) NANIKO was cheapest, so highly recommended.
Thank you for your interest in this question.
Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).
Would you like to answer one of these unanswered questions instead?