There has never been a better time to support musicians directly. The next Bandcamp fee waiver day is June 5, and many artists sell merch and records on the web. You can still buy albums on iTunes, too, in the way your great aunt told you stories about.
I’ve purchased about a half-dozen albums over the past couple of months between physical CDs and iTunes purchases, which is much more than I typically do. If you’re able to support your favorite musicians right now, I would encourage you to do so.