You're thinking of the Highland Supper Club.  From what I understand, the Quarterback Club was near where Wendy's now sits.  A friend of mine tells stories about working there before the mall was around and describes it as a burger joint that was a popular hangout before the era of malls and fast food.

I vaguely remember a football shaped building.  Was it a lounge, serving alcohol?