I was never a Lou Reed/Velvet Underground fan. By the time I heard of them, Sterling Morrison was a graduate student at UT and the Velvet Underground was old news. Old news just didn't carry so long then, and there was always something else and something new to listen to.
One funny thing about Walk on the Wild Side, I was in Vernon, Texas, in high school when it came out, and there was only AM radio. To listen to music I mostly listened to AM out of Wichita Falls, and they played Walk on the Wild Side pretty regularly between 1972 and 1974. It was the strangest thing to hear. I always figured it was so completely out of bounds that no one ever figured out what the song was about, but it oddly left me with the impression that Lou Reed was a novelty act, chosen as a joke by the hip and worldly disc jockeys in Wichita Falls, Texas. I don't think I ever recovered from that impression, and I never really got back to him.
RIP.