a book that feels like a late-night conversation

I'm looking for a book that doesn't feel like a formal story, but more like you're sitting with the author at 2 AM while they tell you something raw and true. Something personal, meandering, and deeply human.

The last book that gave me this feeling was M Train by Patti Smith, it's like listening to a brilliant friend's memories and musings.

What's a book that made you feel like you were let in on a secret?