Suggest me a book about an affair that lasts decades

Something in the vein of Brokeback Mountain IE married people have relationships with other married people but never get together in the end. Orientation doesn't matter, but good prose does–I prefer literary fiction. American setting also preferred. Thank you.