No, you did not miss anything.
Lee heard the answer machine, which said they were at the hospital and couldn't leave.
Clem never heard those messages. She thinks they are at the Marsh House.
I don't know what Lee is thinking taking her there. Maybe it's just to make her feel better. Maybe he wants to look for supplies and thinks it's a nice place to rest.
Nobody knows what Lee's motives are.