If I had to drop one of them, it would be Max. Sam works with his one-liner observations. If you give Max nothing to bounce off of, his humor degrades to the level of the kind of person who thinks that speaking nonsense is the greatest form of humor.
There's a reason Sam is the one to generally comment on items and make conversation, with Max playing off that occasionally. Max's insanity does not work outside of a structured environment humor-wise.