I think the major reasons people don't like him is because he led the bandits to invading the Motor Inn, and he ended up leaving Clementine in the street in episode 4.
All hail King Toasty!
I am starting a new series on YouTube where I answer questions you might have on the Walking Dead. I will answer questions, speculate theories, and other stuff like that. Send questions!