Why does the ability to challenge work so well in football but baseball is reluctant to incorporate this means?

I understand how baseball can't rely on replay w/ runners on base but when no one's on, why not allow the manger to challenge the call? Also, it would substitute the time it takes for a manager to argue w/ the ump for reviewing the play.