Democratic chatter grows about ousting Nancy Pelosi