Old scientific theory be abandoned

Under what conditions should an old scientific theory be abandoned? Under what conditions should a new scientific theory be embraced? Is science rational? Rationally progressive? Why or why not? Is scientific knowledge even possible?