There are specific markings for changes in tempo. The most common ones are listed here.
Accelerando (gradually becoming faster)
Ritenuto (rit) (immediately becoming slower)
Rallentando or Ritardando (gradually becoming slower)
a tempo (return to the original tempo)