Shouldn't be, I use 115k serial ports all the time.  Sure the fifo's
are on?  Sure they are at 16?  Look at the uart code.