Munroe Library on London Street will be closed for several weeks after a water pipe burst.