Stuart Andrew met with Anglian Water chief executive to seek an explanation for regular water outages.
Police say three offenders took the two-wheeled and three-wheeled carts from a yard on Friday.
Anglian Water says households should limit water use for essentials such as drinking and washing.