Liberal Democrat council leader Christine Wise says she thinks there was a campaign to remove signs.
Documents say a new extension will house a multi-purpose hall and new galleries.
A new leader for Rutland County Council will be elected at a meeting on 26 March.
A £6m project would see Rutland County Museum extended to house the world-famous ichthyosaur.
The Conservative group had brought the motion that was discussed at a special meeting on Tuesday.
The head of the authority could go in a dispute over the handling of government reforms.
Two representatives say they saw work being carried out without cones around the affected area.
Campaigners say the budget just approved offers no assurances about the future of their library.
Ashley Baxter, leader of South Kesteven District Council, suggests merging with Rutland.