Some MLAs are considering leaving elected politics over the abuse they and their families face, BBC News NI understands.
The party said Mr Brown, first elected in 2022, was quitting due to "personal reasons".
The former DUP leader had sought to stand in the South Down constituency but was not selected.
It follows changes in Foyle, where two sitting MLAs including Martina Anderson were asked to step down.