math/manifold: remove

I have a WIP to upgrade BRL-CAD, and manifold is intended to be one of
its dependencies, but I’m currently blocked, and it is not yet ready.

See https://github.com/BRL-CAD/bext/issues/3
and https://github.com/BRL-CAD/brlcad/issues/188