If Alice makes a followers-only post, and Bob replies to it, to whom should Bob's reply be visible?
Just visible to Alice unless she accepts the post. And she controls the visibility on her posts.
@BuckRogers1965 have you tried the ActivityPub plugin for WordPress? This is how it works; absolutely great stuff.