if you're concerned that white authors are taking your voice (and how did the "appropriation" debate get warped into that?), the solution is not to tell white people to stop writing, but to write the stories you want to hear and then promote them ahead of those white authors. you'll need to convince the academies in the process.
but, i ultimately don't see how a fiction writer taking on a viewpoint of somebody that is not them is in conflict with a historian of a particular culture, as though only one is allowed to work in some kind of zero sum game, or how opening up more space for certain types of story-telling requires that another type of story-telling cease altogether.
and, this is the problem that free speech liberals are continually expressing against these confused sjws and progressives on the right: arguing for greater inclusion does not and should not mean shutting people down. there's really not even any reason for there to be an argument, as few people nowadays are going to argue against the premise that there should be a broader inclusion of representative voices. the point where liberals push back against conservatives and progressives is when you start trying to police what people type.
and, i'm sorry - if you think such policing is ok, then you're wrong.