I agree. I do believe there is a good case to be made for why God would allow the ban to be put in place or even command the ban that's not because of any racist justification. However I don't think the vast majority of members understand this well enough https://twitter.com/LDSLivingMag/status/1358069832915288068

One of the reasons why the saints was kicked out of missouri and why Joseph Smith was eventually killed was because of fear that they would try and incite a slave revolt. There was also a fear that they would try and create a racially pluralistic society

The 'mormon' race became an official scientific classification. They were seen as 'white slaves' and were seen as a threat to their white american society.

When they came out west, tensions were high and at any moment the us army could come and wipe the church out

If the ban hasn't been put in place that might have just happened, given the context of antebellum America where 'slave revolts' and racial pluralism where huge concerns.

So initiation of the ban whether directly from God or orchestrated by BY and allowed by God was for survival