If you delete the entire contents of a quote block when responding to a forum post, the empty quote block is still there. Pressing backspace doesn't delete it, and there seems to be no way to get rid of it.
After a little more experimentation, I've found that you can change the formatting of the current paragraph using the button with the paragraph formatting mark and selecting "text."
Given that the browser version allows deleting quote blocks with backspace, I'm still not sure the behavior on Android is intentional, but at least there's some way to get out of the quote block.
So, I am able to delete the quote fully on desktop. It goes all the way to the beginning, then stops. After pressing delete again, the purple bar vanishes. So..it must be some other set of variables causing it. If you could show me a video of it happening, I'd love to see it.
In particular, I would not be surprised if the presence/absence of other text (before or after the quote) causes an issue, or perhaps the specific contents of the quote itself.