Brew installing wrong architecture for MacOS Sonoma w/Apple M1

Turns out I did have Rosetta enabled on my terminal, which meant brew was using an Intel setup. Disabling that, uninstalling and reinstalling brew (including all my programs/taps) fixed my issue.