It's certainly possible, there's already a company[1] that sells cameras with this modification performed. And a few cameras that come from the factory with no Bayer filter, like the Leica Monochrom, but all the ones I know of are very expensive.

[1] https://maxmax.com/shopper/category/9241-monochrome-cameras