Yes. If you're powering the camera from an external source via the USB-C cable, you can remove the internal battery and run the camera via external power. The camera will continue to work normally.
An advantage of leaving the internal battery in place is as a safety net in case the external power stops flowing. Without the internal battery, the moment that the AC power stops, the camera will turn off. It won't turn back on automatically when the power source is restored. With the internal battery installed, it will switch over seamlessly. But there are times where removing the battery might be a better option, especially for very long-term shooting such as timelapse.
External Power Indicator
Usually, when you connect external power you'll get the charging battery indicator. Without any internal battery to charge, though, there's a different icon on the front screen. It looks like this: