Yes, you can.
For details on how to configure this, see the applicable manual.
▼Limit Login to SSO / Remove Limit (Web Browser)
https://teachme.jp/8/manuals/51167209
※This cannot be applied only to specific users or access from specific apps, nor can such users or apps be excluded from the scope.