I’m in the process of redoing the shelf pages (see here), but that should still theoretically work.
There are 2 different platform filters. The first one is called Platform on shelf which is being renamed to “Owned platforms.” That would filter your shelf by games that you marked what platforms you own the game on. The second platform filter is the All platforms filter. That’s the one you’d want to use to see what games on a given shelf are available on the PS4 platform.