Should Passive Perception be lower?

Still, it’s not fun spending an action doing nothing, quite a few monsters have bonus action Hides while the only way to get that for players is to be a Rogue or a Goblin. Blindsight is only available at high levels with the exception of Blind fighting style and the Skulker feat, even then Blindsight can be quite limited in range if the enemy is a distance away.

If you don't want to spend an action searching, then you can take the Observant feat.

Quote from Frachese >>

If you don't want to spend an action searching, then you can take the Observant feat.

 True, but a feat’s a feat, it’s gonna be a tad of a challenge for non-wisdom classes that aren’t the rogue and fighter.