I've had a hard time thinking of some abyss encounters so feel free to post some ideas

Abyss encounters, huh? I've heard of it, but never really looked into it. I have been told that I'm great with encounter building, so if you could fill me in on what it is, that would be great.

Here's a page that will explain the Abyss

I'm thinking something like your party stumbling across a small maze, with your standard death traps dispersed in it, but at the centre of the maze you find 3 Bulezau, minotaur-like demons who aren't that bright. With a CR of 3, they're good for a 3 to four person party of level 2 - 3.

Hope that helps!

I could add that in to Baphomets endless maze

That could work. But remember, if it's Baphomet's maze, sprinkle in some of Baphomet's creations throughout the maze. Also, if it's endless, put a puzzle in a special place guarded by some monsters, and put some nice loot in the centre of the maze, if they ever find it. If the make it there, kill everything, and take all the loot, you could probably put that into the next part of the story, with a demon opening a portal into the centre and then realising that he has guests. Just an idea, though.

Thanks, What encounters do you think Grazzt would have in his palace

There are many old adventurers in previous editions in abyss. You can find them on DMs guild. The most recent one being “Kingdom of the Ghouls” I believe, which can be easily adopted to most settings.

Quote from DRAGOLICH12 >>

Thanks, What encounters do you think Grazzt would have in his palace

 Succubi, as well as lamias. Possibly some mariliths as well.

What do you think orcus would use in his lair