If the other team is just better than you (as evidenced by them winning 10-20+ more games than you during the season) and they're taking all of the games seriously/playing at their best, they should sweep you.
Anyone seeded 3-6 should never get swept though. Only occasional exceptions should be made for 7 seeds.