The attempted theft happened at the town of Kristianstad's district court, The Local reports.
The alleged thieves cleaned out the courthouse break room, taking tea, coffee and sugar before taking the toilet seat and attempting to make an escape.
Mikael Persson of the Kristianstad police told Kristianstadbladet: "It's been said they had been at a hearing. They clearly thought what was said was crap."
The two attempted robbers, a man and woman aged 38 and 24 respectively, were also caught on camera attempting to break into a storage locker.
The pair are now being held under suspicion of robbery and attempted robbery.