Sounds like your mix is weak, should be at least 50/50 w real dirty brick..when you say you tried to "hit it a couple times" do you mean with more of your mix or w a little pressure using your pressure washer?
Will be interested to see the before and after pic's. There's no reason those bricks...