I run a similar build, but use Frost bolts on the cross bow. This can supplement the grenades so you can be less stingy with them.
I thought about it too but I preferred being able to kill stuff, so I took Boomstick instead