When you go fast

Probably not the answer, but could it be

When you go, I may show.

You fear me.

I'll blast if you're fast.

You'll hear me.

You'll get a balloon...

...and very soon, someone will come and clear me.

I think you are:

When you go, I may show.

You fear me.

I'll blast if you're fast.

You'll hear me.

You'll get a balloon and very soon,

someone will come and clear me.

(writer’s note: this is partly answer, partly for fun)