Torch lighters are more reliable, especially in the wind. It's easy to hold the flame and bring it closer or further away from the ceramic piece as it heats. There's a bit of an art to using the GVG right.
Torch lighters, if I'm not mistaken, also avoid intake of fumes, although I also believe that the ceramic piece filters fumes from your lighter, so I don't know that it's relevant with the GVG.
You can use it with a normal lighter by all means--it's just better with a torch lighter. I HIGHLY recommend going to Home Depot and getting a Bernzomatic torch from there for around $25. The combination of that lighter and the GVG is a $1,000 value!