It's just me and Mrs Zombie most nights. I'm not afraid to use charcoal. I can use a smaller amount for something light like fish, and I can close the vents after cooking to reserve the coal when I'm done. I just knock off the ash the next time I'm going to use it, and a few fresh lumps and it's ready to go.
I happen to be in a unique position. I grill nearly every third day at the firehouse on a gas grill (also a Weber), but the flavor does not even come remotely close to the charcoal. As for speed, the warm-up time on a charcoal grill is the time I spend prepping the meat (marinade, dry rub, or patting out burgers) or getting the sides ready in the kitchen, so essentially, the speed is a wash anyway, unless I'm making something simple, like brats - in which case the warm up grill time is the amount of time it takes to drink my first beer.
The only advantage to gas, is if we catch a fire when I'm at the firehouse, I can turn off the gas grill halfway through cooking. Hopefully, this is not a concern for most home cooks.
As today is Memorial Day (in the U.S.) I brought the my Weber kettle in to work since I'll be smoking a pork shoulder. I'm not too concerned about heat management when we are on a call, because... low and slow.