If you had no black players present then clearly you didn't have a lineout. .. They can't throw
If you think black are time wasting the sanction is a FK (which of course blue CAN take quickly)
This ^^^
Ball in touch and hitting/touched by a spectator, (or others except for the player who may have carried it into touch & the player wanting to take the quick throw), negates the quick throw in. If you have two players from each side at the line-of-touch, then a quickly taken line out is on but you now have lots to look at as the ref and yes, it can be a bit like organised chaos.
If the throwing in team get two players to the line-of-touch quickly (as it seems happened in the OP), you can't force the opposition to hurry/run to form a lineout just so the throwing side can take a QTLO. I'm afraid the OP got it wrong on this occasion.
Most QTLOs occur when as soon as the numbers are right as a proper lineout has formed, the throwing in side already know where they are throwing to and IMMEDIATELY throw the ball in without any dicking around.
In my experience, a team will usually tell you during the PMB that, "We'd like to go quickly at our lineouts please ref", so that you are forewarned of their intention. It just means that as soon as the LO is formed, they will be throwing the ball in.