Aviation Photography is not a crime!

The amount of stories you hear about people getting told off by the police for simply sitting and watching (and photographing) airplanes is huge! Why is it a crime for people to simply sit and enjoy watching ?...