This whitepaper proposes a Smart Penalty System (SPS), which has the potential to solve prevalent violation issues through the automation of the penalty system. The SPS uses pattern recognition to identify the vehicle license number plate and automatically sends the penalty to the owner of the vehicle.