Spiral waves are a particular form of propagating waves, which rotate around a center point known as a rotor. Spiral waves have been found to play an important role in cardiac arrhythmia. Using voltage-sensitive dye imaging, one can find that spiral waves and plannar waves can occur in the mammalian cortex in vivo. The electrode array conduces to discovering that the seizures may manifest as recurrent spiral waves which propagate in the neocortex. However, the formation mechanism of the ordered waves and its potential function in the nervous system remain uncertain. In order to understand the formation mechanism of the ordered waves, we construct a double-layer two-dimensional -network of neuron, which is composed of nearest-neighbor excitatory coupling and long-range inhibitory coupling layers. The inhibitory grid points account for 25% of total number of grid points in the network. We propose a modified Hindmarsh-Rose neuron model to study whether differently ordered waves can occur spontaneously in the chaotic neuronal network evolving from the initial state with a random phase distribution. The numerical simulation results show that when the inhibitory coupling strength is small the spontaneous formation of ordered wave does not generally appear in the network. The larger inhibitory coupling strength, the more easily the system generates an ordered wave for sufficiently large strength of excitatory coupling. The appearance of differently ordered waves is closely related to the initial state of the system and coupling strength. As the excitatory and inhibitory coupling strengths are appropriately selected, the system can spontaneously generate the maze pattern, planar wave, single spiral wave, multiple spiral wave, paired spiral waves rotating in the opposite directions, two-arm spiral wave, target wave and inward square wave and so on. The probability for spontaneously forming a single spiral wave is far less than that for forming a small spiral wave. The occurrence probabilities of spiral wave, maze pattern and inward square wave reach 27.5%, 21.5% and 10%, respectively. The maze pattern is composed of many plane waves with different propagation directions. The occurrence probabilities of other ordered waves are quite small. These results conduce to understanding the self-organization phenomena occurring in the cerebral cortex.