This paper proposes improving the structure of the neural controller based on the identification model for nonlinear systems. The goal of this work is to employ the structure of the Modified Elman Neural Network (MENN) model into the NARMA-L2 structure instead of Multi-Layer Perceptron (MLP) model in order to construct a new hybrid neural structure that can be used as an identifier model and a nonlinear controller for the SISO linear or nonlinear systems. Two learning algorithms are used to adjust the parameters weight of the hybrid neural structure with its serial-parallel configuration; the first one is supervised learning algorithm based Back Propagation Algorithm (BPA) and the second one is an intelligent algorithm namely Particle Swarm Optimization (PSO) algorithm. The numerical simulation results show that the hybrid NARMA-L2 controller with PSO algorithm is more accurate than BPA in terms of achieving fast learning and adjusting the parameters model with minimum number of iterations, minimum number of neurons in the hybrid network and the smooth output one step ahead prediction controller response for the nonlinear CSTR system without oscillation.