I welcome you all to this presentation On:

2. I welcome you all to this presentation On:

3. Neural Network Applications Imran Nadeem & Naveed R. Butt 220504 & 230353 Systems Engineering Dept. KFUPM

4. Part I: Introduction to Neural Networks Part II: LMS & RBF Part III: Control Applications

5. Part I: Introduction to Neural Networks Part I: Introduction to NN’s • There is no restriction on the unknown function to be linear. Thus, neural networks provide a logical extension to create nonlinear adaptive control schemes. • Universal Approximation Theorem: neural networks can reproduce any nonlinear function for a limited input set. • Neural networks are parameterized nonlinear functions whose parameters can be adjusted to achieve different shaped nonlinearities. • In essence, we try to adjust the neural network to serve as an approximator for an unknown function that we know only through its inputs and outputs

6. Part I: Introduction to Neural Networks Human Neuron

7. Part I: Introduction to Neural Networks Artificial Neuron

8. Part I: Introduction to Neural Networks Adaptation in NN’s

9. Part I: Introduction to Neural Networks Single Layer Feedforward NN’s

10. Part I: Introduction to Neural Networks Multi-Layer Feedforward NN’s

11. Part I: Introduction to Neural Networks Recurrent (feedback) NN’s A recurrent neural network distinguishes itself from the feed-forward network in that it has at least one feedback loop. For example, a recurrent network may consist of a single layer of neurons with each neuron feeding its output signal back to the input of all input neurons.

12. Part I: Introduction to Neural Networks Recurrent (feedback) NN’s The presence of feedback loops has a profound impact on the learning capability of the network and on its performance.

13. Part I: Introduction to Neural Networks Applications of NN’s Neural networks are applicable in virtually every situation in which a relationship between the predictor variables (independents, inputs) and predicted variables (dependents, outputs) exists, even when that relationship is very complex and not easy to articulate in the usual terms of "correlations" or "differences between groups”

14. Part I: Introduction to Neural Networks Applications of NN’s • Detection of medical phenomena • Stock market prediction • Credit assignment • Condition Monitoring • Signature analysis • Process control • Nonlinear Identification & Adaptive Control

15. End of Part I

16. Part II: LMS & RBF Part II: LMS & RBF LMS: The Adaptation Algorithm RBF: Radial Bases Function NN

17. Actual Response Estimated Response Estimation Error Mean Square Error Cost Function Weight Updates Adaptation Step Size Part II: LMS & RBF LMS: The Adaptation Algo.

18. Part II: LMS & RBF RBF-NN’s Radial functions are a special class of functions. Their characteristic feature is that their response decreases (or increases) monotonically with distance from a central point and they are radially symmetric.

19. Part II: LMS & RBF RBF-NN’s Gaussian RBF

20. Part II: LMS & RBF RBF-NN’s Neural Networks based on radial bases functions are known as RBF Neural Networks and are among the most commonly used Neural Networks

21. Part II: LMS & RBF RBF-NN’s • Two-layer feed-forward networks. • Hidden nodes: radial basis functions. • Output nodes : linear summation. • Very fast learning • Good for interpolation, estimation & Classification

22. Part III: Control Applications Part III: Control Applications Nonlinear System Identification Adaptive Tracking of Nonlinear Plants

23. Part III: Control Applications Nonlinear System Identification

24. Part III: Control Applications Nonlinear System Identification Continuously Stirred Tank Reactor

25. Part III: Control Applications Nonlinear System Identification Simulation Results Using SIMULINK

26. Part III: Control Applications Adaptive Nonlinear Tracking

27. Part III: Control Applications Adaptive Nonlinear Tracking Hammerstein Model

28. Part III: Control Applications Adaptive Nonlinear Tracking Simulation Results Using SIMULINK

29. Part III: Control Applications Adaptive Nonlinear Tracking Simulation Results Using SIMULINK

30. Thank you