Skip to main content

What is a Perceptron or an Artificial Neuron ? (Neural Network, Machine Learning, Deep Learning)



Artificial neural network is derived from biology; we try to mimic biological neuron with an artificial neuron termed perceptron.

Biological Neuron

                                                                  Artificial Neuron

The clear definition of it can be found here: https://biologydictionary.net

Dendrites are projections of a neuron (nerve cell) that receive signals (information) from other neurons. The transfer of information from one neuron to another is achieved through chemical signals and electric impulses, that is, electrochemical signals. The information transfer is usually received at the dendrites through chemical signals, then it travels to the cell body (soma), continues along the neuronal axon as electric impulses, and it is finally transferred onto the next neuron at the synapse, which is the place where the two neurons exchange information through chemical signals. At the synapse meet the end of one neuron and the beginning—the dendrites—of the other.

Now we can look at how the artificial neuron works, we assume that the input to the neuron as any real world signal with a numerical value such as 12 and 4 as shown below. To begin, usually, the weights usually will be assigned randomly (here 0.5 and -1)


The next step involves multiplying the inputs with the weights and then summed up together. Then the activation function output some states such as ‘1’ or ‘0’, based on the summation. For example if the summation is above 0 it outputs ‘1’ and vice versa.


In case if both inputs are ‘0’ then whatsoever be the weights we always get ‘0’ as output, hence a Bias term is added.




The mathematical representation for the ‘n’ input system (and a bias) is provided as below


The upgradation of perceptron is multiple perceptron network, which has more layers then single perceptron
And if the number of hidden layer is greater than 3, then its termed as deep network/learning.



Comments

  1. Thank you for sharing best Engineering subject knowledge Its very valuable and supportive for student.
    get more: Image Processing

    ReplyDelete

Post a Comment

Popular posts from this blog

Image RGB to CMYK : Image Conversion - MATLAB Code (RGB to CMYK, CMYK to RGB)

MATAB use makecform and applycform functions to perform this color model conversion  Ref: makecform:  https://www.mathworks.com/help/images/ref/makecform.html Ref: applycform:  https://www.mathworks.com/help/images/ref/applycform.html RGB to CMYK: I_rgb = imread('lena_color.jpg'); %Read the color image  C = makecform('srgb2cmyk');     %srgb (standard rgb) to cmyk  I_CMYK= applycform(I_rgb,C); TO SAVE IN CMYK Format imwrite(I_CMYK, 'test.tiff'); USE IMFINFO to confirm the conversion imfinfo('test.tiff') the command gives the output ... Width: 512 Height: 512 BitDepth: 32 ColorType: 'CMYK' ... CMYK to RGB: I_CMYK = imread('lena_color.jpg'); %Read the color image  C = makecform('cmyk2srgb');     %srgb (standard rgb) to cmyk  I_rgb= applycform(I_CMYK, C);

Digital Half Toning - Ordered Dithering - MATLAB Code Bayer/ Ulichney

Digital Half-toning is a technique to convert the gray scale / color image (in the range 0-255) to binary images (in the range 0-1)  that is useful for printing (especially black and white printers). Though at first glance dots are clearly visible, as Human Vision System is a low pass filter, when dots are printed closely and viewed from the specific distance it can be perceived as a continuous tone image (i.e. gray scale). In general, half toning techniques is widely used in newspapers, journals and magazines printing.  Halftoning algorithms aims for better #Image Quality #Low Complexity #Optimal ink usage Coming to the topic, Ordered dithering is one of the standard technique to produce halftone image from continuous (gray scale) images. Let us assume, the first block containing 'B' is an image matrix and the  'H' is the threshold matrix. And the process is simply a element wise (pixel wise) comparison; if element of B > H (g...

Direct Binary Search Halftoning (DBS) - MATLAB Code (Efficient Direct Binary Search, Halftoning)

Direct binary approach is a heuristic optimization method and is proven to be very powerful to  obtain optimized binary patterns. The approach achieves the least minimum square error between the perceived halftone and original image, though swap and toggle operation. The swap operation consists of switching the current pixel with eight of its neighborhood pixels. Toggle operation is about switching the values between 0 to 1 or vice versa (as shown in Fig. below)      With each iteration, the perceived error starts to reduce and in finally a superior halftone quality is achieved. The method is computationally very expensive and difficult to implement in hardware. The code for Efficient DBS is provided in the link: (MATLAB Code) https://github.com/SankarSrin/EDBS-Halftoning