Perceptron Model

The perceptron is a simple machine learning model that can classify data into two categories, like positive or negative, spam or not spam, and so on. It's one of the oldest and most fundamental models that laid the foundation for more advanced neural networks and deep learning techniques.

Imagine you have a collection of customer reviews, and you want to classify them as either positive or negative based on the words used in the review. The perceptron model looks at the number of times certain words appear in the review and uses that information to decide whether the review is positive or negative.

Here's how it works:

  1. First, we take a set of customer reviews that have already been labelled. This is our training data.
  2. To keep it simple in this example, we count the number of times the word "happy" appears and the number of times the word "sad" appears. See table 1 below.
  3. We plot these counts on a graph, with the "happy" count on one axis and the "sad" count on the other axis. Each review is represented by a point on the graph. See Image 1 below.
  4. The perceptron model then tries to find a line that separates the "happy" points from the "sad" points as best as possible. In this case the equation of the line is like ax1+bx2+c = 0. See Image 1 below. 
  5. Once we have this line, we can use it to classify new, unlabelled reviews. We count the "happy" and "sad" words in the new review, plot it on the graph, and see which side of the line it falls on. If the point falls on the "happy" side of the line, we classify the review as positive. If it falls on the "sad" side, we classify it as negative. In other words, if ax1+bx2+c>0 – Positive review; else negative. See Table 2 and Image 2 below.

While this is a simplified example using only two words, the perceptron model can be extended to consider more words or features, making it more accurate in classifying data. It's a basic building block for more complex machine learning models used in various applications today.







Comments

Post a Comment

Popular posts from this blog

Logical and Physical Architecture

Image
  When you have defined the user stories (requirements) for a new system, the next step is to design the system architecture. There are two main parts to this: 1. Logical Architecture :  This is a high-level view of the system, focusing on the different components or building blocks needed to meet the requirements. It's like a blueprint for the system, showing how the different pieces should work together. ⠀For example, if you're building a system to report bugs, the logical components could be: * Ticket Creation * Ticket Assignment * Notifications (to the requester and resolver) * Communication (adding notes to the ticket) * Ticket Closure ⠀The logical architecture doesn't go into the technical details of how each component will be built. It just maps out what components are needed and how they should interact. 2. Physical Architecture:  This is the more technical view of the system, specifying the actual technologies and infrastructure that will be used to build the com...
Read more

Data Models

  When you think of system design,   Data Models   is a common term that you will hear. So what are Data Models? Very simply it is the way how data for a product or tech system is represented. And this represented ideally depends on the customer or the use case. Take the example of a car. One way to define a car can be to use the attributes like model, color, price, year of manufacture. Another way to define a car can be using attributes - License plate, owner name, history of accidents. If you are making a tech product for the use of a car buyer - then the Data Model 1 is more relevant and if you are making a tech system for the police, then Data model 2 is more relevant.  (One more reason to think customer backwards!!) . Broadly, there are three types of data models: 1) Relational; 2) Document; 3) Graph. The most well-known is the  relational data model . You can see this data typically in a tabular format where each row represents a relation. (SQL is a popula...
Read more

Deep Learning

Image
A few weeks ago, we discussed   representation learning , which allows an algorithm to automatically discover and learn the most useful features from the data itself (unlike classic machine learning that relies on human-defined features). However, representation learning has a limitation when it comes to intricate problems like voice or image recognition, where it becomes challenging to create a representation due to complexities. For instance, in speech recognition, accents pose a difficulty in representing them as a mere set of features. This is where deep learning steps in to solve this problem. Deep learning expresses the representation in terms of other simpler representations. For example, if we need to identify whether an image depicts a car or an animal, the first input to the model can be just the colors. These colors then serve as input to another representation of edges, which further feeds into contours, and so on, until after multiple layers, we can understand the type...
Read more