At the end of my last article, I put the above ‘Overview’ image but did not explain it… I am going to do so now. First, let me say this… when I was at TRW (which was bought out by Northrop Grumman) they offered to send a few of us to take a Java class. If I remember correctly, two of us were sent. I had taken several computer courses, through work, at this point and although I wanted to learn something new, I wasn’t all that excited. Other than taking a break from the office.
The first half of the class was taught by this older gentleman. He went into the similarity between Java and NLP (Neuro Linguistic Programming…not to be confused with Natural Language Processing). I was practically on the edge of my seat with interest. I did briefly look around and everyone else was bored. The second half of the class was taught by the assistant and he went into the specifics of Java. The rest of the class perked up, asking questions and discussing, while I could barely keep my eyes open.
I wanted to note that because I’m doing the suggestions in “Love + Work”… to pay attention to what gives me energy and what drains me. Which, by the way, I’m feeling sleepy (drained?) while working on this AI post. I’m going to push forward though.
Back to the subject at hand. I found an excellent article that listed the steps to create a Generative Chatbot. One of those steps was ‘vector database’. The part in light grey, in the diagram above, is an overview of ‘vector database’.
My understanding, right now, and will update this article as I learn more…
- Take some unstructured data
- Use a Transformer Model to transform it into a vector embedding, which is a ‘numerical’ representation of that data
- Add it to the vector database
- Then you can do a ‘similarity search’ on it
I started with looking into the ‘vector database’, used in creating a Chatbot, and then I wanted to see how it looked in the whole scheme of things. The rest of the diagram is me drawing up how the whole chatbot picture looks.
Learning AI – Chatbot
I also mentioned in my previous post how I started creating a chatbot. This chatbot pulls from an array… I have yet to set it up to pull from MySQL. I also need to see if I can add my downloaded vector database to the server.
I wanted to note that here and mention the URL where I’ve added it to my server…