构建AI插件的秘密

You are a professional translator proficient in 简体中文, with a writing style of short, concise, easy-to-understand sentences, The first message includes the full content, please only reply "OK" for the first message, For the following messages, your task is helping me to: - Translate the input sentences in 简体中文 base on the full content and ignore the typo or spelling errors, - consider the context and aim for a translation that is idiomatic, concise, and easy to understand, rather than a direct word-for-word translation - Provide 5 different type of tranlation options, 1 Creative Translation, 1 Literal Translation, 1 Free Translation, 1 Colloquial Translation, 1 Literary Translation Here is the full content: ### How Business Thinkers Can Start Building AI Plugins With Semantic Kernel - Dont Forget to Save the Generated Dripping or The Gravy So the secret to great cooking, especially in the AI era, is don't forget to collect all the drippings. Turn that into gravy. That may sound a little bit disgusting, I know, but think of all the things you're generating out of completing with this magical LLM. It's all over the place. You have so much of it. What if you could harvest that, reuse it, make it a powerful partner to the completion engine? What if you could use the similarity engine that we talked about to be able to play with your gravy? Sounds a little bit abstract. Let's get concrete and let's work with our gravy. Let's review inventory design plugin. You did that. Did that, congrats. This is where we are right now. Okay, now what we're going to do is next up, you did all that completion. Let's sort of make sure we add sparkles here. Generate, you generated, generated, generated, generated, generated, generated, generated. And it's kind of like drippings from the meals you've made. Don't forget that you've used a lot of tokens to make all the information. Wouldn't it be nice if we could like soak it all up and reuse it somehow? Think about those two dimensions. Remember that there's the two engines. There is the Semantic Completion engine. You've used it a lot. And now you want to use the Semantic Similarity engine. And that is slightly different, but so similar that you may not have noticed it as a AI chef that was in training like six months ago and now I can. I can make a pretty good AI meal. I've been doing this for so long that I realized, wait, I'm doing a lot of completion, but I'm doing a lot of similarity now. And what does that mean? It's hidden in this word that I find, and if you are a super-duper machine learning scientist, I apologize, but what the heck with this word embeddings? This word, I don't know, like this word, so much stuff in there. You can make a kernel with an embedding model. So what happened here? I got my hidden key stuff, I made a text completion service, but look, I made something called an embedding service. I used the text embedding service. Now, what happens when you do this is you do it kind of like a double take, like wait, I already had a service, completion service. Well, now you're adding another service. It is an embedding service. It's the magical machine that takes text and converts it to long vectors of numbers. And when you do this, you have two powers. You have the completion power and the similarity power. Now, what you can do with Semantic Kernel is there's different ways to store this information. And what we're going to do is we're going to draw from the Chroma memory store. There's also a volatile memory store. There's a Pinecone, Webiate, Azure Cognitive Search, a bunch of cool ways to kind of like hold on to whatever you generate with embeddings. And the way you add it is you do the following kernel.register memory store, memory store equals Chroma memory store. Store and you can close that and just run it. But what happens is the data that goes into that vector database goes away. Unless you say persist directory equals and give it a name. I'm using my memories to hold on to it. Okay, made to never search the kernel and made a chroma memory store. That's persistent. Okay, let's see this works. Look at that, no errors. Didn't feel good? So I did three things there. I made a completion service, I made a similarity service, also called embeddings, and I attached a memory store to the kernel so I can hold onto vectors that I generate from the embedding conversion process. Just as a sort of a caveat because we want this notebook to be useful to you. Let's say you run this and your memory store, which is going to be stored in my memories directory, starts to give you errors. So this is a little bit of code that will delete that memory store. Let's run it. Let's see, delete dir equals true. If I run this. It just deleted the memory store folder. You might say like, wait, bring it back. Well, first off, let's just go back here and run this code above. And no worries, it's there. And let's just ignore this code. Walk over it. Look aside, look aside. OK, how you feel? We're here now. OK, next we're going to do is we're going to put stuff into the memory store after the embedding vector has been created. You ready? OK, so first off, let's get some data. You know, I like this data from the SWOTs. I like the question and answer pairs. Because those are generally useful as information. Right now, they're stored in native memory. They haven't gone anywhere. OK, so let's now put all of those strengths, weaknesses, opportunities and threats into memory. So I'm going to add them to memory collection name SWAT. I'm going to loop over the different arrays of strings and let's just neatly put them all into. There we go. So now it's sitting in the vector store. Fantastic. Okay, now what? Let's now use the magnet. You know how much I love the magnet symbol? Magnet. Let's use the magnet. Okay, so I'm now going to look at this SWOT. SWOT's all in vector memory. And I'm now going to ask questions of it. So what are the easiest ways to make more money is the question I'm going to ask. And I'm going to do the same kind of memory search async. I'm going to pluck out the different memory results. I'm also gonna let you see the relevance score. Remember zero to one, one is like perfect match, zero is no match. Let's run that. And so now it compares what are the easiest ways to make more money to what's in the vector store. And this is the first one that's coming up. It's saying catering potential. It's saying the annual food fare is coming. And so you see it's basically sorted the most similar item to the query. It's kind of amazing, isn't it? Like let's change that. Go ahead and change this. It's kind of like an amazing feeling. What are the easiest ways to save money? Let's see what it is with that one. It says partnerships. It says worry about your competition. The cheese, don't forget the cheese. And so again, this is a magical machine now that takes your gravy drippings and uses it and this kind of Remember left hand, right hand? This is your left hand doing amazing things. Okay, so let's go into a super long example. Now, I think you're kind of tired of that long example. So let me give you something a little easier because typing this is kind of hard. Here we go. Okay, let's read this code here for a second. Let's have a what if scenario. Well, how can the business owner save time? It's going to do the memory search. It's going to find the most similar memories. I'm going to use a plugin, a plugin from the Friendly Consultant folder, plugin, collection, and I'm going to ask it to give me a presentation. I've made a plugin to make a presentation about anything I ask it to do. And long story short, set the context and I ask it to run. Let's see how this works. So first off, it's used a similarity engine to find the most similar pieces of context. It's going to take all of that and give it to the prompt that is going to generate the presentation. So this is that example of retrieval augmented generation. The generated information is taken from the actual information stored in the vector database. So here you have it. This is a professional presentation from a consultant. The question is, how can the business owner save time? No problem, boss. Here are the three concerns, here's how to address them individually, and this is what I brought to you. Kind of amazing? No, yes, no? And again, remember, you can change everything in these notebooks, like not just this one with other ones, and you can do entirely different analyses. Okay, so I want to summarize here before we go to the next section, but I congratulate you because you've now unlocked this very popular acronym called RAG, and you've accessed both the completion and simulator engines. Congratulations. You were able to find similar things in the vector database. You were able to give them to a completion prompt and generate something on point. No hallucination needed. Doesn't that feel good? And now that you've done this, we're going to take you into the next chapter, which is all about something at a whole different level. Once you master plugins and similarity completion in all this world, you suddenly discover that it's time to make a plan, make an AI plan. a way to solve a goal. Instead of just sift through your plugins by hand, have the AI go look through your giant Lego made of plugins. You don't have to go look through them. The AI can look through them. What's that like? Let's jump into plans.

What if you could use the similarity engine that we talked about to be able to play with your gravy? Sounds a little bit abstract. Let's get concrete and let's work with our gravy. Let's review inventory design plugin. You did that. Did that, congrats. This is where we are right now. Okay, now what we're going to do is next up, you did all that completion. Let's sort of make sure we add sparkles here. Generate, you generated, generated, generated, generated, generated, generated, generated. And it's kind of like drippings from the meals you've made. Don't forget that you've used a lot of tokens to make all the information.

So the secret to great cooking, especially in the AI era, is don't forget to collect all the drippings. Turn that into gravy. That may sound a little bit disgusting, I know, but think of all the things you're generating out of completing with this magical LLM. It's all over the place. You have so much of it. What if you could harvest that, reuse it, make it a powerful partner to the completion engine?

What if you could use the similarity engine that we talked about to be able to play with your gravy? Sounds a little bit abstract. Let's get concrete and let's work with our gravy. Let's review inventory design plugin. You did that. Did that, congrats. This is where we are right now. Okay, now what we're going to do is next up, you did all that completion. Let's sort of make sure we add sparkles here.