Do you dream of big language models of artificial intelligence agents?

Photo of author

By [email protected]


During sleep, The human brain is secreted through different memories, and unifying that task while eliminating those that do not matter. What if Amnesty International could do the same?

PelletThe company that offers shopping offers and local restaurants for tenants, recently published several million agents in the hope of doing so.

Bilt uses technology from an emerging company called Lita This allows agents to learn from previous talks and exchange memories with each other. Using a process called “Sleeptime Compute”, the agents decide the information that must be stored in the long -term memory cellar and what may be required to summon faster.

“We can make one update to the” memory “bloc and have the behavior of hundreds of thousands of factors changes,” says Andrew Fitz, an Amnesty International engineer at Bilt. “This is useful in any scenario where you want to control the context of the agents,” he adds, referring to the text mentor that is fed to the model at the time of reasoning.

Large linguistic models can usually “remember” things if the information is included in Context window. IYou want to remember Chatbot your latest conversation, you need to glue it in the chat.

Most of the artificial intelligence systems can only deal with a limited amount of information in the context window before its ability to use data stumbling and becomes confusing. In contrast, the human brain is able to provide useful information and call it later.

“Your mind is constantly improving and adding more information like sponge,” says Charles Baker, CEO of Letta. “With the language models, it is just like the opposite.

It has already evolved Bakr and its founder Sarah and Wooders MemgptAn open source project aims to help LLMS to identify the information that must be stored in the short term for long -term memory. With letta, the duo expanded their approach to allowing agents to learn in the background.

Bilt with Letta is part of a wider batch to give artificial intelligence the ability to store and call useful information, which may make Chatbots more intelligent and agents less vulnerable to error. The memory remains backward in modern artificial intelligence, undermining the intelligence and reliability of artificial intelligence tools, according to the experts you spoke to.

Harrison Chase, founder and executive director of Langchain, another company that has developed a way to improve memory in artificial intelligence agents, says he sees memory a vital part of context engineering – where the user or engineer decides the information that must be fed in the window of context. Langchain offers companies several different types of memory storage for agents, from long -term facts about users to memories of modern experiences. “Memory, I would like to argue, is a form of context,” says Chis. “A large part of the function of the artificial intelligence engineer is basically obtaining the correct context model (information).”

AI tools are gradually less forgotten. In February, Openai Declare Chatgpt will store relevant information to provide a more customized experience for users – although the company has not revealed how this works.

Letta and Langchain make the summons more transparent for engineers who build artificial intelligence systems.

“I think it is very important not only to be open forms but also for memory systems open,” says Cleem Dylangoy, CEO of the ITTA.

It is interesting that the CEO of Letta hints that it may also be important to learn artificial intelligence models what you forget. “If one of the users said,” This project that we were working on, wipe it from your memory, “the agent must be able to return and rewrite each memory retrospectively.”

The idea of artificial memories and dreams makes me think Is Anderod’s dream of electric sheep?? Written by Philip K. Dick, a novel that bends the mind that inspired the elegant made film Blade. Big language models are not impressive yet Repeated rebel From the story, but their memories, apparently, It can be fragile.


This is an edition of Will Fares Newsletter of the AI. Read the previous newsletters here.



https://media.wired.com/photos/68a4d513fcff14d710cba18c/191:100/w_1280,c_limit/AI-Lab-Sleep-Compute%20(0-00-00-21).jpg

Source link

Leave a Comment