Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

As I can't reply to the child - that makes sense it is for embeddings. So would GPT3 still need to be used combined with this then?


HN prevents users from responding to responses to their own comments without some delay to prevent flame wars -- just wait a few minutes next time, or click on the link to the comment directly and you'll be able to reply.

Yes you would still need GPT3 in this system. Right now, the incredibly simple system just wires gives GPT3 a window of the last 100 messages and has it output the next message to send.

    The following is an excerpt SMS conversation between two friends:

    Transcript:
    <splice in the last 100 messages here>
Then you can have GPT3 output what it believes the most likely next message is, and you send it. But this system means it loses context if a message is outside the window. So you can augment this system by creating an embedding of the last few messages of the conversation, and creating a prompt like:

    The following is an excerpt SMS conversation between two friends, and relevant past memories that are related to the current conversation:

    Relevant past memories:
    <splice in the N past messages with the most similar embedding to the most recent messages>

    Transcript:
    <splice in the last 100 messages>
So this gets you a kind of short term memory (the last 100 messages) and a long term memory (the embeddings).


> Relevant past memories: > <splice in the N past messages with the most similar embedding to the most recent messages>

This is a really good idea. Presumably you'd keep the memory per-person.


Oh, that makes a ton of sense. Thank you!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: