Agent State Logging for Enhanced Understanding of State Composition

[ArsalonAmini2024]

As RSP, we want to Implement logging for agent state composition so that we can understand state composition across various agent actions.

Acceptance Criteria:

• log agent initial state
• log as agent updates state
• log specific memories used in composing agent state (Message History, Factual Memory, Knowledge Base, Relationship Tracking, RAG Integration)

---

interface State {
    userId?: UUID;
    agentId?: UUID;
    roomId: UUID;
    bio: string;
    lore: string;
    agentName?: string;
    senderName?: string;
    actors: string;
    actorsData?: Actor[];
    recentMessages: string;
    recentMessagesData: Memory[];
    goals?: string;
    goalsData?: Goal[];
    actions?: string;
    actionNames?: string;
    providers?: string;
}


interface IAgentRuntime {
    // Core identification
    agentId: UUID;
    serverUrl: string;
    token: string;

    // Configuration
    character: Character;
    modelProvider: ModelProviderName;

    // Components
    actions: Action[];
    evaluators: Evaluator[];
    providers: Provider[];

    // Database & Memory
    databaseAdapter: IDatabaseAdapter;
    messageManager: IMemoryManager;
    descriptionManager: IMemoryManager;
    loreManager: IMemoryManager;
}


// Evaluate message
const evaluationResults = await runtime.evaluate(message, state, didRespond);


const memoryManager = runtime.getMemoryManager("messages");
await memoryManager.createMemory({
    id: messageId,
    content: { text: "Message content" },
    userId,
    roomId,
});


// Compose initial state
const state = await runtime.composeState(message, {
    additionalContext: "custom-context",
});

// Update message state
const updatedState = await runtime.updateRecentMessageState(state);

messageManager - conversation messages and responses
descriptionManager - user descriptions and profiles
loreManager - static character knowledge

const stateAction: Action = {
    name: "UPDATE_STATE",
    handler: async (runtime, message, state) => {
        const newState = await runtime.composeState(message, {
            additionalData: "new-data",
        });

        await runtime.updateState(newState);
        return true;
    },
};

[github-actions]

Hello @ArsalonAmini2024! Welcome to the ai16z community. Thank you for opening your first issue; we appreciate your contribution. You are now a ai16z contributor!

[jzvikart]

@jkbrooks @ArsalonAmini2024 Do we want to do this in our fork or do we plan to merge it upstream?

[ArsalonAmini2024]

For what we want to do here, we may consider the idea of integrating Eliza framework with a SaaS tool such as https://www.promptlayer.com/platform/observability

Just an idea ^^

Also we want an AI agent to be able to observe these in future so maybe we need a solution that can be accessed via an AI agent

[ArsalonAmini2024]

NOTE - this maybe already covered by

• Logging Instrumentation | Context & Prompt Logging Infra For Enhanced Understanding of Context Composition #196
• In which we define a RUN and logging of specific parts of that run which would include the contents of this ticket

In which can we can close this out or link it to the PR above ^^

CC: @monilpat @jzvikart

[TimKozak]

Conversation moved to #196 . This ticket is redundant.