[Obs AI Assistant] Pass function responses when copying conversation

[viduni94]

Closes #181216

Summary

Problem

Function call arguments and responses are serialized separately. Therefore, when a conversation is copied, arguments and responses (content and data) appear as strings instead of JSON objects. This makes it harder to debug.

Solution

Deserialize the arguments and responses and include it in the copied conversation object.

Example of original copied conversation:

Click to expand JSON

{
  "title": "",
  "messages": [
    {
      "@timestamp": "2024-10-09T13:58:41.723Z",
      "message": {
        "role": "system",
        "content": "You are a helpful assistant for Elastic Observability...."
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:26.881Z",
      "message": { "role": "user", "content": "Give me examples of questions I can ask here." }
    },
    {
      "@timestamp": "2024-10-09T13:58:26.965Z",
      "message": { "role": "assistant", "function_call": { "name": "context", "trigger": "assistant" }, "content": "" }
    },
    {
      "@timestamp": "2024-10-09T13:58:27.063Z",
      "message": {
        "role": "user",
        "data": "{\"scores\":[],\"suggestions\":[]}",
        "name": "context",
        "content": "{\"screen_description\":\"The user is looking at http://localhost:5601/kyq/app/observability/overview?rangeFrom=now-15m&rangeTo=now. The current time range is 2024-10-09T13:40:00.288Z - 2024-10-09T13:55:00.288Z.\\n\\nThe user is viewing the Overview page which shows a summary of the following apps: {\\\"universal_profiling\\\":{\\\"hasData\\\":false,\\\"status\\\":\\\"success\\\"},\\\"uptime\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"heartbeat-*\\\",\\\"status\\\":\\\"success\\\"},\\\"infra_metrics\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"metrics-*,metricbeat-*\\\",\\\"status\\\":\\\"success\\\"},\\\"alert\\\":{\\\"hasData\\\":false,\\\"status\\\":\\\"success\\\"},\\\"apm\\\":{\\\"hasData\\\":false,\\\"indices\\\":{\\\"transaction\\\":\\\"traces-apm*,apm-*,traces-*.otel-*\\\",\\\"span\\\":\\\"traces-apm*,apm-*,traces-*.otel-*\\\",\\\"error\\\":\\\"logs-apm*,apm-*,logs-*.otel-*\\\",\\\"metric\\\":\\\"metrics-apm*,apm-*,metrics-*.otel-*\\\",\\\"onboarding\\\":\\\"apm-*\\\",\\\"sourcemap\\\":\\\"apm-*\\\"},\\\"status\\\":\\\"success\\\"},\\\"ux\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"traces-apm*,apm-*,traces-*.otel-*,logs-apm*,apm-*,logs-*.otel-*,metrics-apm*,apm-*,metrics-*.otel-*\\\",\\\"status\\\":\\\"success\\\"},\\\"infra_logs\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"logs-*-*,logs-*,filebeat-*,kibana_sample_data_logs*\\\",\\\"status\\\":\\\"success\\\"}}\",\"learnings\":[]}"
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:35.140Z",
      "message": {
        "role": "assistant",
        "function_call": { "name": "", "arguments": "", "trigger": "assistant" },
        "content": "Sure, here are some examples of questions you can ask:\n\n1. \"What is the average response time for my services?\"\n2. \"Show me the error rate for my services.\"\n3. \"Are there any anomalies in my system?\"\n4. \"What are the top 5 services by transaction volume?\"\n5. \"Show me the logs for a specific service.\"\n6. \"Are there any alerts in my system?\"\n7. \"What is the CPU usage of my hosts?\"\n8. \"Show me the network traffic in my system.\"\n9. \"What is the disk usage of my hosts?\"\n10. \"Show me the memory usage of my containers.\"\n\nPlease note that the actual questions you can ask depend on the data you have in your system."
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:41.651Z",
      "message": { "role": "user", "content": "What are the top 5 services by transaction volume" }
    },
    {
      "@timestamp": "2024-10-09T13:58:41.723Z",
      "message": { "role": "assistant", "function_call": { "name": "context", "trigger": "assistant" }, "content": "" }
    },
    {
      "@timestamp": "2024-10-09T13:58:41.784Z",
      "message": {
        "role": "user",
        "data": "{\"scores\":[],\"suggestions\":[]}",
        "name": "context",
        "content": "{\"screen_description\":\"The user is looking at http://localhost:5601/kyq/app/observability/overview?rangeFrom=now-15m&rangeTo=now. The current time range is 2024-10-09T13:40:00.288Z - 2024-10-09T13:55:00.288Z.\\n\\nThe user is viewing the Overview page which shows a summary of the following apps: {\\\"universal_profiling\\\":{\\\"hasData\\\":false,\\\"status\\\":\\\"success\\\"},\\\"uptime\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"heartbeat-*\\\",\\\"status\\\":\\\"success\\\"},\\\"infra_metrics\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"metrics-*,metricbeat-*\\\",\\\"status\\\":\\\"success\\\"},\\\"alert\\\":{\\\"hasData\\\":false,\\\"status\\\":\\\"success\\\"},\\\"apm\\\":{\\\"hasData\\\":false,\\\"indices\\\":{\\\"transaction\\\":\\\"traces-apm*,apm-*,traces-*.otel-*\\\",\\\"span\\\":\\\"traces-apm*,apm-*,traces-*.otel-*\\\",\\\"error\\\":\\\"logs-apm*,apm-*,logs-*.otel-*\\\",\\\"metric\\\":\\\"metrics-apm*,apm-*,metrics-*.otel-*\\\",\\\"onboarding\\\":\\\"apm-*\\\",\\\"sourcemap\\\":\\\"apm-*\\\"},\\\"status\\\":\\\"success\\\"},\\\"ux\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"traces-apm*,apm-*,traces-*.otel-*,logs-apm*,apm-*,logs-*.otel-*,metrics-apm*,apm-*,metrics-*.otel-*\\\",\\\"status\\\":\\\"success\\\"},\\\"infra_logs\\\":{\\\"hasData\\\":false,\\\"indices\\\":\\\"logs-*-*,logs-*,filebeat-*,kibana_sample_data_logs*\\\",\\\"status\\\":\\\"success\\\"}}\",\"learnings\":[]}"
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:43.370Z",
      "message": {
        "role": "assistant",
        "function_call": {
          "name": "get_dataset_info",
          "arguments": "{\n  \"index\": \"traces-apm*,apm-*,traces-*.otel-*\"\n}",
          "trigger": "assistant"
        },
        "content": ""
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:43.379Z",
      "message": { "role": "user", "name": "get_dataset_info", "content": "{\"indices\":[],\"fields\":[]}" }
    },
    {
      "@timestamp": "2024-10-09T13:58:43.998Z",
      "message": {
        "role": "assistant",
        "function_call": { "name": "query", "arguments": "{}", "trigger": "assistant" },
        "content": ""
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:47.572Z",
      "message": {
        "role": "user",
        "data": "{\"keywords\":[\"STATS\",\"SORT\",\"LIMIT\",\"COUNT\"],\"requestedDocumentation\":{\"STATS\":\"# STATS ... BY\\n\\nThe `STATS ... BY` command groups rows based on a common value and calculates one or more aggregated values over these grouped rows.\\n\\n## Syntax\\n\\n```esql\\nSTATS [column1 =] expression1[, ..., [columnN =] expressionN] [BY grouping_expression1[, ..., grouping_expressionN]]\\n```\\n\\n### Parameters\\n\\n#### columnX\\n\\nThe name for the aggregated value in the output. If not provided...."}}",
        "name": "query",
        "content": "{}"
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:51.481Z",
      "message": {
        "role": "assistant",
        "function_call": {
          "name": "execute_query",
          "arguments": "{\"query\":\"FROM traces-apm*,apm-*,traces-*.otel-* | STATS COUNT(*) BY service.name | SORT COUNT(*) DESC | LIMIT 5\"}",
          "trigger": "assistant"
        },
        "content": ""
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:51.619Z",
      "message": {
        "role": "user",
        "name": "execute_query",
        "content": "{\"message\":\"The query failed to execute\",\"error\":{\"name\":\"ResponseError\",\"message\":\"verification_exception\\n\\tRoot causes:\\n\\t\\tverification_exception: Found 1 problem\\nline 1:1: Unknown index [traces-apm*,apm-*,traces-*.otel-*]\"}}"
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:56.600Z",
      "message": {
        "role": "assistant",
        "function_call": { "name": "", "arguments": "", "trigger": "assistant" },
        "content": "I'm sorry, but it seems like there are no indices matching the pattern \"traces-apm*,apm-*,traces-*.otel-*\" in your system. Therefore, I'm unable to retrieve the top 5 services by transaction volume. Please ensure that your APM data is being ingested correctly into Elasticsearch."
      }
    }
  ]
}

Copied conversation after deserializing:

Click to expand JSON

{
  "title": "",
  "messages": [
    {
      "@timestamp": "2024-10-09T13:58:41.723Z",
      "message": {
        "role": "system",
        "content": "You are a helpful assistant for Elastic Observability. Your goal is to help the Elastic Observability users to quickly assess what is happening in their observed systems..."
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:26.881Z",
      "message": { "role": "user", "content": "Give me examples of questions I can ask here." }
    },
    {
      "@timestamp": "2024-10-09T13:58:26.965Z",
      "message": { "role": "assistant", "function_call": { "name": "context", "trigger": "assistant" }, "content": "" }
    },
    {
      "@timestamp": "2024-10-09T13:58:27.063Z",
      "message": {
        "role": "user",
        "data": { "scores": [], "suggestions": [] },
        "name": "context",
        "content": {
          "screen_description": "The user is looking at http://localhost:5601/kyq/app/observability/overview?rangeFrom=now-15m&rangeTo=now. The current time range is 2024-10-09T13:40:00.288Z - 2024-10-09T13:55:00.288Z.\n\nThe user is viewing the Overview page which shows a summary of the following apps: {\"universal_profiling\":{\"hasData\":false,\"status\":\"success\"},\"uptime\":{\"hasData\":false,\"indices\":\"heartbeat-*\",\"status\":\"success\"},\"infra_metrics\":{\"hasData\":false,\"indices\":\"metrics-*,metricbeat-*\",\"status\":\"success\"},\"alert\":{\"hasData\":false,\"status\":\"success\"},\"apm\":{\"hasData\":false,\"indices\":{\"transaction\":\"traces-apm*,apm-*,traces-*.otel-*\",\"span\":\"traces-apm*,apm-*,traces-*.otel-*\",\"error\":\"logs-apm*,apm-*,logs-*.otel-*\",\"metric\":\"metrics-apm*,apm-*,metrics-*.otel-*\",\"onboarding\":\"apm-*\",\"sourcemap\":\"apm-*\"},\"status\":\"success\"},\"ux\":{\"hasData\":false,\"indices\":\"traces-apm*,apm-*,traces-*.otel-*,logs-apm*,apm-*,logs-*.otel-*,metrics-apm*,apm-*,metrics-*.otel-*\",\"status\":\"success\"},\"infra_logs\":{\"hasData\":false,\"indices\":\"logs-*-*,logs-*,filebeat-*,kibana_sample_data_logs*\",\"status\":\"success\"}}",
          "learnings": []
        }
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:35.140Z",
      "message": {
        "role": "assistant",
        "function_call": { "name": "", "arguments": "", "trigger": "assistant" },
        "content": "Sure, here are some examples of questions..."
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:41.651Z",
      "message": { "role": "user", "content": "What are the top 5 services by transaction volume" }
    },
    {
      "@timestamp": "2024-10-09T13:58:41.723Z",
      "message": { "role": "assistant", "function_call": { "name": "context", "trigger": "assistant" }, "content": "" }
    },
    {
      "@timestamp": "2024-10-09T13:58:41.784Z",
      "message": {
        "role": "user",
        "data": { "scores": [], "suggestions": [] },
        "name": "context",
        "content": {
          "screen_description": "The user is looking at http://localhost:5601/kyq/app/observability/overview?rangeFrom=now-15m&rangeTo=now. The current time range is 2024-10-09T13:40:00.288Z - 2024-10-09T13:55:00.288Z.\n\nThe user is viewing the Overview page which shows a summary of the following apps: {\"universal_profiling\":{\"hasData\":false,\"status\":\"success\"},\"uptime\":{\"hasData\":false,\"indices\":\"heartbeat-*\",\"status\":\"success\"},\"infra_metrics\":{\"hasData\":false,\"indices\":\"metrics-*,metricbeat-*\",\"status\":\"success\"},\"alert\":{\"hasData\":false,\"status\":\"success\"},\"apm\":{\"hasData\":false,\"indices\":{\"transaction\":\"traces-apm*,apm-*,traces-*.otel-*\",\"span\":\"traces-apm*,apm-*,traces-*.otel-*\",\"error\":\"logs-apm*,apm-*,logs-*.otel-*\",\"metric\":\"metrics-apm*,apm-*,metrics-*.otel-*\",\"onboarding\":\"apm-*\",\"sourcemap\":\"apm-*\"},\"status\":\"success\"},\"ux\":{\"hasData\":false,\"indices\":\"traces-apm*,apm-*,traces-*.otel-*,logs-apm*,apm-*,logs-*.otel-*,metrics-apm*,apm-*,metrics-*.otel-*\",\"status\":\"success\"},\"infra_logs\":{\"hasData\":false,\"indices\":\"logs-*-*,logs-*,filebeat-*,kibana_sample_data_logs*\",\"status\":\"success\"}}",
          "learnings": []
        }
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:43.370Z",
      "message": {
        "role": "assistant",
        "function_call": {
          "name": "get_dataset_info",
          "arguments": { "index": "traces-apm*,apm-*,traces-*.otel-*" },
          "trigger": "assistant"
        },
        "content": ""
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:43.379Z",
      "message": { "role": "user", "name": "get_dataset_info", "content": { "indices": [], "fields": [] } }
    },
    {
      "@timestamp": "2024-10-09T13:58:43.998Z",
      "message": {
        "role": "assistant",
        "function_call": { "name": "query", "arguments": {}, "trigger": "assistant" },
        "content": ""
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:47.572Z",
      "message": {
        "role": "user",
        "data": {
          "keywords": ["STATS", "SORT", "LIMIT", "COUNT"],
          "requestedDocumentation": {
            "STATS": "# STATS ... BY\n\nThe `STATS ... BY`...",
            "SORT": "# SORT\n\nThe SORT command...",
            "LIMIT": "# LIMIT\n\nThe LIMIT command...",
            "COUNT": "# COUNT\n\n....",
            "SYNTAX": "# ES|QL Syntax Guide....",
            "OVERVIEW": "## ES|QL Overview\n\n### ES|QL....",
            "OPERATORS": "# ES|QL Operators\n\nThis document...."
          }
        },
        "name": "query",
        "content": {}
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:51.481Z",
      "message": {
        "role": "assistant",
        "function_call": {
          "name": "execute_query",
          "arguments": {
            "query": "FROM traces-apm*,apm-*,traces-*.otel-* | STATS COUNT(*) BY service.name | SORT COUNT(*) DESC | LIMIT 5"
          },
          "trigger": "assistant"
        },
        "content": ""
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:51.619Z",
      "message": {
        "role": "user",
        "name": "execute_query",
        "content": {
          "message": "The query failed to execute",
          "error": {
            "name": "ResponseError",
            "message": "verification_exception\n\tRoot causes:\n\t\tverification_exception: Found 1 problem\nline 1:1: Unknown index [traces-apm*,apm-*,traces-*.otel-*]"
          }
        }
      }
    },
    {
      "@timestamp": "2024-10-09T13:58:56.600Z",
      "message": {
        "role": "assistant",
        "function_call": { "name": "", "arguments": "", "trigger": "assistant" },
        "content": "I'm sorry, but it seems like there are no indices matching the pattern \"traces-apm*,apm-*,traces-*.otel-*\" in your system. Therefore, I'm unable to retrieve the top 5 services by transaction volume. Please ensure that your APM data is being ingested correctly into Elasticsearch."
      }
    }
  ]
}

[elasticmachine]

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

[elasticmachine]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: 64afd53
• Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-195635-64afd53ae9f3

Failed CI Steps

• FTR Configs #85

Test Failures

• [job] [logs] FTR Configs #85 / Serverless security API cloud_security_posture Intercept the usage API request sent by the metering background task manager Should intercept usage API request for CSPM

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
observabilityAIAssistantApp	380	381	+1
searchAssistant	303	304	+1
total			+2

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
observabilityAIAssistantApp	238.2KB	238.7KB	+523.0B
searchAssistant	179.2KB	179.7KB	+526.0B
total			+1.0KB

History

• 💔 Build #242778 failed 40a6ae1c3b4f34e3271b7922740f702c016e15fa
• 💔 Build #242748 failed e409dbf18768e25bdf16833397a8826546071d20
• 💚 Build #242662 succeeded dcbb8695c2ae0e382639b62e62dacbd0385312fd
• 💚 Build #242619 succeeded 1ece766ad753e207b71f7a2ee6d69877b88775a5
• 💛 Build #242570 was flaky 154e00f5970cad9b2c55b62fdb6c720c2fe1086f

cc @viduni94

[kibanamachine]

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/11368045522

[kibanamachine]

💚 All backports created successfully

Status	Branch	Result
✅	8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation