Prompt Structure in Conversations with Generative AI

Summary: Most prompts contain a combination of the following components: request, framing context, format specification, and one or more references to previous answers or external sources. There are also 3 types of unconventional prompts that do not follow this structure: "Can you do X," "Give me more," and filler prompts.

Our study of AI-chatbot interactions shows that most AI prompts contain one or more of several key components. These components help articulate the users’ information need. Prompts that lack certain components can result in long, inefficient conversations, with many query refinements.

Designers can support users by providing AI-interface elements that make it easy to include the different prompt components.

Our Research

In May and June 2023, we conducted a 2-week diary study involving 18 participants who used ChatGPT 4.0, Bard, and Bing Chat. Participants logged 425 conversations and rated each for helpfulness and trustworthiness. At the end of the study, we conducted in-depth interviews with 14 participants.