Connect with us

AI

Prompting 101: Writing prompts for AI

Published

on

Get up to 30%* off! Get going with GoDaddy!

Class is in session

AI chatbots have become a game-changer. As digital assistants, they can help generate content, streamline service and processes, enhance experiences, drive growth, answer questions, and so much more. To unlock their full potential, it’s crucial to understand the craft of prompting, speaking to the AI chatbots in a way that they give the results that we want. And our guide to writing prompts for AI is here to teach you how to do just that.

Writing prompts for AI

What are AI prompts?

A prompt is an input, a text command or a question provided to an AI model, with the aim of generating a desired output like content or answer. It is like asking a question or giving the AI a command to get the desired answer or outcome.  Prompting is providing a cue to an AI language model, and it’s essential for obtaining high-quality responses from generative AI models like ChatGPT, Google Bard and Bing AI.

The better the prompt, the better the results.

So, what makes a good prompt? Effective prompts that are clear, specific, and tailored to the task at hand can improve the accuracy and relevance of the agenerated responses. Think about what you want the AI to accomplish and give it a prompt that will get you there. While it may take some extra effort to craft effective prompts, the high-quality responses that you’ll receive make it worthwhile.

Related: AI prompts for small business owners

Back to top.

5 steps for writing effective AI prompts

This guide is designed to help you learn the craft of prompting, enabling you to get the most out of these AI chatbots.

1. Understand the basics

A prompt is a message or question that you provide to the chatbot to generate a response. The purpose of a prompt is to provide a specific direction or goal for the chatbot to work towards, allowing it to produce more relevant and accurate responses.

In the context of chatbots, prompts serve as the input to the system, while the response generated by the chatbot is the output. By providing a clear and concise prompt, you can influence the output generated by the chatbot and obtain the information or response that you’re looking for.

Related: How solopreneurs can lean on generative AI to scale their business

Back to top.

2. Know your chatbot

Picture of a white robotic hand, palm open, outstretched

When it comes to working with chatbots, it’s important to understand the differences between popular systems like ChatGPT, Google Bard and Bing AI. Each system has its own unique strengths and weaknesses, and understanding these differences can help you craft more effective prompts and obtain better results.

ChatGPT

ChatGPT is known for its ability to generate natural-sounding responses, making it a great option for tasks like customer support or chat-based interactions. The system is trained on a massive dataset of human language, allowing it to produce responses that are fluent and contextually relevant. However, it can sometimes struggle with tasks that require a more creative or specific approach.

Related: Getting started with ChatGPT — A beginner’s guide to creating with AI

Google Bard

Google Bard is designed to produce creative and engaging content. The system is trained on a large dataset of poetry and prose, allowing it to generate responses that are poetic, humorous, or emotionally evocative. This makes it a great option for tasks like content creation or social media management. However, it can sometimes produce responses that are overly verbose or irrelevant to the task at hand.

Bing AI

Bing AI is designed to produce more concise and specific responses, making it a great option for tasks that require a high degree of accuracy or specificity. The system is optimized for tasks like question-answering or fact-checking, and it excels at producing responses that are brief and to the point. However, it can sometimes struggle with tasks that require more complex or nuanced responses.

Each chatbot also has its own unique syntax and instructions, which can affect the way you craft your prompts. For example, ChatGPT may require you to provide a specific context or topic in your prompt, while Google Bard may require more creative or conversational prompts. Understanding the specific requirements of each chatbot can help you craft more effective prompts and obtain better results.

Any chatbot and model can produce inaccurate or unintended results. Make sure that you check your work.

By understanding the unique strengths and weaknesses of each system and crafting effective prompts accordingly, you can improve your outcomes and achieve your goals with greater speed and efficiency. Try them out and see which fits your needs best!

Related: The essential small business guide to generative AI

Back to top.

3. Craft effective prompts

Crafting effective prompts is key to getting high-quality results from chatbots like ChatGPT, Google Bard and Bing AI. Here are some tips and strategies to help you create better prompts:

  • Talk to it like it’s intelligent. When talking to the chatbot, treat it as if you’re conversating with an intelligent human, using natural language and coherent questions to obtain more accurate and useful responses.
  • Be clear and specific. Clear and specific prompts are crucial for guiding the chatbot to generate relevant and accurate responses. For example, if you’re using a chatbot for customer support, a clear and specific prompt might be: “Please describe the issue you’re experiencing in detail.”
  • Use context and set the stage. Providing context can help the chatbot understand the purpose of the prompt and generate more relevant responses. For example, if you’re using a chatbot for product recommendations, a prompt like “What are your favorite products?” may not be as effective as “Can you recommend a product that’s similar to [specific product name]?”
  • Make it personal and specific. Include your name, product, or company name, background information, topic, highlights, tone, format (like a list or blog), and length.
  • Define the role and expertise. Tell the AI to assume the identity of a profession (like a copywriter, marketer, developer, coach, professor, or HR).
  • Set the style. Choose a style such as academic, instructive, journalistic, critical, creative, conversational, or professional.
  • Set the tone. Opt for a tone like confident, witty, or dramatic.
  • Use the right format and tone. Tailoring your prompt’s format and tone to match your goal is essential for getting the desired response. For example, if you’re using a chatbot for professional purposes, maintaining a formal tone might be more effective: “Kindly suggest some strategies to increase website traffic for a small business.” On the other hand, if you’re seeking creative ideas, adopting a more casual tone could yield better results: “Hey, what are some fun ways to promote a small business on social media?”
  • Experiment with question phrasing. Rephrasing questions and testing multiple variations can help you find the best possible prompt. For example, instead of asking “How can we improve our product?” you might try “What features would you like to see added to our product?” or “What are your biggest pain points when using our product?”

Poorly written prompt example: “Tell me about marketing.”

Strong prompt example: “Act as a master marketer, and in a professional tone, explain three essential digital marketing strategies that a small business should implement to increase their online visibility and drive sales. Please write a 200-word explanation with 3 bullet points following.”

Prompt template:

  • Role: Specify the role you want the chatbot to assume, such as a business strategist, educator, or marketing expert.
  • Objective: Indicate the intent of the content to be generated, e.g., blog article, social media update, product overview, FAQ, or ask a question.
  • Details: Include relevant information like the business, brand, or product name.
  • Background: Offer a concise background of the business or brand, highlighting its primary product or service offerings, target customers, and unique selling propositions.
  • Content subject: Define the central topic or theme of the content to be generated.
  • Context and objectives: Supply context, particular goals for the role, and company details to help the chatbot grasp your expectations, e.g., “As a specialist in ecommerce and collaborating with ‘Business Y’, a top online marketplace, offer advice for enhancing the user experience of their website.”
  • Writing style: Indicate the preferred style for the content, e.g., formal, casual, convincing, educational, etc.
  • Structure: Mention any specific format or organization, e.g., bullet points, paragraphs, Q&A, etc.
  • Supplementary details: Incorporate any other pertinent information or context that may support The chatbot in producing the content, such as particular examples or directions.
  • Voice: Indicate if you’d like it to be in a certain style like Shakespeare.

Pro tip: After creating your text, run the prompt: Act as a plagiarism checker and analyze this text for potential plagiarism, then suggest rewrites or modifications to ensure originality, and retain similar format, tone and length: [paste generated text]. Once the text is output, re-read and revise it to ensure that it speaks to your needs.

Back to top.

4. Improve your AI prompts

Person working on a laptop

Person working on a laptop

Ready to build on what we’ve discussed so far? Here are some further steps to take to improve on your prompt writing:

  • Offer the AI step-by-step instructions. Breaking down complex queries into simpler steps can help you get better results and more accurate responses.
  • Identify main ideas: Find the most important parts of your question.

Example: A business owner wants to improve their online presence to drive sales. Main ideas: online presence, drive sales.

  • Simplify your question. Turn your complex question into simpler, specific questions about each main idea.

Example: What makes a strong online presence? How does a better online presence drive sales?

  • Ask the chatbot. Enter the simple questions one by one for more focused answers.
  • Utilize prompt chains. Break down complex queries into a series of connected, simpler questions to obtain better results and more accurate responses.
  • Write shorter questions. Break down your complex question into smaller specific questions and order them in a logical order. Ask the chatbot these simpler questions one by one, using the answers to build a comprehensive response.
    Example: Improving Customer Service Complex question: “How can I improve customer service at my online store?”

Prompt chain:

  • What are the common pain points customers face when shopping online?
    [allow to answer, then type in the next]
  • What tools or processes can be implemented to address these pain points?
    [allow to answer, then type in the next]
  • How can the store proactively communicate with customers to improve their shopping experience?

Pro tip: One way to achieve longer text is a simple prompt chain. After text is generated, type in “tell me more…”

Here are some further prompt descriptions that can enhance the chatbot’s output:

  • Linguistic and cultural context: Indicate the language and cultural background related to the discussion or subject, assisting the chatbot in producing more precise and pertinent responses.
  • Emotion and sentiment: Point out the desired emotional tone or sentiment you want to express in your conversation or subject, such as joy, sorrow, frustration, or astonishment.
  • Imagery and sensory details: Offer visual or sensory details to aid the chatbot in creating more vivid and captivating responses, like describing a setting or an item.
  • Actionable steps: Incorporate a call to action in your prompt, prompting the chatbot to create responses that inspire or convince the reader to act.
  • Brand character and identity: Determine the brand character and identity you wish to portray in your conversation or subject, like approachable, authoritative, or lighthearted.
  • Sector or niche-specific terminology: Supply sector or niche-specific terminology, helping the chatbot to produce responses customized for a particular audience or subject.
  • Historical or cultural allusions: Add historical or cultural allusions to assist the chatbot in creating responses that are both pertinent and informative.
  • Humor or amusement factor: Specify if you’d like the chatbot to produce responses with a humorous or entertaining aspect to engage readers.

Intermediate prompt writing tip

Use this prompt to quickly and effectively “tune” your prompts. Copy and paste or type this before starting a chat:

I’d like you to act as my prompt assistant. Your mission is to help me create the most effective prompt for my requirements, which will be used by you, The chatbot. To achieve this, we’ll follow these steps:

  • Your initial response should be to inquire about the topic of the prompt. I’ll provide my input, and we’ll refine it through subsequent iterations by going through the following steps.
  • Based on my input, you’ll produce 3 sections: a) refined prompt (supply an improved version of the prompt that is clear, concise, and easy for you to understand), b) recommendations (suggest what details could be added to the prompt for improvement), and c) inquiries (ask relevant questions related to any extra information needed from me to enhance the prompt).
  • We’ll continue this iterative process, with me giving more information and you updating the Refined Prompt section until it’s perfect.

Keep refining until you’re satisfied, then simply copy and paste the improved prompt into a new chat. Witness the transformation!

Back to top.

5. Practice advanced prompt engineering

From here, you can further level up your prompt writing skills with these more-advanced tips:

  • System message prompts: Use system messages to set context and guide chatbots for more accurate answers.
  • Set the context: Describe the conversation’s purpose, background information and main goal.

Example: [System message] You are an AI assistant helping a business owner improve their online presence to drive sales.

  • Guide the chatbot: Remind the chatbot of its purpose when dealing with complex questions.

Example: [System message] Remember, we’re focusing on strategies for businesses to enhance their online presence and drive sales.

  • Temperature parameters: Adjust the temperature to control the type of answers chatbots give.
    • For focused answers: Set a low temperature (e.g., 0.2-0.5) when you need specific information or a direct answer.
    • Example: What are the top 3 strategies for businesses to improve their online presence?
      • For creative answers: Set a high temperature (e.g., 0.8-1.0) when looking for brainstorming ideas or multiple solutions.

Troubleshooting common issues

Common issues when using chatbots include receiving irrelevant, incomplete, or overly verbose responses. To improve response quality:

  • Reframe your question: Make it more specific or rephrase it to avoid ambiguity. Example: Instead of “How to increase sales?”, ask “What are effective strategies for a small business to increase sales online?”
  • Break down complex queries: Divide your question into smaller, simpler parts to get more focused answers.

Back to top.

Suggested uses for generative AI

Person placing sticky notes on a whiteboard

Person placing sticky notes on a whiteboard

Here is a list of some ideas of the various tasks that chatbots can be used for. This list is not comprehensive, it is ultimately as long as your imagination!

  1. Idea generation and brainstorming:
    • Generate new ideas
    • Combine existing concepts
    • Get inspired by other creators
    • Explore online forums or communities
    • Reverse-engineer popular content
  2. Content creation and optimization:
    • Write compelling ad copy
    • Craft engaging email content
    • Develop creative ad concepts
    • Utilize social media
    • Optimize SEO
    • Improve ad visuals
    • Consider localization
  3. Editing and proofreading:
    • Read for clarity
    • Rearrange sentences
    • Enhance word choice
    • Check grammar and spelling
    • Simplify complex sentences
    • Ensure consistency
    • Summarization
    • Suggest revisions and additions
  4. Research and analysis:
    • Analyze ad performance
    • Analyze demographic data
    • Understand pain points
    • Research industry trends
    • Research relevant keywords
  5. Audience targeting and campaign management:
    • Target specific demographics
    • Create tailored content
    • Leverage influencers
    • Use the appropriate tone
    • Tailor campaigns
    • Plan social media posts
    • A/B test messaging
    • Curate resonating content
  6. Organization and planning:
    • Set deadlines
    • Develop a task list
    • Prioritize activities
    • Allocate resources
    • Delegate responsibilities
    • Set milestones
    • Plan for contingencies
  7. Feedback and improvement:
    • Ask for feedback
    • Incorporate feedback
    • Monitor progress
    • Test and revise

Back to top.

Ethics and responsible use

Using AI chatbots responsibly and ethically is important to prevent problems like wrong information, biases and negative effects. Chatbots learn from data that might have biases, so make sure to ask questions that promote fair answers and don’t support stereotypes or false information.

Keep private information safe by not sharing or asking for sensitive details with the chatbot. Be careful when discussing sensitive topics, legal matters or health issues, because chatbots could give incorrect or harmful advice.

Back to top.

Conclusion

As you practice and refine your prompting skills, remember that continuous learning and adaptation are essential. Chatbots will continue to evolve and improve, and so should your strategies for engaging with them.



Get Hosting for $1.00*/mo with GoDaddy!

This post was originally published on this site

Continue Reading

AI

Revolutionizing Marketing: The Power of AI in the Digital Age

Published

on

Embracing AI-Powered Marketing: Transforming Brands in the Digital Marketplace

In the crowded digital marketplace, standing out is challenging. Enter AI-powered marketing, a revolutionary upgrade transforming brands into digital powerhouses.

Hyper-Personalized Campaigns: Beyond Basic Personalization

Gone are the days of generic marketing. Today’s gold standard is AI-driven hyper-personalization. This approach uses customer data analysis to create deeply resonant, individualized marketing campaigns. With AI’s ability to segment audiences based on intricate criteria, including purchasing history and browsing behavior, your messages can hit the mark every time.

Enhanced Customer Journey Mapping

AI’s capabilities extend to mapping the entire customer journey. By predicting needs and preferences at each stage, AI aids in crafting narratives that guide customers from discovery to purchase, integrating your brand into their personal stories.

SEO Wizardry: Mastering Search Engine Dynamics

With ever-changing algorithms, SEO is a complex puzzle. AI serves as a sophisticated navigator, deciphering these changes through machine learning. It aids in keyword optimization, understanding search intent, and aligning content with search trends.

Predictive SEO

AI tools offer predictive SEO, anticipating search engine and user behavior changes. This proactive stance ensures your brand’s prominent visibility in search results, capturing the right audience at the right time.

Social Media Mastery: Crafting a Digital Narrative

AI transforms social media strategies from uncertain to precise. By analyzing vast social data, AI provides insights into resonating content.

Content Optimization

AI analyzes performance data to recommend effective content types. This data-driven approach refines your social media content strategy.

Engagement Analysis

AI examines user interaction nuances, understanding engagement patterns. It helps tailor interactions for maximum impact, including adjusting posting schedules and messaging for increased relevance.

Conclusion: Navigating the AI-Driven Marketing Landscape

AI-powered marketing is essential for thriving in the digital age, offering precision and personalization beyond traditional methods. For small businesses, it’s a chance to leverage AI for impactful, data-driven strategies.

As we embrace the AI revolution, the future of marketing is not just bright but intelligently radiant. With AI as your digital ally, your brand is equipped for a successful journey, making every marketing effort and customer interaction count.

Continue Reading

AI

AI: Your Small Business Ally in a Digital Age

Published

on

In the ever-evolving landscape of modern commerce, small business owners find themselves at a crossroads of opportunity and obsolescence. Enter Artificial Intelligence (AI) – once the exclusive domain of tech behemoths, it now stands as the great equalizer, offering small businesses a competitive edge previously unthinkable. The emergence of AI as a wingman for small businesses is not just a fleeting trend but a fundamental shift in how entrepreneurs can leverage technology to revolutionize their operations.

The 24/7 Customer Service Hero: Chatbots

In the digital storefront, customer service is the heartbeat of business survival and success. Chatbots emerge as the indefatigable heroes of this domain. Envision a customer service agent that never clocks out an entity that requires no sleep or sustenance yet delivers consistently and instantaneously. These AI-driven chat interfaces embody the essence of your brand’s voice, capable of handling a barrage of customer queries with a speed that outpaces the swiftest of typists. They are the embodiment of efficiency – ensuring that customer satisfaction is not just met but exceeded around the clock.

Unearthing Market Treasures: Data Dive

AI’s prowess in pattern recognition has catapulted data analytics into a realm once considered the stuff of science fiction. Small business owners armed with AI tools can sift through vast swathes of data to extract actionable insights. These algorithms act as modern-day oracles, predicting market trends, discerning customer behaviors, and offering sales forecasts with remarkable accuracy. Equipped with: this knowledge, small businesses, can navigate the market with the foresight and precision of an experienced captain steering through foggy seas.

Personalization at Scale: Customize Like a Boss

The age-old business mantra of the customer is king is given new potency with AI’s personalization capabilities. Tailoring the customer experience is no longer a luxury but a necessity. AI enables small businesses to offer bespoke experiences to consumers, making them feel like the sole focus of their attention. It’s personalization executed with such finesse that customers are left marveling at the thoughtfulness and individual attention, fostering loyalty and establishing deep-rooted brand connections.

Offloading the Mundane: Task Slayers

Repetitive tasks are the bane of creativity and innovation. AI steps in as the ultimate task slayer, automating routine chores that once consumed disproportionate amounts of time. From scheduling appointments to managing inventory, AI liberates entrepreneurs from the drudgery of administrative duties, freeing them to refocus on the creative and strategic endeavors that propel business growth.

Mastering Social Media: Social Savants

Social media – the pulsing vein of modern marketing – demands astuteness and agility. AI emerges as the savant of social media, capable of demystifying platform algorithms to optimize content delivery. It knows the optimal times to post, the types of content that resonate with audiences, and the strategies that convert passive scrollers into engaged customers. By automating your social media presence, AI transforms your brand into an online sensation, cultivating a digital community of brand ambassadors.

The Verdict: Embracing AI

For a small business owner, AI is not about an overnight overhaul but strategic integration. The goal is to start small, allowing AI to shoulder incremental aspects of your business, learning and scaling as you witness tangible benefits. The transition to AI-enablement does not necessitate a background in technology; it requires a willingness to embrace change and a vision for the future.

In summary, as the digital revolution marches forward, AI stands ready to partner with small businesses, providing them with tools once deemed the province of giants. This partnership promises to elevate the small business landscape, ushering in an era of democratized technology where every entrepreneur can harness the power of AI to write their own David vs. Goliath success story. AI, the once-distant dream, is now the most loyal wingman a small business can enlist in its quest for growth and innovation.

Continue Reading

AI

How to Train Generative AI Using Your Company’s Data

Published

on

Many companies are experimenting with ChatGPT and other large language or image models. They have generally found them to be astounding in terms of their ability to express complex ideas in articulate language. However, most users realize that these systems are primarily trained on internet-based information and can’t respond to prompts or questions regarding proprietary content or knowledge.

Leveraging a company’s propriety knowledge is critical to its ability to compete and innovate, especially in today’s volatile environment. Organizational Innovation is fueled through effective and agile creation, management, application, recombination, and deployment of knowledge assets and know-how. However, knowledge within organizations is typically generated and captured across various sources and forms, including individual minds, processes, policies, reports, operational transactions, discussion boards, and online chats and meetings. As such, a company’s comprehensive knowledge is often unaccounted for and difficult to organize and deploy where needed in an effective or efficient way.

Emerging technologies in the form of large language and image generative AI models offer new opportunities for knowledge management, thereby enhancing company performance, learning, and innovation capabilities. For example, in a study conducted in a Fortune 500 provider of business process software, a generative AI-based system for customer support led to increased productivity of customer support agents and improved retention, while leading to higher positive feedback on the part of customers. The system also expedited the learning and skill development of novice agents.

Like that company, a growing number of organizations are attempting to leverage the language processing skills and general reasoning abilities of large language models (LLMs) to capture and provide broad internal (or customer) access to their own intellectual capital. They are using it for such purposes as informing their customer-facing employees on company policy and product/service recommendations, solving customer service problems, or capturing employees’ knowledge before they depart the organization.

These objectives were also present during the heyday of the “knowledge management” movement in the 1990s and early 2000s, but most companies found the technology of the time inadequate for the task. Today, however, generative AI is rekindling the possibility of capturing and disseminating important knowledge throughout an organization and beyond its walls. As one manager using generative AI for this purpose put it, “I feel like a jetpack just came into my life.” Despite current advances, some of the same factors that made knowledge management difficult in the past are still present.

The Technology for Generative AI-Based Knowledge Management

The technology to incorporate an organization’s specific domain knowledge into an LLM is evolving rapidly. At the moment there are three primary approaches to incorporating proprietary content into a generative model.

Training an LLM from Scratch

One approach is to create and train one’s own domain-specific model from scratch. That’s not a common approach, since it requires a massive amount of high-quality data to train a large language model, and most companies simply don’t have it. It also requires access to considerable computing power and well-trained data science talent.

One company that has employed this approach is Bloomberg, which recently announced that it had created BloombergGPT for finance-specific content and a natural-language interface with its data terminal. Bloomberg has over 40 years’ worth of financial data, news, and documents, which it combined with a large volume of text from financial filings and internet data. In total, Bloomberg’s data scientists employed 700 tokens, or about 350 billion words, 50 billion parameters, and 1.3 million hours of graphics processing unit time. Few companies have those resources available.

Fine-Tuning an Existing LLM

A second approach is to “fine-tune” train an existing LLM to add specific domain content to a system that is already trained on general knowledge and language-based interaction. This approach involves adjusting some parameters of a base model, and typically requires substantially less data — usually only hundreds or thousands of documents, rather than millions or billions — and less computing time than creating a new model from scratch.

Google, for example, used fine-tune training on its Med-PaLM2 (second version) model for medical knowledge. The research project started with Google’s general PaLM2 LLM and retrained it on carefully curated medical knowledge from a variety of public medical datasets. The model was able to answer 85% of U.S. medical licensing exam questions — almost 20% better than the first version of the system. Despite this rapid progress, when tested on such criteria as scientific factuality, precision, medical consensus, reasoning, bias and harm, and evaluated by human experts from multiple countries, the development team felt that the system still needed substantial improvement before being adopted for clinical practice.

The fine-tuning approach has some constraints, however. Although requiring much less computing power and time than training an LLM, it can still be expensive to train, which was not a problem for Google but would be for many other companies. It requires considerable data science expertise; the scientific paper for the Google project, for example, had 31 co-authors. Some data scientists argue that it is best suited not to adding new content, but rather to adding new content formats and styles (such as chat or writing like William Shakespeare). Additionally, some LLM vendors (for example, OpenAI) do not allow fine-tuning on their latest LLMs, such as GPT-4.

Prompt-tuning an Existing LLM

Perhaps the most common approach to customizing the content of an LLM for non-cloud vendor companies is to tune it through prompts. With this approach, the original model is kept frozen, and is modified through prompts in the context window that contain domain-specific knowledge. After prompt tuning, the model can answer questions related to that knowledge. This approach is the most computationally efficient of the three, and it does not require a vast amount of data to be trained on a new content domain.

Morgan Stanley, for example, used prompt tuning to train OpenAI’s GPT-4 model using a carefully curated set of 100,000 documents with important investing, general business, and investment process knowledge. The goal was to provide the company’s financial advisors with accurate and easily accessible knowledge on key issues they encounter in their roles advising clients. The prompt-trained system is operated in a private cloud that is only accessible to Morgan Stanley employees.

While this is perhaps the easiest of the three approaches for an organization to adopt, it is not without technical challenges. When using unstructured data like text as input to an LLM, the data is likely to be too large with too many important attributes to enter it directly in the context window for the LLM. The alternative is to create vector embeddings — arrays of numeric values produced from the text by another pre-trained machine learning model (Morgan Stanley uses one from OpenAI called Ada). The vector embeddings are a more compact representation of this data which preserves contextual relationships in the text. When a user enters a prompt into the system, a similarity algorithm determines which vectors should be submitted to the GPT-4 model. Although several vendors are offering tools to make this process of prompt tuning easier, it is still complex enough that most companies adopting the approach would need to have substantial data science talent.

However, this approach does not need to be very time-consuming or expensive if the needed content is already present. The investment research company Morningstar, for example, used prompt tuning and vector embeddings for its Mo research tool built on generative AI. It incorporates more than 10,000 pieces of Morningstar research. After only a month or so of work on its system, Morningstar opened Mo usage to their financial advisors and independent investor customers. It even attached Mo to a digital avatar that could speak out its answers. This technical approach is not expensive; in its first month in use, Mo answered 25,000 questions at an average cost of $.002 per question for a total cost of $3,000.

Content Curation and Governance

As with traditional knowledge management in which documents were loaded into discussion databases like Microsoft Sharepoint, with generative AI, content needs to be high-quality before customizing LLMs in any fashion. In some cases, as with the Google Med-PaLM2 system, there are widely available databases of medical knowledge that have already been curated. Otherwise, a company needs to rely on human curation to ensure that knowledge content is accurate, timely, and not duplicated. Morgan Stanley, for example, has a group of 20 or so knowledge managers in the Philippines who are constantly scoring documents along multiple criteria; these determine the suitability for incorporation into the GPT-4 system. Most companies that do not have well-curated content will find it challenging to do so for just this purpose.

Morgan Stanley has also found that it is much easier to maintain high quality knowledge if content authors are aware of how to create effective documents. They are required to take two courses, one on the document management tool, and a second on how to write and tag these documents. This is a component of the company’s approach to content governance approach — a systematic method for capturing and managing important digital content.

At Morningstar, content creators are being taught what type of content works well with the Mo system and what does not. They submit their content into a content management system and it goes directly into the vector database that supplies the OpenAI model.

Quality Assurance and Evaluation

An important aspect of managing generative AI content is ensuring quality. Generative AI is widely known to “hallucinate” on occasion, confidently stating facts that are incorrect or nonexistent. Errors of this type can be problematic for businesses but could be deadly in healthcare applications. The good news is that companies who have tuned their LLMs on domain-specific information have found that hallucinations are less of a problem than out-of-the-box LLMs, at least if there are no extended dialogues or non-business prompts.

Companies adopting these approaches to generative AI knowledge management should develop an evaluation strategy. For example, for BloombergGPT, which is intended for answering financial and investing questions, the system was evaluated on public dataset financial tasks, named entity recognition, sentiment analysis ability, and a set of reasoning and general natural language processing tasks. The Google Med-PaLM2 system, eventually oriented to answering patient and physician medical questions, had a much more extensive evaluation strategy, reflecting the criticality of accuracy and safety in the medical domain.

Life or death isn’t an issue at Morgan Stanley, but producing highly accurate responses to financial and investing questions is important to the firm, its clients, and its regulators. The answers provided by the system were carefully evaluated by human reviewers before it was released to any users. Then it was piloted for several months by 300 financial advisors. As its primary approach to ongoing evaluation, Morgan Stanley has a set of 400 “golden questions” to which the correct answers are known. Every time any change is made to the system, employees test it with the golden questions to see if there has been any “regression,” or less accurate answers.

Legal and Governance Issues

Legal and governance issues associated with LLM deployments are complex and evolving, leading to risk factors involving intellectual property, data privacy and security, bias and ethics, and false/inaccurate output. Currently, the legal status of LLM outputs is still unclear. Since LLMs don’t produce exact replicas of any of the text used to train the model, many legal observers feel that “fair use” provisions of copyright law will apply to them, although this hasn’t been tested in the courts (and not all countries have such provisions in their copyright laws). In any case, it is a good idea for any company making extensive use of generative AI for managing knowledge (or most other purposes for that matter) to have legal representatives involved in the creation and governance process for tuned LLMs. At Morningstar, for example, the company’s attorneys helped create a series of “pre-prompts” that tell the generative AI system what types of questions it should answer and those it should politely avoid.

User prompts into publicly-available LLMs are used to train future versions of the system, so some companies (Samsung, for example) have feared propagation of confidential and private information and banned LLM use by employees. However, most companies’ efforts to tune LLMs with domain-specific content are performed on private instances of the models that are not accessible to public users, so this should not be a problem. In addition, some generative AI systems such as ChatGPT allow users to turn off the collection of chat histories, which can address confidentiality issues even on public systems.

In order to address confidentiality and privacy concerns, some vendors are providing advanced and improved safety and security features for LLMs including erasing user prompts, restricting certain topics, and preventing source code and propriety data inputs into publicly accessible LLMs. Furthermore, vendors of enterprise software systems are incorporating a “Trust Layer” in their products and services. Salesforce, for example, incorporated its Einstein GPT feature into its AI Cloud suite to address the “AI Trust Gap” between companies who desire to quickly deploy LLM capabilities and the aforementioned risks that these systems pose in business environments.

Shaping User Behavior

Ease of use, broad public availability, and useful answers that span various knowledge domains have led to rapid and somewhat unguided and organic adoption of generative AI-based knowledge management by employees. For example, a recent survey indicated that more than a third of surveyed employees used generative AI in their jobs, but 68% of respondents didn’t inform their supervisors that they were using the tool. To realize opportunities and manage potential risks of generative AI applications to knowledge management, companies need to develop a culture of transparency and accountability that would make generative AI-based knowledge management systems successful.

In addition to implementation of policies and guidelines, users need to understand how to safely and effectively incorporate generative AI capabilities into their tasks to enhance performance and productivity. Generative AI capabilities, including awareness of context and history, generating new content by aggregating or combining knowledge from various sources, and data-driven predictions, can provide powerful support for knowledge work. Generative AI-based knowledge management systems can automate information-intensive search processes (legal case research, for example) as well as high-volume and low-complexity cognitive tasks such as answering routine customer emails. This approach increases efficiency of employees, freeing them to put more effort into the complex decision-making and problem-solving aspects of their jobs.

Some specific behaviors that might be desirable to inculcate — either though training or policies — include:

  • Knowledge of what types of content are available through the system;
  • How to create effective prompts;
  • What types of prompts and dialogues are allowed, and which ones are not;
  • How to request additional knowledge content to be added to the system;
  • How to use the system’s responses in dealing with customers and partners;
  • How to create new content in a useful and effective manner.

Both Morgan Stanley and Morningstar trained content creators in particular on how best to create and tag content, and what types of content are well-suited to generative AI usage.

“Everything Is Moving Very Fast”

One of the executives we interviewed said, “I can tell you what things are like today. But everything is moving very fast in this area.” New LLMs and new approaches to tuning their content are announced daily, as are new products from vendors with specific content or task foci. Any company that commits to embedding its own knowledge into a generative AI system should be prepared to revise its approach to the issue frequently over the next several years.

While there are many challenging issues involved in building and using generative AI systems trained on a company’s own knowledge content, we’re confident that the overall benefit to the company is worth the effort to address these challenges. The long-term vision of enabling any employee — and customers as well — to easily access important knowledge within and outside of a company to enhance productivity and innovation is a powerful draw. Generative AI appears to be the technology that is finally making it possible.

Advertisement

This post was originally published on this site

Continue Reading

Trending

SmallBiz.com does not provide legal or accounting advice and is not associated with any government agency. Copyright © 2023 UA Services Corp - All Rights Reserved.