The AI PioneerPlain-language field notes on putting AI to work in a real business. From Levelbrook.

The AI Pioneer / Phones, intake and supportNo. 53

AI voice agent or chatbot: which one your business should automate first

How to choose between a phone agent and a chat bot based on how your customers actually reach you, what each costs to run, where each one fails, and the order that keeps the risk low.

11 minute read. Updated 2026-09-17. Ask about your business

Every vendor who calls you sells one of two things. The first says your phone is ringing unanswered and an AI voice agent will pick up every call. The second says your customers want to type, not talk, and a chatbot on the site will handle it. Both have a demo. Both sound right. You can afford one of them this quarter.

The AI voice agent vs chatbot decision is not about which technology is better. It is about which channel your customers already use when they have money in their hand, and which failure you can afford. A plumber and an online furniture store should not make the same choice, and a law firm should probably make a third one.

What each of these actually is

An AI voice agent is software that answers a phone call, listens, and talks back. Under the hood it turns your caller’s speech into text, sends that text to a language model (an LLM, the kind of system behind Claude, GPT-class models and Gemini) with your instructions, and turns the reply back into speech, all in about a second. Platforms like Vapi, Retell and Bland package this up; Twilio provides the phone lines underneath many of them. It can take a message, book an appointment, answer questions from material you gave it, and transfer to a person.

An AI chatbot does the same thing in text: a widget on your website, or a reply in SMS, WhatsApp or Messenger. It reads what the customer typed, consults your material, and answers. Intercom, Zendesk and HubSpot all sell one; a custom one can be built on the model providers directly.

The business analogy: the voice agent is a front-desk hire who only answers the phone. The chatbot is one who only answers the contact form. Both are junior. Both need a written brief and a manager to hand things to. The question is which desk has the queue.

AI voice agent vs chatbot: how to decide, step by step

1. Count where the money actually arrives

Before anything else, look at thirty days of real contacts: how many calls, web chats, form submissions, emails, texts. Then, for the ones that turned into revenue, which channel did they come through. Your phone system, website analytics and inbox can give you the counts in an afternoon.

The pattern is usually stark. Trades, clinics, and anything urgent or local are call-heavy: a homeowner with a leak dials, they do not type. Professional services (law, accounting, agencies) are form-heavy: the first contact is a web form or an email, and a call comes second. E-commerce and anything where the customer is already on your site is chat-heavy. Automate the channel with the queue, not the one with the shinier demo.

2. Score the risk of a wrong answer on each channel

A wrong answer on the phone is worse than a wrong answer in chat, for three reasons. It happens in real time, so there is no moment for a person to review before the customer hears it. There is no transcript the customer can re-read, so misunderstandings compound. And callers are more often in a hurry or upset, so patience is shorter.

Chat is more forgiving. The customer can see the answer, the bot can show its source, and a handoff is a message in a thread rather than a hold tone. So if both channels have a queue, our view is that chat is the safer place to learn (AI Customer Support Chatbot Best Practices That Customers Accept covers it), and voice comes once the knowledge base and escalation process have proven themselves in text. The exception is a business whose phone is genuinely going unanswered, where any competent answer beats voicemail.

3. Match the channel to the job, not just the customer

Some jobs suit voice. After-hours message-taking with a callback promise. Overflow when the front desk is on another line. Booking a routine appointment from a calendar the agent can see. Simple status checks (“is my order shipped”). These are short, structured, and low-stakes, and a voice agent that only does these can be excellent.

Some jobs suit chat. Anything with a link, a form, a document or a price list. Anything the customer will want to refer back to. Pre-sales questions on a product page. Anything where the customer is already typing.

Some jobs suit neither, yet. Complaints. Anything involving a refund, a dispute, a medical or legal question, or a price the AI was not explicitly given. Both channels need a hard rule to hand these to a person (AI Chatbot Escalation to Human: When and How the Handoff Works), and a voice agent needs it more, because a caller who gets stonewalled by a machine remembers it.

4. Build the knowledge base before you build either

Both channels answer from the same thing: written material about your business that the AI can consult. Hours, services, prices you are willing to have quoted, service area, policies, the ten questions your staff answer every day. If that material does not exist, neither channel can work, and the vendor’s demo was answering from generic knowledge, which is how a bot ends up describing a service you do not offer.

Write the knowledge base first (Knowledge Base for an AI Chatbot: What to Write and How). Keep it plain, keep it current, and include a list of things the AI must never say. It is the most reusable asset in the project: the same material powers the chatbot, the voice agent, and eventually the email triage.

5. Start one channel in a narrow lane, then widen it

Do not launch “the AI phone agent.” Launch “the after-hours line takes a message and books callbacks.” Do not launch “the support bot.” Launch “the bot answers questions about shipping and returns, and hands everything else to the team.” A narrow lane means the AI’s instructions are short, the knowledge base is small, and the failure surface is a handful of topics you can check by hand.

Run it in the narrow lane for a month. Count the handoffs and read why. Widen one topic at a time, only when the transcripts on the current topics are clean. AI Phone Answering for Small Business: What Works in 2026 walks through the after-hours, overflow and full-front-desk stages for voice; the same staging applies to chat.

6. Make the handoff to a person a first-class feature, not a fallback

The difference between an AI channel customers tolerate and one they hate is almost entirely the handoff. On chat: one click to reach a person, with the conversation so far attached, and an honest expected wait. On voice: a warm transfer during business hours, and after hours a promise (“someone will call you back before nine tomorrow”) that is actually kept, because the agent created a task in the system a person watches.

Design the handoff before the AI answers its first question: who receives it, where it lands, how fast it is acknowledged. Then instruct the AI to hand off early and generously: on anger, on money, on anything it is not sure of, and whenever the customer asks for a person. An AI that clings to a conversation is the one that ends up in a screenshot.

7. Read the transcripts every week for the first quarter

Every AI conversation, voice or text, produces a transcript. For the first three months, someone reads them. Not a sample: all of them, if volume allows, or every handoff plus a random twenty otherwise. Look for the three things: questions the AI could not answer (add them to the knowledge base), answers that were wrong (fix the material or the instructions), and tone that made you wince.

Voice transcripts are longer, messier and include transcription errors, so reviewing them takes longer; budget for it. The businesses that get lasting value from either channel are the ones where a manager still reads twenty transcripts a week a year later.

Picture a business like this one

The business below is a composite of the kind of company that writes to us, not a client. The numbers describe the shape of the problem, not a case study.

Picture a business like this one: a two-location veterinary clinic, fourteen staff, with a phone that rings through the front desk during the day and goes to voicemail at night. The website has a contact form that gets a handful of messages a week. Two vendors pitched: one a voice agent to handle all calls, one a chatbot for the site.

Thirty days of counting settled it: roughly four hundred calls a week, thirty web forms, and nearly every new client came by phone. Voice was the channel, but full-front-desk voice on day one was a risk they could not take, because a wrong answer about a sick animal is not a small thing.

What got built:

  1. A knowledge base: hours, both locations, services, the routine appointment types and durations, what counts as an emergency and the emergency number, and a list of things the agent must never do (diagnose, advise on medication, quote surgical prices).
  2. An after-hours voice agent only: it identifies itself as an assistant, takes a message, reads the emergency rule for anything that sounds urgent, and books routine appointments from the practice calendar.
  3. Every call transcribed and summarised into the practice system, with a callback task for the morning team.
  4. A hard handoff: any mention of an animal in distress plays the emergency line number and offers to connect.
  5. Weekly transcript review by the practice manager, with a running list of questions the agent could not answer.

After two months of clean transcripts they widened the lane to daytime overflow. The chatbot was built six months later, from the same knowledge base, in a week.

What it costs to run

On cost, the AI voice agent vs chatbot comparison is clear: voice costs more, because there are more moving parts. A voice agent is typically billed per minute of call, combining the platform’s fee, the speech-to-text and text-to-speech services, the model, and the phone line; rough figures in 2026 run from a few cents to somewhere around ten to fifteen cents a minute all-in, depending on the platform and the voice quality you choose. Check the current pricing pages of Vapi, Retell or Bland, because the bundles change. A business taking a few hundred calls a month should expect a bill in the low hundreds of dollars.

Chat is cheaper. Model usage for a few thousand conversations a month is typically tens of dollars at current per-token rates (a token is roughly three quarters of a word). Through a support platform like Intercom or Zendesk, the AI add-on priced per resolution or per seat can be the larger cost; check the current page. A custom bot on your own site runs on a small server at $10 to $30 a month plus model usage.

Both channels share the real cost: the hours spent writing and maintaining the knowledge base, and the weekly transcript review. In our experience that time is where the value comes from.

The mistakes we see most

Choosing the channel from the demo. The AI voice agent vs chatbot decision gets made by which demo was more impressive, so a form-heavy business buys a phone agent that answers eleven calls a week.

Launching wide. The agent answers everything on day one, so the failures arrive faster than anyone can read the transcripts.

No knowledge base. The bot answers from general knowledge and invents a service. This is the single most common cause of the embarrassing screenshot.

A hidden or grudging handoff. “Are you sure you don’t want me to try again?” Customers who want a person want one now.

Not identifying as an assistant. A caller who realises halfway through that they are talking to software feels tricked. Say it in the first sentence.

Stopping the transcript review. It goes well for two months, the review stops, and the knowledge base quietly goes stale.

When to bring in help

An owner can get a long way alone. Counting the channels is a spreadsheet. Writing the knowledge base is a few afternoons with the front-desk staff. A chatbot from Intercom, Zendesk or HubSpot, restricted to your material, can be switched on without a developer. A narrow after-hours voice agent on Vapi or Retell can be configured by a careful non-developer, though the integrations are where it gets fiddly.

A developer becomes worth it when the channel has to do things, not just say things: book into your actual scheduling system, look up a real order, create a task a person will see, transfer with context, log every conversation somewhere you own. And when the two channels should share one knowledge base and one escalation queue rather than being two separate products from two vendors. AI Receptionist vs Answering Service: An Honest Comparison covers the wider staffing question if you are weighing AI against a human service.

Levelbrook builds both channels for businesses, on one knowledge base, with the handoff and the transcripts wired into the systems you already run, in accounts you own, fixed price from a written scope. If you are trying to decide which channel to start with, the form below is how the conversation starts.

Questions owners ask

Should a small business use an AI voice agent or a chatbot first?

In the AI voice agent vs chatbot decision, start with the channel that carries your revenue. Count thirty days of calls, chats and forms and see where paying customers arrive. Call-heavy businesses (trades, clinics) usually start with a narrow after-hours voice agent. Form-heavy and site-heavy businesses start with chat, which is also the lower-risk place to learn.

Is an AI voice agent riskier than a chatbot?

Yes, somewhat. Voice happens in real time with no review step, no transcript for the customer to re-read, and callers who are often in a hurry. That is why voice should launch in a narrow lane (after-hours messages, routine bookings) with a generous handoff rule, and widen only once the transcripts are clean.

Can the same knowledge base power both a chatbot and a voice agent?

Yes, and it should. Both channels answer from written material about your business. Build the knowledge base first, restrict both channels to it, and keep one list of things the AI must never say. The second channel then takes days rather than months.

How much does an AI voice agent cost per call?

Voice is billed per minute, combining platform, speech services, model and phone line; expect somewhere between a few cents and around fifteen cents a minute all-in, depending on the platform and voice quality, and check the current pricing pages because bundles change. A three-minute call therefore costs well under a dollar, with the knowledge base and transcript review as the larger ongoing cost.

Do customers mind talking to an AI on the phone?

Less than they mind voicemail, in our experience, provided the agent says it is an assistant in the first sentence, handles the simple things well, and hands off to a person quickly when asked. What customers resent is being kept from a person, or being misled about what they are talking to.

Want this done properly for your business?

Tell us what the task is and what it costs you today. You get a reply from an engineer with a couple of questions, an honest view of whether it is worth doing, and a fixed price if it is.

One reply within a business day, from the engineer who would do the work. No newsletter, no sales sequence.
Sent. We read every one of these and will reply within a business day with a couple of questions and, if it makes sense, a time to talk.