# How can we implement AI in our IVR system using Asterisk?

**URL:** <https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740>\
**Category:** Asterisk Integration\
**Created:** [March 25, 2024, 4:48am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740 "2024-03-25T04:48:30Z")\
**Posts on this page:** 16\
**Page:** 1

<div class="post-metadata">

**Author:** ![zaryabgithub](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/zaryabgithub/32/7399_2.png) [@zaryabgithub](https://community.asterisk.org/u/zaryabgithub)\
**Post date:** [March 25, 2024, 4:48am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/1 "2024-03-25T04:48:31Z")

</div>

I want to implement AI in my IVR system to enable live voice conversations between the bot and callers, without using recorded messages.

---

<div class="post-metadata">

**Author:** ![david551](https://avatars.discourse-cdn.com/v4/letter/d/3bc359/32.png) [@david551](https://community.asterisk.org/u/david551)\
**Post date:** [March 25, 2024, 1:34pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/2 "2024-03-25T13:34:01Z")

</div>

This has been multiposted at [How can we implement AI in our IVR system using Asterisk? - Development - FreePBX Community Forums](https://community.freepbx.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/95435) although, I think you are confusing AI with the speech recognition application of it. For more general AI, there is far too little information to work on, unless all you want is to be able to include “AI” in your marketing brochures.

---

<div class="post-metadata">

**Author:** ![dewdude](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/dewdude/32/5980_2.png) [@dewdude](https://community.asterisk.org/u/dewdude)\
**Post date:** [March 25, 2024, 2:57pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/3 "2024-03-25T14:57:00Z")

</div>

I think what they want is speech recgonition that’s fed in to an LLM that can then output to text to speech.

The LLM is the issue. They’re huge and system intensive. You won’t run this in your datacenter unless your datacenter is setup for crypto mining.

The technology is not there yet.

---

<div class="post-metadata">

**Author:** ![david551](https://avatars.discourse-cdn.com/v4/letter/d/3bc359/32.png) [@david551](https://community.asterisk.org/u/david551)\
**Post date:** [March 25, 2024, 3:45pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/4 "2024-03-25T15:45:46Z")

</div>

> [@dewdude](#):
>
> an LLM that can then output to text to speech

I assume they will need good quality training data for that, as well.

---

<div class="post-metadata">

**Author:** ![Pooh](https://avatars.discourse-cdn.com/v4/letter/p/f05b48/32.png) [@Pooh](https://community.asterisk.org/u/Pooh)\
**Post date:** [March 25, 2024, 4:05pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/5 "2024-03-25T16:05:32Z")

</div>

On Monday 25 March 2024 at 16:56:47, david551 via Asterisk Community wrote:

> > [@dewdude](#):
> >
> > an LLM that can then output to text to speech
> 
> I assume they will need good quality training data for that, as well.

Depends on what sort of service they want to provide to their callers 🙂

Also, what sort of service this system is intended to replace…

Antony.

–  
Was ist braun, liegt ins Gras, und raucht?  
Ein Kaminchen…

```
                                               Please reply to the list;
                                                     please *don't* CC me.

```

---

<div class="post-metadata">

**Author:** ![nshmyrev](https://avatars.discourse-cdn.com/v4/letter/n/858c86/32.png) [@nshmyrev](https://community.asterisk.org/u/nshmyrev)\
**Post date:** [March 25, 2024, 4:14pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/6 "2024-03-25T16:14:31Z")

</div>

For many cases you don’t need heavy LLM. Lightweight ASR + Lightweight TTS + small network for NLU is enough. Response time is within 0.5 second.

---

<div class="post-metadata">

**Author:** ![Pooh](https://avatars.discourse-cdn.com/v4/letter/p/f05b48/32.png) [@Pooh](https://community.asterisk.org/u/Pooh)\
**Post date:** [March 25, 2024, 4:28pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/7 "2024-03-25T16:28:03Z")

</div>

On Monday 25 March 2024 at 17:25:34, nshmyrev via Asterisk Community wrote:

> For many cases you don’t need heavy LLM. Lightweight ASR + Lightweight TTS
> 
> - small network for NLU is enough. Response time is within 0.5 second.

Do you have an example? Sounds interesting.

Antony.

–  
Most people have more than the average number of legs.

```
                                               Please reply to the list;
                                                     please *don't* CC me.

```

---

<div class="post-metadata">

**Author:** ![bill1](https://avatars.discourse-cdn.com/v4/letter/b/a8b319/32.png) [@bill1](https://community.asterisk.org/u/bill1)\
**Post date:** [March 26, 2024, 6:40pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/8 "2024-03-26T18:40:12Z")

</div>

Hi David:

I have been doing some development of natural language processing for Asterisk. Would be happy to share some of my insights with you.

Bill

---

<div class="post-metadata">

**Author:** ![zaryabgithub](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/zaryabgithub/32/7399_2.png) [@zaryabgithub](https://community.asterisk.org/u/zaryabgithub)\
**Post date:** [March 27, 2024, 2:40am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/9 "2024-03-27T02:40:19Z")

</div>

Can we take the output of a call from our Asterisk system, convert it into text, and then pass it to an AI for processing? After the AI processes the text and generates an answer, can we convert that answer back into a voice format and pass it to the IVR in Asterisk to provide the response to the caller?It is possible?

---

<div class="post-metadata">

**Author:** ![jcolp](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/jcolp/32/8848_2.png) [@jcolp](https://community.asterisk.org/u/jcolp)\
**Post date:** [March 27, 2024, 8:52am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/10 "2024-03-27T08:52:20Z")

</div>

The building blocks are in Asterisk to do so, yes. If what you actually want is an out of the box experience that requires no effort or development on your part, that is not in Asterisk.

---

<div class="post-metadata">

**Author:** ![DavidGOrtega](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/davidgortega/32/7099_2.png) [@DavidGOrtega](https://community.asterisk.org/u/DavidGOrtega)\
**Post date:** [March 27, 2024, 11:13am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/11 "2024-03-27T11:13:16Z")

</div>

We are currently working on this kind of technology. A pure agent.  
As @dewdude has said LLMs can consume lots of resources, unaffordable for almost every single small/medium company even big companies. Thats why our approach is to make the technology small and distributed. As much it could be.

Our first release all the AI comes within our softphone. The transcription and summarisation (using a Phi-2 3B llm) happen in the phone itself and it’s delivered to your preferred backend via webhooks.

> **[Open Source Softphone | AI Powered | Event-driven | 008 Agent](https://008agent.ai/)**
>
> Experience the future of communication with 008 Agent – the most powerful open-source, event-driven, and AI-powered solution in the market.

> **[GitHub - kunzite-app/008: Open-source event-driven AI powered Softphone](https://github.com/kunzite-app/008)**
>
> Open-source event-driven AI powered Softphone. Contribute to kunzite-app/008 development by creating an account on GitHub.

---

<div class="post-metadata">

**Author:** ![zaryabgithub](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/zaryabgithub/32/7399_2.png) [@zaryabgithub](https://community.asterisk.org/u/zaryabgithub)\
**Post date:** [March 28, 2024, 3:45am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/12 "2024-03-28T03:45:47Z")

</div>

> [@jcolp](#):
>
> The building blocks are in Asterisk to do so, yes. If what you actually want is an out of the box experience that requires no effort or development on your part, that is not in Asterisk.

Yes, you’re right. I’m a PHP and Laravel developer, and I don’t have much knowledge or experience with Asterisk. My company wants me to work on it and create a system that can talk to humans automatically during calls. I’m learning the basics of Asterisk, but they want this feature, and I’ve already informed them that I don’t have experience in it, which is making it difficult for me. That’s why I keep posting in the community for things I can’t find on Google and youtube.

---

<div class="post-metadata">

**Author:** ![bill1](https://avatars.discourse-cdn.com/v4/letter/b/a8b319/32.png) [@bill1](https://community.asterisk.org/u/bill1)\
**Post date:** [March 28, 2024, 2:46pm UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/13 "2024-03-28T14:46:49Z")

</div>

I have been working on a similar system (natural language processing). Happy to share what knowledge I have. Email me direct.

---

<div class="post-metadata">

**Author:** ![manju](https://avatars.discourse-cdn.com/v4/letter/m/ecd19e/32.png) [@manju](https://community.asterisk.org/u/manju)\
**Post date:** [April 4, 2024, 5:15am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/14 "2024-04-04T05:15:00Z")

</div>

hi , we built voice bot using Rasa framework and we need to integrate with Asterisk. i am not finding any documents or video on this topic in google. so please help or guide me in integrating voice bot with asterisk

---

<div class="post-metadata">

**Author:** ![simone686](https://sea1.discourse-cdn.com/asterisk/user_avatar/community.asterisk.org/simone686/32/1795_2.png) [@simone686](https://community.asterisk.org/u/simone686)\
**Post date:** [April 6, 2024, 9:29am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/15 "2024-04-06T09:29:40Z")

</div>

I usually integrate Asterisk with tiny bash o php script  
Personally i use google-cli to convert wav to text, via recording caller speaking.(via bash script)  
Not perfect but i advice to use unimrcp google dialogflow plugin fo AI integration. Dialogflow ES is a cheaper product than CX and for small purpouse is adequate.  
For TTS instead i’m using amazon polly via php script

---

<div class="post-metadata">

**Author:** ![system](https://global.discourse-cdn.com/asterisk/original/2X/4/475d0c889911cfb84ac4881ad6df8b523e3f9105.png) [@system](https://community.asterisk.org/u/system)\
**Post date:** [May 6, 2024, 9:30am UTC](https://community.asterisk.org/t/how-can-we-implement-ai-in-our-ivr-system-using-asterisk/101740/16 "2024-05-06T09:30:13Z")

</div>

Closed on May 6, 2024, 9:30am UTC

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
