Preliminary Comparison: ChatGPT Plugin vs. Bing Chat on Context-Aware Text Generation

by Jim Wang , 26 Oct 2023

Incomplete testing to compare ChatGPT Plugin (POWER DYNAMICS 365) and Bing Chat

Last month, I had the privilege of launching the first-ever ChatGPT Plugin: POWER DYNAMICS 365, which was empowered by official documents, learning resources, and blogs.

One of the pertinent inquiries received via LinkedIn was: How does it compare with Bing Chat with restricted search? (insite search to a specific domain)

Awesome question! So in addition to the extension possibilities, I had some incomplete testing with interesting results. 

In my test, Bing Chat works well in general scenrios, and it may struggle with more complex conversations. 

For example, the licensing questions I asked for the ChatGPT Plugin and Bing Chat are:

"I need to build a website using Power Pages, my average monthly visitors are 20,000 users, half of them are auth users, and the other half are anonymous users. During peak months (3 months in a year), my site visit is 2 times than average. How much does it cost annually?"


ChatGPT Plugin





Bing Chat




I must admit: apart from a few calculation errors in Bing Chat, I am particularly impressed with the detailed responses provided by ChatGPT.

You might be curious: Are they all based on the same GPT4 model?