From bard to Gemini: An investigative exploration journey through Google’s evolution in conversational AI and generative AI

  • Zarif Bin Akhtar Department of Engineering, University of Cambridge, Cambridge CB2 1TN, England, United Kingdom
Ariticle ID: 1378
98 Views, 51 PDF Downloads, 2 Supp.file Downloads
Keywords: artificial intelligence (AI); bard; ChatGPT; computer vision; deep learning (DL); Gemini; generative artificial intelligence (GAI); large language models (LLM); machine intelligence; machine learning (ML)

Abstract

The advent of artificial intelligence (AI) has significantly transformed various aspects of human life, particularly in information retrieval and assistance. This research presents a comprehensive evaluation of Gemini, previously known as Google Bard, a state-of-the-art AI chatbot developed by Google. Through a meticulous methodology encompassing both qualitative and quantitative approaches, this research aims to assess Gemini’s performance, usability, integration capabilities, ethical implications. Primary data collection methods, including user surveys and interviews, were utilized to gather towards the qualitative feedback on user experiences with Gemini, supplemented by secondary data analysis using tools such as Google Analytics to capture quantitative metrics. Performance evaluation involved benchmarking against other AI chatbots and technical analysis of Gemini’s architecture and training methods. User experience testing examined usability, engagement, and integration with Google Workspace and third-party services. Ethical considerations regarding data privacy, security, and biases in AI-generated content were also addressed, ensuring compliance with major regulations and promoting ethical AI practices. Acknowledging limitations and challenges inherent in the investigative exploration, data analysis was conducted using thematic and statistical methods to derive insights. The results and findings of this research offer valuable insights into the capabilities and limitations of Gemini, providing implications for future AI development, user interaction design, and ethical AI governance. By contributing to the ongoing discourse on AI advancements and their societal impact, this exploration facilitates informed decision-making and lays the groundwork for future research endeavors in the field of AI-driven conversational agents.

References

[1] Where you can use Bard. Available online: https://support.google.com/gemini/answer/13575153 (accessed on 13 July 2023).

[2] David E. The AI wars might have an armistice deal sooner than expected. Available online: https://www.theverge.com/2023/7/20/23800755/ai-meta-llama-microsoft-chatgpt-interoperability (accessed on 25 July 2023).

[3] Konrad A, Cai K. Inside ChatGPT’s Breakout Moment and the Race to Put AI To Work. Available online: https://www.forbes.com/sites/alexkonrad/2023/02/02/inside-chatggpts-breakout-moment-and-the-race-for-the-future-of-ai/?sh=3f67b566240b (accessed on 6 February 2023).

[4] Vincent J. AI-generated answers temporarily banned on coding Q&A site Stack Overflow. Available online: https://www.theverge.com/2022/12/5/23493932/chatgpt-ai-generated-answers-temporarily-banned-stack-overflow-llms-dangers (accessed on 5 December 2022).

[5] Olson P. Google Faces a Serious Threat from ChatGPT. Available online: https://www.washingtonpost.com/ (accessed on 6 February 2023).

[6] Grant N, Metz C. A New Chat Bot Is a ‘Code Red’ for Google’s Search Business. Available online: https://www.nytimes.com/2022/12/21/technology/ai-chatgpt-google-search.html (accessed on 30 December 2022).

[7] Newton C. How Google is making up for lost time. Available online: https://www.theverge.com/2023/5/12/23721037/google-ai-progress-search-docs-starline-video-calls (accessed on 10 June 2023).

[8] Grant N. Google Calls in Help from Larry Page and Sergey Brin for A.I. Fight. Available online: https://www.nytimes.com/2023/01/20/technology/google-chatgpt-artificial-intelligence.html (accessed on 6 February 2023).

[9] Nieva R, Konrad A. Back at Google Again, Cofounder Sergey Brin Just Filed His First Code Request in Years. Available online: https://www.forbes.com/sites/richardnieva/2023/01/31/sergey-brin-code-request-lamda/?sh=6a71df637ce6 (accessed on 31 December 2023).

[10] Condon S. Google I/O 2021: Google unveils new conversational language model, LaMDA. Available online: https://www.zdnet.com/article/google-io-google-unveils-new-conversational-language-model-lamda/ (accessed on 12 June 2022).

[11] Roth E. Meet the companies trying to keep up with ChatGPT. Available online: https://www.theverge.com/2023/3/5/23599209/companies-keep-up-chatgpt-ai-chatbots (accessed on 9 March 2023).

[12] Kleinman Z. ChatGPT firm trials $20 monthly subscription fee. Available online: https://www.bbc.com/news/technology-64492750 (accessed on 10 April 2023).

[13] Elias J. Google execs warn company’s reputation could suffer if it moves too fast on AI-chat technology. Available online: https://www.cnbc.com/2022/12/13/google-execs-warn-of-reputational-risk-with-chatgbt-like-tool.html (accessed on 6 February 2023).

[14] Vincent J. Google won’t launch ChatGPT rival because of ‘reputational risk’. Available online: https://www.theverge.com/2022/12/14/23508756/google-vs-chatgpt-ai-replace-search-reputational-risk (accessed on 6 February 2023).

[15] Cuthbertson A. DeepMind’s AI chatbot can do things that ChatGPT cannot, CEO claims. Available online: https://www.independent.co.uk/tech/deepmind-ai-chatbot-chatgpt-openai-b2262862.html (accessed on 6 February 2023).

[16] Elias J. Google is asking employees to test potential ChatGPT competitors, including a chatbot called ‘Apprentice Bard’. Available online: https://www.cnbc.com/2023/01/31/google-testing-chatgpt-like-chatbot-apprentice-bard-with-employees.html (accessed on 2 February 2023).

[17] O’Brien M. Google has the next move as Microsoft embraces OpenAI buzz. Available online: https://apnews.com/article/technology-science-software-microsoft-corp-business-a7f6f44fdd53730e45daa611555c8c23 (accessed on 6 February 2023).

[18] Mailk A. Google tries to reassure investors on AI progress as ChatGPT breathes down its neck. Available online: https://techcrunch.com/2023/02/03/google-best-yet-to-come-ai-journey-faces-potential-disruption-openai-chatgpt/ (accessed on 6 February2023).

[19] Alba D, Love J. Google releases ChatGPT rival AI ‘Bard’ to early testers. Available online: https://www.latimes.com/business/story/2023-02-06/google-chatgpt-rival-ai-bard-early-testers (accessed on 6 February 2023).

[20] Schechner S, Kruppa M. Google Opens ChatGPT Rival Bard for Testing, as AI War Heats Up. Available online: https://www.wsj.com/articles/google-opens-testing-of-chatgpt-rival-as-artificial-intelligence-war-heats-up-11675711198 (accessed on 6 February 2023).

[21] Nieva R. Google Debuts A ChatGPT Rival Called Bard In Limited Release. Available online: https://www.forbes.com/sites/richardnieva/2023/02/06/google-bard/?sh=795b687b152d (accessed on 6 February 2023).

[22] Elias J. Google CEO tells employees that 80,000 of them helped test Bard A.I., warns ‘things will go wrong’. Available online: https://www.cnbc.com/2023/03/21/google-ceo-pichai-memo-to-employees-on-bard-ai-things-will-go-wrong.html (accessed on 21 March 2023).

[23] Mollman S. Google’s head of ChatGPT rival Bard reassures employees it’s ‘a collaborative A.I. service’ and ‘not search’. Available online: https://fortune.com/2023/03/03/google-chatgpt-rival-bard-sundar-pichai-eassures-employees-tool-not-search-but-ai-companion/ (accessed on 9 March 2023).

[24] Elias J. Google execs tell employees in testy all-hands meeting that Bard A.I. isn’t just about search. Available online: https://www.cnbc.com/2023/03/03/google-execs-say-in-all-hands-meeting-bard-ai-isnt-all-for-search-.html (accessed on 11 March 2023).

[25] Dastin J, Nellis S. For tech giants, AI like Bing and Bard poses billion-dollar search problem. Available online: https://www.reuters.com/technology/tech-giants-ai-like-bing-bard-poses-billion-dollar-search-problem-2023-02-22/ (accessed on 9 March 2023).

[26] Liedtke M. Google hopes ‘Bard’ will outsmart ChatGPT, Microsoft in AI. Available online: https://apnews.com/article/technology-science-microsoft-corp-sundar-pichai-business-395b0b94410d9fa3ebb13b14af640e06 (accessed on 6 February 2023).

[27] Metz C, Grant N. Racing to Catch Up with ChatGPT, Google Plans Release of Its Own Chatbot. Available online: https://www.nytimes.com/2023/02/06/technology/google-bard-ai-chatbot.html (accessed on 17 February 2023).

[28] Knight W. The Chatbot Search Wars Have Begun. Available online: https://www.wired.com/story/fast-forward-the-chatbot-search-wars-have-begun/ (accessed on 10 February 2023).

[29] Warren T. Microsoft and Google are about to Open an AI battle. Available online: https://www.theverge.com/2023/2/7/23587767/microsoft-google-open-ai-battle-search-bing (accessed on 8 February 2023).

[30] Google Strikes Back in AI Battle with Microsoft. Available online: https://www.barrons.com/news/google-strikes-back-in-ai-battle-with-microsoft-01675871108 (accessed on 8 February 2023).

[31] Morrison S. Google is scrambling to catch up to Bing, of all things. Available online: https://www.vox.com/recode/2023/2/7/23590069/bing-openai-microsoft-google-bard (accessed on 8 February 2023).

[32] Peers Martin. What Google’s AI Catch-Up Reveals. Available online: https://www.theinformation.com/articles/what-google-s-ai-catch-up-reveals (accessed on 8 February 2023).

[33] De Vynck G, Tiku N. Google’s catch-up game on AI continues with Bard launch. Available online: https://www.washingtonpost.com/technology/2023/03/21/bard-google-ai/ (accessed on 16 October 2023).

[34] Patel N. Microsoft thinks AI can beat Google at search—CEO Satya Nadella explains why. Available online: https://www.theverge.com/23589994/microsoft-ceo-satya-nadella-bing-chatgpt-google-search-ai (accessed on 12 September 2023).

[35] Alba D. ChatGPT Reignites the Search Wars Between Google and Microsoft. Available online: https://www.bloomberg.com/news/newsletters/2023-02-08/chatgpt-reignites-search-competition-microsoft-bing-vs-google-bard (accessed on 8 February 2023).

[36] Stokel-Walker Chris. TechScape: Google and Microsoft are in an AI arms race—who wins could change how we use the internet. Available online: https://www.theguardian.com/technology/2023/feb/21/techscape-google-bard-microsoft-big-ai-search (accessed on 9 March 2023).

[37] Morrison S. “The exciting new AI transforming search—and maybe everything—explained. Available online: https://www.vox.com/recode/2023/3/4/23624033/openai-bing-bard-microsoft-generative-ai-explained (accessed on 9 March 2023).

[38] De Vynck G. Investors pummel Google after Microsoft ramps up AI wars. Available online: https://www.washingtonpost.com/technology/2023/02/08/google-bard-chatbot-microsoft/ (accessed on 17 February 2023).

[39] Alba D, Patnaik S. Google suffers $144b wipeout after Bard AI chatbot gives wrong answer. Available online: https://www.smh.com.au/business/companies/google-suffers-140b-wipeout-after-bard-ai-chatbot-gives-wrong-answer-20230209-p5cj3a.html (accessed on 9 February 2023).

[40] Miao H. Alphabet Stock Drops 8% After Google Rollout of AI Search Features. Available online: https://www.wsj.com/livecoverage/stock-market-news-today-02-08-2023/card/alphabet-stock-drops-after-google-parent-introduces-ai-search-features-wgCJG3IDoSbfL3SgyrNI (accessed on 8 February 2023).

[41] Coulter M. Google shares dive 8% after AI chatbot Bard flubs answer in ad. Available online: https://www.reuters.com/technology/google-ai-chatbot-bard-offers-inaccurate-information-company-ad-2023-02-08/ (accessed on 8 February 2023).

[42] Kan M. No, That’s Wrong: Google’s Bard AI Demo Spouts Incorrect Info. Available online: https://www.pcmag.com/news/no-thats-wrong-googles-bard-ai-demo-spouts-incorrect-info (accessed on 8 February 2023).

[43] Elias J. Google employees criticize CEO Sundar Pichai for ‘rushed, botched’ announcement of GPT competitor Bard. Available online: https://www.cnbc.com/2023/02/10/google-employees-slam-ceo-sundar-pichai-for-rushed-bard-announcement.html (accessed on 11 February 2023).

[44] Harrison M. Chaos Inside Google as Execs Try to Figure Out How to Actually Use AI. Available online: https://futurism.com/chaos-google-execs-use-for-ai (accessed on 9 March 2023).

[45] Elias J. Alphabet Chairman John Hennessy explains why Google was hesitant to put out its ChatGPT competitor. Available online: https://www.cnbc.com/2023/02/13/alphabet-chairman-john-hennessy-google-bard-hesitation.html (accessed on 11 March 2023).

[46] Maxwell T, Langley H. Leaked memo shows Google CEO Sundar Pichai is asking staffers for help testing its Bard AI chatbot. Available online: https://www.businessinsider.com/google-bard-chatbot-googlers-sundar-pichai-2023-2 (accessed on 17 February 2023).

[47] Elias J. Google asks employees to rewrite Bard’s bad responses, says the A.I. ‘learns best by example’. Available online: https://www.cnbc.com/2023/02/15/google-asks-employees-to-rewrite-bards-incorrect-responses-to-queries.html (accessed on 17 February 2023).

[48] Alba D, Love J. Google’s Rush to Win in AI Led to Ethical Lapses, Employees Say. Available online: https://www.bloomberg.com/news/features/2023-04-19/google-bard-ai-chatbot-raises-ethical-concerns-from-employees (accessed on 24 April 2023).

[49] Maxwell T, Langley H. Leaked messages show Googlers are taking out their frustrations over layoffs on its new Bard AI chatbot. Available online: https://www.businessinsider.com/google-layoffs-bard-chatbot-ai-2023-2 (accessed on 9 March 2023).

[50] Langley H. “Google employees are already internally testing a smarter version of its chatbot called ‘Big Bard’. Available online: https://www.businessinsider.com/google-employees-test-smarter-chatbot-big-bard-2023-3 (accessed on 10 April 2023).

[51] Grant N. Google Releases Bard, Its Competitor in the Race to Create A.I. Chatbots. Available online: https://www.nytimes.com/2023/03/21/technology/google-bard-chatbot.html (accessed on 21 March 2023).

[52] Liedtke M. Google’s artificially intelligent ‘Bard’ set for next stage. Available online: https://www.washingtonpost.com/ (accessed on 21 March 2023).

[53] Vincent J. Google opens early access to its ChatGPT rival Bard—here are our first impressions. Available online: https://www.theverge.com/2023/3/21/23649794/google-chatgpt-rival-bard-ai-chatbot-access-hands-on (accessed on 21 March 2023).

[54] Schroeder S. Google is giving early access to its AI assistant to Pixel Superfans. Available online: https://mashable.com/article/google-bard-pixel-superfans (accessed on 21 March 2023).

[55] Li A. Google tapping the Pixel and Nest brands to invite people to Bard. Available online: https://9to5google.com/2023/03/21/google-bard-pixel-nest-one/ (accessed on 10 June 2023).

[56] Fu YC, Marques M, Tseng YH, et al. An evolving international research collaboration network: spatial and thematic developments in co-authored higher education research, 1998–2018. Scientometrics. 2022; 127(3): 1403-1429. doi: 10.1007/s11192-021-04200-w

[57] Kwiek M. The prestige economy of higher education journals: a quantitative approach. Higher Education. 2020; 81(3): 493-519. doi: 10.1007/s10734-020-00553-y

[58] Turing AM. Computing machinery and intelligence. Mind. 1950; LIX(236): 433-460. doi: 10.1093/mind/lix.236.433

[59] McDermott D. Artificial intelligence meets natural stupidity. ACM SIGART Bulletin. 1976; (57): 4-9. doi: 10.1145/1045339.1045340

[60] Minsky M. Steps toward Artificial Intelligence. Proceedings of the IRE. 1961; 49(1): 8-30. doi: 10.1109/jrproc.1961.287775

[61] Akhtar ZB. The design approach of an artificial intelligent (AI) medical system based on electronical health records (EHR) and priority segmentations. The Journal of Engineering. 2024; 2024(4). doi: 10.1049/tje2.12381

[62] Akhtar ZB. Securing Operating Systems (OS): A Comprehensive Approach to Security with Best Practices and Techniques. International Journal of Advanced Network, Monitoring and Controls. 2024; 9(1): 100-111. doi: 10.2478/ijanmc-2024-0010

[63] Akhtar ZB, Gupta AD. Integrative Approaches for Advancing Organoid Engineering: From Mechanobiology to Personalized Therapeutics. Journal of Applied Artificial Intelligence. 2024; 5(1): 1-27. doi: 10.48185/jaai.v5i1.974

[64] Akhtar ZB. Advancements within Molecular Engineering for Regenerative Medicine and Biomedical Applications an Investigation Analysis towards A Computing Retrospective. Journal of Electronics, Electromedical Engineering, and Medical Informatics. 2024; 6(1). doi: 10.35882/jeeemi.v6i1.351

[65] Bin Akhtar Z. A Revolutionary Gaming Style in Motion. IntechOpen; 2022. doi: 10.5772/intechopen.100551

[66] Akhtar ZB, Stany Rozario V. The Design Approach of an Artificial Human Brain in Digitized Formulation based on Machine Learning and Neural Mapping. In: Proceedings of the 2020 International Conference for Emerging Technology (INCET); 2020; Belgaum, India. pp. 1-7. doi: 10.1109/INCET49848.2020.9154000

Published
2024-06-27
How to Cite
Bin Akhtar, Z. (2024). From bard to Gemini: An investigative exploration journey through Google’s evolution in conversational AI and generative AI. Computing and Artificial Intelligence, 2(1), 1378. https://doi.org/10.59400/cai.v2i1.1378
Section
Article