ChatGPT can pass the United States Medical Licensing Exam and the Bar Exam


ChatGPT – a recently released AI with the uncanny ability to mimic human writing – has passed some of America’s most challenging professional exams, studies have shown, raising concerns it could soon put many white collar workers out of a job.

The artificially intelligent content creator, whose name is short for ‘Chat Generative Pre-trained Transformer,’ was released two months ago by OpenAI, and has since taken the world by storm.

Praised by figures such as Elon Musk – one of OpenAI’s founders – the AI-powered also raised alarms in regards to ethics as students use it to cheat on writing assignments and experts warn it could have lasting effects on the US economy.

Its results, however, are inarguable – with recent research showing it the chatbot could successfully achieve an MBA, and soon pass notoriously difficult tests like the United States Medical Licensing Exam and the Bar.

Ethan Mollick, associate professor at Wharton School of the University of Pennsylvania, touted ChatGPT’s increasingly impressive capabilities in a recent post to Twitter 

Recent research shared by the professor showed that the AI-powered chatbot, release two months ago, can already  successfully achieve an MBA, and may soon be able to pass notoriously difficult tests like the United States Medical Licensing Exam and the Bar Exam

Recent research shared by the professor showed that the AI-powered chatbot, release two months ago, can already  successfully achieve an MBA, and may soon be able to pass notoriously difficult tests like the United States Medical Licensing Exam and the Bar Exam

Ethan Mollick, associate professor at Wharton School of the University of Pennsylvania, highlighted these reports in a recent post on social media, one of which was carried out by one of his colleagues at the prestigious school.

The report, carried out by Christian Terwiesch, found that ChatGPT, while still in its infancy, received a grade varying from a B to B- on the final exam of a typical MBA core course.

The research, carried out to see what the release of the AI tool could mean for MBA programs, further found that ChatGPT also ‘performed well in the preparation of legal documents.’

‘The next generation of this technology might even be able to pass the bar exam,’ the report notes.

Mollick, who requires students to use the AI during his courses covering innovation and entrepreneurship, touted the findings Sunday in a post to social media, in which he remarked on their potential implications. 

Mollick, who allows students in his class to use the technology highlighted these reports in a recent post on social media, one of which was carried out by one of his colleagues

Mollick, who allows students in his class to use the technology highlighted these reports in a recent post on social media, one of which was carried out by one of his colleagues

‘I think we haven’t fully absorbed the fact that careful academic papers have found ChatGPT clearly passes some of the most challenging American professional exams,’ Mollick wrote.

The post saw the professor share another study carried out by researchers ay Yale that saw the chatbot earn a passing grade United States Medical Licensing Exam.

Another praised the AI bot’s performances on the professional license exam, commonly referred to as ‘the Bar Exam’, which professors at the Michigan State and Chicago Kent colleges of law found could also be conquered by ChatGPT.

Other posts from the professor similarly tout the progress recently seen from the still young AI, which early adopters have already begun using to draft assignments and write work emails, all in specific tones and styles.

While ‘still in its infancy,’ as billionaire crypto enthusiast Mark Cuban said in an interview touting the technology this week, the accomplishments of ChatGPT in the few months since its release cannot be ignored.

The post saw the professor share another study carried out by researchers ay Yale that saw the chatbot earn a passing grade United States Medical Licensing Exam

The post saw the professor share another study carried out by researchers ay Yale that saw the chatbot earn a passing grade United States Medical Licensing Exam

Andrew Karolyi, dean of Cornell University’s SC Johnson College of Business, told the Financial Times this week that while many may have their reservations over the technology –  which has become a burgeoning internet fad in recent weeks – he believes ChatGPT is here to stay. 

‘One thing we all know for sure is that ChatGPT is not going away. If anything, these AI techniques will continue to get better and better. Faculty and university administrators need to invest to educate themselves.’

As the technology gains popularity, it has reportedly raised alarms within companies like Google, which has sought to adopt the AI to enhance the capabilities of its popular search engine.

Late last week,  The New York Times reported that Google execs are engaged in plans to ‘demonstrate a version of its search engine with chatbot features this year’ and unveil more than 20 projects powered by artificial intelligence.

However, sources have since alleged that brass at the company have embraced the AI technology too fast for its own good, with the search giant on Friday announcing layoffs of more than 12,000 employees amid plans to shift to AI as a domain of primary importance.

The nixing, the largest in the company’s 25-year history, stoked fears that services like ChatGPT could copywriters, journalists, customer-service agents, and now even lawyers and doctors, out of a job.

Another praised the AI bot's performances on the professional license exam, commonly referred to as 'the Bar Exam', which professors at the Michigan State and Chicago Kent colleges of law found could also be conquered by the now viral AI bot

Another praised the AI bot’s performances on the professional license exam, commonly referred to as ‘the Bar Exam’, which professors at the Michigan State and Chicago Kent colleges of law found could also be conquered by the now viral AI bot

As students and others on social media become the first to embrace the technology, Kara McWilliams, who heads a nonprofit which that offers a tool that can identify AI-generated answers, warns that others will soon need to follow suit or risk being left in the dust by those who embrace such tools, which likely will become more commonplace in the coming years.

ETS Product Innovation Labs’ Williams told the Times last week: ‘I’m of the mind that AI isn’t going to replace people, but people who use AI are going to replace people.’ 

While introducing his paper, Terwiesch, noted liken affect ChapGPT will have on the world to that of electronic calculators on the corporate world in the late 60s and 70s.

‘Prior to the introduction of calculators and other computing devices, many firms employed hundreds of employees whose task it was to manually perform mathematical operations such as multiplications or matrix inversions,’ he wrote. 

‘Obviously, such tasks are now automated, and the value of the associated skills has dramatically decreased. In the same way any automation of the skills taught in our MBA programs could potentially reduce the value of an MBA education.’ 

What is OpenAI’s chatbot ChatGPT and what is it used for?

OpenAI states that their ChatGPT model, trained using a machine learning technique called Reinforcement Learning from Human Feedback (RLHF), can simulate dialogue, answer follow-up questions, admit mistakes, challenge incorrect premises and reject inappropriate requests.

Initial development involved human AI trainers providing the model with conversations in which they played both sides – the user and an AI assistant. The version of the bot available for public testing attempts to understand questions posed by users and responds with in-depth answers resembling human-written text in a conversational format.

A tool like ChatGPT could be used in real-world applications such as digital marketing, online content creation, answering customer service queries or as some users have found, even to help debug code.

The bot can respond to a large range of questions while imitating human speaking styles.

A tool like ChatGPT could be used in real-world applications such as digital marketing, online content creation, answering customer service queries or as some users have found, even to help debug code

A tool like ChatGPT could be used in real-world applications such as digital marketing, online content creation, answering customer service queries or as some users have found, even to help debug code

As with many AI-driven innovations, ChatGPT does not come without misgivings. OpenAI has acknowledged the tool´s tendency to respond with “plausible-sounding but incorrect or nonsensical answers”, an issue it considers challenging to fix.

AI technology can also perpetuate societal biases like those around race, gender and culture. Tech giants including Alphabet Inc’s Google and Amazon.com have previously acknowledged that some of their projects that experimented with AI were “ethically dicey” and had limitations. At several companies, humans had to step in and fix AI havoc.

Despite these concerns, AI research remains attractive. Venture capital investment in AI development and operations companies rose last year to nearly $13 billion, and $6 billion had poured in through October this year, according to data from PitchBook, a Seattle company tracking financings.

Read more at DailyMail.co.uk