Linklaters evaluates AI's legal aptitude through exams

In recent months, Linklaters, a notable law firm in the UK, has implemented a groundbreaking initiative by introducing law examinations specifically designed for artificial intelligence. This endeavor stems from the growing interest and concern surrounding the application of AI in the legal domain. Linklaters aims to assess the reliability of AI programs to perform legal tasks effectively, as the use of such technology raises both potential benefits and significant ethical questions within the industry. The LinksAI English law benchmark consists of various legal questions, with each question assigned a maximum score of ten points. The scoring criteria focuses on several important aspects, such as the correctness of the answers provided, the clarity of the language used, and the incorporation of relevant citations. By critiquing AI programs based on these factors, Linklaters hopes to ascertain whether these models can adequately mimic human responses to complex legal inquiries. This initiative also reflects the broader skepticism among traditional legal firms towards AI technology. Recently, Hill Dickinson, one of the UK's major legal practices, restricted its lawyers' access to AI because of concerns regarding the possibility of misuse. Such contrasting approaches among law firms highlight the ongoing debate about the balance between harnessing innovative technology and maintaining the integrity of legal practices. As the landscape of the legal profession evolves with advancements in technology, assessing AI's capability becomes crucial. Linklaters' evaluations represent a significant step towards understanding how such tools can be integrated into legal practices. The outcomes of these examinations may ultimately influence whether legal firms pursue the utilization of AI for various tasks, shaping the future of the industry significantly.