How AI Firms Are Destroying Physical Books to Train Their Models, Pg11
AI firms like Amazon and Anthropic are controversially destroying rare physical books to train their models, sparking outrage over cultural heritage loss and copyright issues.
An investigation by 404 Media revealed that AI companies, including Amazon, are acquiring physical books, often rare ones, and destroying them through a process called destructive scanning to train their AI models.
Amazon employees at a Las Vegas facility (VGT3) confirmed their primary task involves cutting book bindings and scanning pages, leading to the destruction of the original books.
AI firm Anthropic initiated a secret initiative named Project Panama in early 2024, aiming to "destructively scan all the books in the world" to develop its Claude family of models.
A U.S. district judge ruled that using purchased print books for destructive scanning to train AI models constitutes fair use under copyright law, as it is "exceedingly transformative."
However, Anthropic was found liable for copyright infringement for acquiring and storing millions of pirated books in a central library, leading to a $1.5 billion settlement.
AI and Books.jpg
Detailed Insights:
AI companies seek high-quality, original datasets from books, especially rare or out-of-print volumes, to prevent AI-generated content from saturating their training data.
Destructive scanning involves removing a book's spine to flatten pages for rapid, high-quality digital conversion, making the process faster and cheaper than non-destructive methods.
Destroying the physical book after scanning can also serve as a legal defense, making it harder for authors to claim piracy compared to downloading pirated e-books.
The legal precedent set by U.S. District Judge William Alsup distinguishes between the transformative use of legally acquired and scanned books for AI training (ruled fair use) and the storage of pirated digital copies (ruled infringement).
The practice has sparked outrage among authors, booksellers, and cultural preservationists, who fear the loss of unique literary works.
Booksellers are increasingly scrutinizing large or unusual book orders, suspecting they are intended for destructive scanning by AI companies.
Elon Musk, founder of SpaceXAI, stated his company would preserve rare books and scan them non-destructively, contrasting with the current industry practice.
Key Concepts Involved:
Destructive Scanning: A method of digitizing physical books by removing their bindings to flatten pages for high-speed scanning, typically resulting in the destruction of the original book.
Fair Use: A legal doctrine in U.S. copyright law that permits limited use of copyrighted material without permission from the rights holders for purposes such as criticism, comment, news reporting, teaching, scholarship, or research.
Copyright Infringement: The unauthorized use of works protected by copyright law, violating the copyright holder's exclusive rights, such as reproduction, distribution, or adaptation.