SUBSCRIBE
SUBSCRIBE
EXPLORE +
  • About infoDOCKET
  • Academic Libraries on LJ
  • Research on LJ
  • News on LJ
  • Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Libraries
    • Academic Libraries
    • Government Libraries
    • National Libraries
    • Public Libraries
  • Companies (Publishers/Vendors)
    • EBSCO
    • Elsevier
    • Ex Libris
    • Frontiers
    • Gale
    • PLOS
    • Scholastic
  • New Resources
    • Dashboards
    • Data Files
    • Digital Collections
    • Digital Preservation
    • Interactive Tools
    • Maps
    • Other
    • Podcasts
    • Productivity
  • New Research
    • Conference Presentations
    • Journal Articles
    • Lecture
    • New Issue
    • Reports
  • Topics
    • Archives & Special Collections
    • Associations & Organizations
    • Awards
    • Funding
    • Interviews
    • Jobs
    • Management & Leadership
    • News
    • Patrons & Users
    • Preservation
    • Profiles
    • Publishing
    • Roundup
    • Scholarly Communications
      • Open Access

December 29, 2014 by Gary Price

Research Article: “‘Text Overlap’ Clutters Scientific Papers, arXiv Analysis Finds”

December 29, 2014 by Gary Price

Recently published research out of Cornell University.
From Cornell University:

Computer text analysis of a huge database of scientific papers shows a large amount of “text overlap,” where authors use text from previous papers of their own and others, not always with attribution. This is not necessarily good or bad, Cornell researchers say.
“Our first goal was to characterize the accepted practice, not to be judgmental,” said Paul Ginsparg, professor of physics and information science and founder of the online arXiv collection of scientific papers, now maintained by Cornell University Library. The analysis was conducted on thousands of papers in the arXiv. Ginsparg and Cornell graduate student Daniel Citron reported their study in the Dec. 8 online edition of the Proceedings of National Academy of Sciences. (abstract only, full text preprint linked below).
“While it is technically plagiarism, which more generally is stealing of ideas,” Ginsparg said, “it’s a benign form in the sense that most of it cites the source (at least somewhere in the article), and many authors have rationales for the practice.” Many readers find the reuse of text “an annoyance and a distraction,” he added, and some worry that it wastes space online and in print journals.
[Clip]
The study compared text in 757,000 articles deposited from 1991 to 2012. Each text was broken into overlapping phrases seven words long, and other texts were then scanned to see how many matching phrases they had in common. The system skips common usages like “The remainder of this article is organized as follows,” as well as direct quotations with proper attribution.
The entire database was preprocessed to create an index of all the seven-word patterns in the arXiv. The analysis only became possible, Ginsparg said, with the low-cost availability of computers with enough random-access memory (RAM) to hold the entire 12.5 GB index. Given that, a single paper can be checked in less than a second, he said.
Since June 2011, every new article submitted to the arXiv has been scanned against the entire database, and papers with significant text overlap have been flagged with a notice to that effect. The current study grew partly from the need to establish a threshold for aberrant practice, permitting a response to indignant authors saying in effect, “Everybody does it.”

Read the Complete Summary (via Cornell U.)
*** Read the Complete Article: “Patterns of Text Reuse in a Scientific Corpus” (Preprint Version, via arXiv)
See Also: Paul Ginsparg’s Homepage

Filed under: Academic Libraries, Conference Presentations, Journal Articles, Libraries, News

SHARE:

About Gary Price

Gary Price (gprice@gmail.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. He earned his MLIS degree from Wayne State University in Detroit. Price has won several awards including the SLA Innovations in Technology Award and Alumnus of the Year from the Wayne St. University Library and Information Science Program. From 2006-2009 he was Director of Online Information Services at Ask.com.

ADVERTISEMENT

Archives

Job Zone

ADVERTISEMENT

Related Infodocket Posts

AI/GPT News Roundup: Items From ACM, JISC, OpenAI, Meta, and Others

ACM Tech Brief: Generative Artificial Intelligence AI Now Computational Power and AI (Report) Anthropic Amazon is Investing Up to $4 Billion in AI Startup Anthropic in Growing Tech Battle (via ...

EveryLibrary Institute and BookRiot Releases Findings From "Public Libraries and Book Bans - Parent Perception Survey"

From an EveryLibrary Release: The “Public Libraries and Book Bans – Parent Perception Survey” gathered insights from 853 parents and guardians with children under 18 during September 2023. The survey ...

Idaho: "Sheriff Scopes Out Explicit Library Books"

From The Coeur d’Alene Press: “Kootenai County Sheriff Bob Norris said he has heard from both sides about reportedly inappropriate materials available to youth at local libraries. One side argued ...

MIT Libraries Receives Grant From National Science Foundation to Explore Open Science Evaluations with ICOR; Clarivate Establishes Academia...

AI Generative AI Has Disrupted Education. Here’s How It Can Be Used For Good – UNESCO (via WEF) University of Leeds Research Report on Potentials for AI in Libraries (via ...

Resources: FCC Chairwoman Rosenworcel Proposes to Restore Net Neutrality Rules

UPDATED POST (Sep. 27, 2023): ALA Welcomes FCC Chair Rosenworcel’s Proposal to Reinstate Network Neutrality Rules —End Update— From a FCC Fact Sheet: The internet is too important to our ...

Brown University Digital Publications Joins the Association of University Presses; Report on Open Book Collective's (OBC) First Annual...

Advocacy ‘A Toolkit for Knowledge Rights Advocacy’ – KR21 Workshop Report (via LIBER) Legal Appeals Court Temporarily Stays Injunction Blocking Texas Book Rating Law (via PW) Open Book Collective Report ...

Governor Gavin Newsom Signs Bill Blocking California School Boards From Banning Inclusive Books

From The Sacramento Bee: California Gov. Gavin Newsom on Monday evening signed a bill into law barring school boards from banning books, instructional materials or curricula labeled as inclusive or ...

Article: "Journal Production Guidance for Software and Data Citations"

The full text article linked below was published today by Scientific Data. Title Journal Production Guidance for Software and Data Citations Authors Shelley Stall, Geoffrey Bilder, Matthew Cannon, Neil Chue ...

AI Book Bans: Testing LLMs Against the Freedom to Read; ChatGPT Can Now See, Hear, and Speak; &...

AI What I Found in a Database Meta Uses to Train Generative AI (via The Atlantic) Book Bans A Ban on Book Bans? Teachers, Students Call on Pennsylvania Lawmakers to ...

Journal Article: "Librarians’ Attitudes, Needs, and Barriers to Participating in International Conferences: A Survey of ALA Members"

The article linked below was recently published by the International Journal of Librarianship. Title Librarians’ Attitudes, Needs, and Barriers to Participating in International Conferences: A Survey of ALA Members Authors ...

Just Released: 2023 EDUCAUSE Horizon Action Plan: Generative AI

From EDUCAUSE: In 2023, generative AI emerged as the most rapidly adopted technology in history. All members of the higher education community, from students to administrators, are trying to determine ...

Colorado: "Former Weld County Librarian Wins Settlement After District Fired Her For Promoting LGBTQ, Anti-Racism Programs"

From Colorado Public Radio: A former librarian will receive $250,000 from the High Plains Library District as part of a settlement in a lengthy civil rights dispute over her firing. ...

ADVERTISEMENT

FOLLOW US ON TWITTER

Tweets by infoDOCKET

ADVERTISEMENT

This coverage is free for all visitors. Your support makes this possible.

This coverage is free for all visitors. Your support makes this possible.

Primary Sidebar

  • News
  • Reviews+
  • Technology
  • Programs+
  • Design
  • Leadership
  • People
  • COVID-19
  • Advocacy
  • Opinion
  • INFOdocket
  • Job Zone

Reviews+

  • Booklists
  • Prepub Alert
  • Book Pulse
  • Media
  • Readers' Advisory
  • Self-Published Books
  • Review Submissions
  • Review for LJ

Awards

  • Library of the Year
  • Librarian of the Year
  • Movers & Shakers 2022
  • Paralibrarian of the Year
  • Best Small Library
  • Marketer of the Year
  • All Awards Guidelines
  • Community Impact Prize

Resources

  • LJ Index/Star Libraries
  • Research
  • White Papers / Case Studies

Events & PD

  • Online Courses
  • In-Person Events
  • Virtual Events
  • Webcasts
  • About Us
  • Contact Us
  • Advertise
  • Subscribe
  • Media Inquiries
  • Newsletter Sign Up
  • Submit Features/News
  • Data Privacy
  • Terms of Use
  • Terms of Sale
  • FAQs
  • Careers at MSI


© 2023 Library Journal. All rights reserved.


© 2022 Library Journal. All rights reserved.