
Jed Crandall
Censors at Sina Weibo, a Chinese website similar to Twitter, work with amazing speed and efficiency. That’s the conclusion of research conducted by UNM Assistant Professor of Computer Science
Jed Crandall and Rice University Professor of Computer Science and Electrical Engineering
Dan Wallach in conjunction with an independent researcher and an undergraduate researcher from Bowdoin College.
The study is titled, “The Velocity of Censorship: High-Fidelity Detection of Microblog Post Deletions,” and is undergoing peer-review.
“The point of our measurement study of Weibo is to take a closer look at global online censorship practices,” Crandall said. “There has been considerable debate in the U.S. recently about extending copyright law enforcement to include various kinds of filtering online. China already has laws in place for companies within China to filter online content.”
Weibo is one of the biggest social network companies in China, and it faces the dual challenge of keeping its users engaged (and thus, watching advertisements and making money for Weibo) while keeping the content it hosts compliant with local laws. If Weibo had insufficient controls, the government may take action against the company. If their controls were too rigid, users might abandon them for one of their competitors. Weibo’s success implies that it has found a happy medium, and the research team says that is what makes Weibo an interesting social media platform to study.
In February 2012 Weibo had more than 300 million users and about 100 million messages that were sent daily. Weibo, like Twitter limits message length to 140 characters. It also allows embedded photos and videos and comment threads to be attached to posts.
In spite of the tremendous volume, the company can detect a censorship event within one minute of posting. In their paper the researchers describe how they were able to track the censors at work and hypothesize several different filtering methods that appear to comprise Weibo’s defense-in-depth system of censorship.
“Weibo gives us a window into the future for what Internet censorship of social media around the world may look like,” Wallach said. “Former Supreme Court Justice Louis Brandeis championed transparency a century ago when he wrote, ‘sunlight is said to be the best disinfectants.’ We hope that our research shines a light on how laws created by governments and implemented by the private sector can affect free speech everywhere, including here in the U.S.”
One of the most interesting elements of the research is the finding about the speed at which the censorship process actually works. According to Crandall, “There have been some studies on Weibo showing that posts are deleted after a day or two, but we see posts being deleted after five or ten minutes. Basically we showed that if you want to have a complete picture of internet censorship you have to have something that can measure very quickly on the order of minutes, and you have to be able to measure a wide variety of things.”
About the Research
The research group first had to determine how to approach the problem, so they looked at the postings of individuals who had previously been censored. Over weeks, they were able to slowly expand their group, adding any user with more than five deleted posts and eventually finding more than 3,500 users to track for their sample.
Once they settled on a group to monitor, they decided to check their posts every minute to determine how long it took censors to remove a post. Their web crawler searched for posts that appear, and then are subsequently deleted. Their data showed that five percent of the deletions happened in the first eight minutes and within 30 minutes nearly 30 percent of the deletions were completed. More than 90 percent of the deletions occurred within one day after a post appeared.
This information lead the team to think about what resources it would take to monitor that river of information. They calculated it would take 4,200 workers reading 50 posts a minute in eight hour shifts to censor using only human review of the posts. That led them to the conclusion that much of the filtering must be automated, through initial flagging and retrospective searches. This conclusion allowed them to set up six hypotheses.
- There is a surveillance keyword list that triggers for posts to be look at by a moderator for possible deletion.
- Weibo targets specific users, such as those who frequently post sensitive comments.
- When a sensitive post is found, a moderator will find all of its related reposts and delete them all at once.
- Weibo removes posts retroactively via keyword search, causing spikes in the deletion rate of a particular keyword within a short amount of time.
- The censors work relatively independently, in a distributed fashion. Some of them may work in their spare time.
- Deletion speed is related to the topic. That is, particular topics are targeted for deletion based on how sensitive they are.
The research team notes there may be many mechanisms beyond those they have hypothesized, which future work may reveal. The team did not consider interactions between social media and traditional media but suggest that would be an interesting topic for future research.
Media contacts: UNM Karen Wentworth (505) 277‑5627; email: kwent2@unm.edu
Rice University, Jade Boyd (713) 348‑6778; email: jadeboyd@rice.edu
David Ruth (713) 348‑6327; email: david@rice.edu
Scott Burchiel Selected as UNM’s 58th Annual Research Lecturer
Scott Burchiel
The lecture, titled “ToxicoGenomic Bases for Human Susceptibility to Environmental Injury and Disease,” will be presented on Tuesday, April 16, at 6:30 p.m., in the Student Union Building (SUB), Ballroom A&B, on the University of New Mexico main campus. A reception will be held prior to the lecture at 5:30 p.m. Faculty, staff, students and the public are invited. There is no admission charge.
“Humans are exposed to chemicals in their environment via the food we eat, the air we breathe, the water we drink, and substances that contact our skin,” Burchiel said. “While human allergies to drugs such as penicillin and foods such as eggs and peanuts are well known, there is less understanding of the differences in susceptibility to environmental pollutants.”
Burchiel, an expert in the interactions between environmental chemicals and the immune system, will discuss the differences in sensitivity of humans to various drugs, chemicals, and environmental agents that produce injury and disease. Based on an understanding of the human genome, the fields of pharmacogenomics and toxicogenomics seek to identify genetic susceptibilities that lead to adverse reactions. Whole genome sequencing of individuals now permits the identification of certain drug and chemical sensitivities that may lead to the safer use of medications as well as identify persons who might be at increased risk for certain environmental diseases.
“It is hoped that a better understanding of multiple gene and environment interactions will lead to new prevention and intervention strategies that will play an important role in the emerging field of personal medicine,” he explained.
Burchiel joined the University of New Mexico in 1977 as a National Cancer Institute NRSA Fellow, and became a faculty member in the College of Pharmacy in 1978. He has a highly distinguished career as a leader in education, research, and administration at UNM.
Burchiel is the Nunzio and Sherolyn DeSantis Endowed Chair of Pharmacogenomics and professor of Pharmacology and Toxicology in the Department of Pharmaceutical Sciences. He serves as the associate dean for Research in the College of Pharmacy and has served as the Director of the UNM HSC Signature Program in Environmental Health Sciences and the director of the New Mexico Center for Environmental Health Studies for the UNM Health Sciences Center. He directs the New Mexico Center for Isotopes in Medicine (NMCIM) and has served as an associate vice president for Advanced Studies (UNM Office of Research and Economic Development). He is a Fellow of the Academy of Toxicological Sciences, an active NIH grant reviewer, and is the Editor-In-Chief of Toxicology and Applied Pharmacology.
Burchiel is an expert in immunotoxicology and environmental carcinogenesis and has been continually funded by the NIH for over 25 yrs. Burchiel’s laboratory is active in the use of toxicogenomics, pharmacogenomics, and the use of genomic and epigenomic tools to analyze mechanisms of action of xenobiotics. These studies seek to identify human susceptibility factors, such as polymorphisms in receptor signaling, metabolism, and DNA repair genes.
Burchiel is an expert in immunotoxicity testing and his laboratory has been involved in the development of numerous new biotechnology products and has conducted numerous preclinical and clinical trials with pharmaceutical and biotechnology companies. He has served on an FDA Expert Working Group in Vasculitis and on numerous National Academy and Institute of Medicine committees. He currently chairs the FDA’s National Center for Toxicologic Research (NCTR) Science Advisory Board.
To view the flyer, visit: 58th Annual Research Lecturer.
The University of New Mexico congratulates Scott Burchiel as UNM’s 58th Annual Research Lecturer.