CityReads | On the Ubiquity of Statistics

楼市 2024-09-27 21:43 上海

517

On the Ubiquity of Statistics

The enduring wisdom encapsulated within statistical principles

Rao, C. R. (1997). Statistics and truth: Putting chance to work (2nd ed). Singapore: World Scientific.

Sources:https://www.worldscientific.com/worldscibooks/10.1142/3454#t=aboutBook

https://www.nature.com/articles/d41586-023-03200-5

https://www.deccanchronicle.com/lifestyle/a-comprehensive-exploration-of-statistical-wisdom-unraveling-statistics-and-truth-putting-chance-to-work-by-cr-rao-882770?infinitescroll=1

I encountered a quote by C. R. Rao the other day:

“All knowledge is, in final analysis, history.

All sciences are, in the abstract, mathematics.

All judgements are, in their rationale, statistics.”

This passage is from the 1997 book Statistics and Truth: Putting Chance to Work by C. R. Rao, which I recently picked up to read. I discovered that many examples I’ve encountered in other statistics-related books were already covered in C. R. Rao’s work. For instance, one longstanding mystery in American history—who authored the 12 disputed essays in The Federalist Papers? This question was finally resolved in 1963 by two statisticians, Frederick Mosteller and David Wallace, through a comparative analysis of word frequency (for more details, refer to "City Reads | When Words Meet Numbers: What It Reveals about Writing"). Only now do I realize my limited knowledge and the importance of this classic work in statistics.

C. R. Rao’s full name is Calyampudi Radhakrishna Rao. In Indian names, "Rao" is a suffix that indicates social status and lineage, much like the prefix "Sir" in British names, signifying that he was born into a noble family. Despite having no material concerns, he didn’t rely on his family’s wealth but worked hard. As a child, his mother would wake him at 4 a.m. to study by the light of an oil lamp in the quiet early hours of the morning. After earning his master’s degrees in mathematics and statistics in India, C. R. Rao worked at the Indian Statistical Institute. He was later sent to Cambridge University’s Museum of Archaeology and Anthropology in the UK, where he analyzed measurements of ancient skulls unearthed from burial sites in Sudan, classifying them by tribe and age. During this time, he studied under Ronald Fisher, the father of modern statistics, conducting research on the relationship between chromosomes and genes by breeding and dissecting mice. In 1948, he received his Ph.D. in statistics. After graduation, C. R. Rao returned to the Indian Statistical Institute, eventually becoming its director. Following his retirement, he moved to the U.S., teaching at Pennsylvania State University and the University at Buffalo. C. R. Rao’s work has had a profound impact not only on statistics but also on economics, genetics, anthropology, geology, national planning, demography, biostatistics, and medicine.

In 1987, C. R. Rao was invited to deliver three lectures at the inaugural Ramanujan Centenary Lecture in Delhi, organized by India’s Council of Scientific & Industrial Research in honor of Ramanujan, the brilliant mathematician who "appeared like a meteor in the mathematical firmament." In 1989, based on these three lectures on the history and development of statistics, C. R. Rao wrote and published Statistics and Truth: Putting Chance to Work. The second edition was released in 1997, with the lecture material reorganized and expanded into five chapters, and a newly added sixth chapter discussing the public’s understanding of statistics. Rao also wrote a biography of Ramanujan, which is included in the appendix.

This book serves as both a popular science introduction to statistical principles and a philosophical exploration of the field. It also functions as a practical guide, offering insights for both laypeople and seasoned statisticians alike.

Chapter 1 discusses the concepts of uncertainty, randomness, chaos, and chance, emphasizing their importance in investigating and explaining natural phenomena. Chapter 2 introduces common methods for generating new knowledge—induction, deduction, and abduction—and explains how to measure uncertainty to make optimal decisions. Chapters 3 and 4 cover the historical development of statistics. Chapters 5 and 6 present numerous examples illustrating the widespread applications of statistics in scientific research, government policymaking, and everyday life. These examples show how statistical thinking and methods uncover truths across various fields and convincingly argue why statistical reasoning should be considered the fourth fundamental skill everyone must develop, in addition to reading, writing, and arithmetic.

The book also discusses the ubiquity of uncertainty in both nature and human society, as well as the difficulties it creates. It explains how the role of statistics in addressing uncertainty gradually emerged. In the past, societies relied on magic and astrology to cope with uncertainty, but it wasn’t until the 20th century that we discovered statistics as a better tool, though it hasn’t completely replaced the former two. Statistics is a method for extracting useful information from observed data, as well as the logic behind decision-making under uncertainty. It is the science of quantifying uncertainty and a tool that helps us in our pursuit of knowledge that approaches truth.

C. R. Rao pointed out that the uniqueness of statistics lies in the fact that it has no inherent subject matter of its own; it exists and thrives by solving problems in other fields. He quoted L. J. Savage, who said:“Statistics is basically parasitic: it lives on the work of others. This is not a slight on the subject for it is now recognized that many hosts die but for the parasites they entertain. Some animals could not digest their food. So it is with many fields of human endeavors, they may not die but they would certainly be a lot weaker without statistics.

Rao elaborated on the ubiquity of statistics, showcasing numerous examples from ancient and modern times and across different cultures, to illustrate how statistical tools have been widely applied in fields as diverse as industrial production, public policy, scientific research, business, medicine, literature, archaeology, and the courtroom. Rao said: “there has rarely been a technological invention like statistical quality control, which is so wide in its application yet so simple in theory, which is so effective in its results yet so easy to adopt, and which yields so high a return yet needs so small an investment."

Rao shared a statistical story about salt from India. In 1947, shortly after India gained independence, riots erupted in Delhi, and some refugees took shelter in a place called the Red Fort, where the government provided them with food. The government didn’t know the exact number of refugees but was faced with hefty bills. Suspecting that contractors were inflating the costs, they asked a statistician to estimate the number of refugees inside the Red Fort. The challenge was that the statistician had no prior information and couldn’t safely enter the fort to conduct a survey. The only available data was the contractor’s records, which listed the quantities of food supplies provided to the refugees, including rice, beans, and salt. The statistician calculated the quantities of these supplies and found that rice, being the most expensive, had likely been overestimated, while salt, which was very inexpensive, was unlikely to have been exaggerated. Using the quantity of salt as the most reliable figure, the statistician estimated the number of refugees in the fort and then calculated how much rice should have been provided.

The understanding, study, and practical application of statistics have now expanded across natural sciences, social sciences, engineering, management, economics, the arts, and literature. Even ordinary people use statistical knowledge (gleaned from media and other sources) to make various decisions in their daily lives based on the data and analysis available to them.

Rao argued that, in addition to the three basic skills of reading, writing, and arithmetic (3R), everyone should develop a fourth fundamental skill: statistical reasoning (4R). Only by doing so can we understand the uncertainties present in nature and human behavior, and minimize risk when making decisions based on our own or others' experiences. He incisively noted: “He who accepts statistics indiscriminately will often be duped unnecessarily. But he who distrusts statistics indiscriminately will often be ignorant unnecessarily.”

The core theme of Statistics and Truth is that we see truth only with some uncertainty, which we need to understand to make responsible use of the glimpse of truth we have had. C. R. Rao summarized this with the following equation:

Uncertain knowledge + knowledge of the amount of uncertainty in it

= usable knowledge.

Statistics provides the second term on the left and thus is essential in obtaining "usable knowledge."

This equation represents a new way of thinking, freeing humanity from reliance on oracles and fortune-tellers and helping to reduce risks and make informed decisions.

“* If we have to take a decision under uncertainty, mistakes cannot be avoided.

* If mistakes cannot be avoided, we better know how often we make mistakes (knowledge of amount of uncertainty) by following a particular rule of decision making (creation of new but uncertain knowledge).

* Such a knowledge could be put to use in finding a rule of decision making which does not betray us too often or which minimizes the frequency of wrong decisions, or which minimizes the loss due to wrong decisions.“

Rao gives a common example from daily life in his book: Suppose the weather forecast predicts a 60% chance of rain tomorrow. How do you decide whether to carry an umbrella? It depends on which situation results in less loss: bringing or not bringing an umbrella. Suppose the inconvenience caused by bringing an umbrella on any given day can be measured in monetary terms, denoted as mdollars, and the loss caused by getting wet due to not bringing an umbrella is rdollars. Then, when there is a 60% chance of rain, the expected loss in dollars for both decisions can be calculated as follows:

Decision	Expected Loss
Carry an umbrella	m
Don’t carry an umbrella	0.6 × r + 0.4 × 0 = 0.6r

Thus, when m ≤ 0.6r, you should decide to carry the umbrella; when m > 0.6r, not carryinging the umbrella will minimize your loss.

When analyzing superstition and psychological effects using statistics, Rao mentioned a phenomenon where people seem to have the ability to delay death until they experience a significant or auspicious moment. A study on the mortality rates of Chinese-American women before and after the Mid-Autumn Festival found that the death rate in the week leading up to the festival was 35.1% lower than usual, while in the week following the festival, the death rate was 34.6% higher than normal. Another related study analyzed the months of death for famous individuals, finding that fewer people died just before their birth month compared to those who died in or after their birth month. It seems that people often attempt to delay death until after their birth month. C. R. Rao was born on September 10, 1920, and passed away on August 22, 2023, just short of his 103rd birthday. Unlike the patterns observed in most famous individuals, Rao passed away just before his birth month.

CityQuotes

1.“To understand God’s thoughts we must study statistics, for these are the measures his purpose.”-Francis Nightingale, see Karl Pearson, The Life, Letters and Labours for Francis Galton, 1924

2.“The quiet statisticians have changed our world一not by discovering new facts or technical developments, but by changing the ways we reason, experiment, and form our opinions about it."-Ian Hacking, Trial by number, Science,1984

Related CityReads

06.CityReads | Life in the City Is Essentially One Giant Math Problem

15.CityReads | Academic Writing: How to Write a Lot?

16.CityReads | Writing Lessons from Stephen King

21.CityReads│A Red Capitalist in Shanghai in 1966

23.CityReads│How to Lie With Maps

35.CityReads│The Joy of Stats

38.CityReads│Sontag: What Makes Me Feel Strong?

40.CityReads│By Force of Thought: Kornai's Intellectual Journey

74.CityReads | The Eight Strategies for Getting Academic Writing Done

87.CityReads│A Russian in Lijiang, 1941-1949

96.CityReads│Alexander von Humboldt: the man who invents the nature

111.CityReads│The Top 12 Book Reviews of 2016 by LSE RB

113.CityReads│Haruki Murakami: A Running Novelist & Translator

117.CityReads | Remembering Edutainer Hans Rosling,Who Made Data Dance

127.CityReads | Everybody Lies: How the Internet Reveals Who We Are

135.CityReads│Borges in Conversation

164.CityReads│May You Find Your Own Abbot Vallet

165.CityReads | Scale: Simple Law of organisms, Cities and Companies

175.CityReads│What Is the Best Way to Learn Statistics?

191.CityReads│The Unknown Lives of Sanitation Workers in New York

207.CityReads│Guide for the Study of 21st Century City

210.CityReads│How Sociologists Study Space?

211.CityReads│Learning Statistical Thinking for the 21st Century

213.CityReads│When Words Meet Numbers: What It Reveals about Writing

215.CityReads│Thinking through Images: A Phd Thesis in Comics

228.CityReads│How to Map the Spatial Logic of Society?

234.CityReads | How to Take Smart Notes:Luhmann’s Slip-Box

235.CityReads│How to Spot Chart Lies?

241.CityReads│Bright Stars: Summer Reading List of (Auto)biographies

242.CityReads│Three Reference & Study Guide Books on Housing Studies

252.CityReads│How To Improve Your Data Literacy?

290.CityReads | The Banished Immortal: a life of Li Bai by Ha Jin

323.CityReads | 12 Most-read Book Reviews of 2020 by LSE RB

349.CityReads | Tools of Titans: Luhmann's Slip-Box

350.CityReads | 8 Academic Writing Books

356.CityReads | 5 Milestones in the History of Data Visualization

357.CityReads | 16 Recommended Books for Urban Sociology Graduate Students

359.CityReads | 5 Books for Ethnographic Writing by Jørgen Kalin

362.How to Conduct a Mixed Methods Study in Social Sciences?

363.CityReads | Five Guidelines for Better Data Visualizations

364.CityReads | 7 Ways to Visualize Qualitative Data

365.CityReads | How to Conduct Comparative Urban Studies?

391.CityReads | Best Books on Urban Affairs: 1999-2022

400.CityReads | How to Conduct a High-quality Qualitative Research?

411.Why Qualitative Research Is Needed in the Era of Big Data

412.How the Internet Has Changed the Ethnography Practices?

415.CityReads | What Constitutes a Good Qualitative Research?

430.CityReads | 5 books on Using Data to Understand the World

431.Correcting 5 Misunderstandings About Case Study Research

432.CityReads | Steering His Own Ship: Yi-Fu Tuan’s lessons

434.CityReads | How to Think Clearly With Data?

446.CityReads | How to Conduct Fieldworks in Chinese Cities？

458.CityReads | When Hägerstrand Meets Big Data

482.CityReads | Delineating a City by Cell-Phone Data

487.CityReads | How to Spot and Refute Bullshit?

489.CityReads | How Sociologists Use Statistics to Study Society?

（Click the title or enter our WeChat menu and reply number ）

CityReads ∣Notes On Cities

"CityReads", a subscription account on WeChat,

posts our notes on city reads weekly.

Please follow us by searching "CityReads"

Or long press the QR code above

城读

城市阅读的记录

最新文章

城读 | 我们从未可持续发展过

CityReads | We Have Never Been Sustainable

城读 | 全球城市的社会分层正在两极化吗？来自21世纪伦敦社会阶层变迁的数据

CityReads | Polarized Social Class of Global City?

城读 | 中国城市治理之道：国家企业主义

CityReads | Ways of Urban Governance in China

城读 | 没有规模经济就没有城市：城市与空间经济学50年研究进展

城读 | 什么是批判性城市理论？

CityReads | What is Critical Urban Theory?

城读 | 我们如何死亡？

CityReads | How We Die?

城读 | 激进的适应：如何改造城市以应对高温、洪水和干旱等气候变化？

CityReads | Radical Adaptation to Climate Change

城读 | 编结茅香：一位北美原住民后裔和植物学家从植物中学到的智慧

CityReads | The Lesson of Sweetgrass

城读 | 当我们模拟一座城市的时候，我们在模拟什么？

CityReads | What Do We Simulate When We Simulate a City?

城读 | 21世纪的多元城市主义

CityReads | Many Urbanisms at the 21st Century

城读 | 技术与进步角力的千年史：如何将技术导向共同繁荣？

城读 | 中英相遇时的两位译者

CityReads | The Two Interpreters During Qing-Britain Encounters

城读 | 农业与城市的发明必然会导致不平等吗？

CityReads | Agriculture & Cities inevitably Lead to Inequality?

城读 | 论统计学应用的普遍性

CityReads | On the Ubiquity of Statistics

城读 | 城市让你的梦想实现了吗？

CityReads | City Makes Your Dreams Come True?

城读 | 反对AI：为什么AI构成人类生存的威胁？

CityReads | Rage Against AI

城读 | 不平等的亲密：制造宠物的权力游戏

CityReads | Unequal Intimacy: Power and Play of Pet Making

城读 | 马蹄声响：马如何改变人类历史？

CityReads | Hoof Beats: A 4,000-Year History of Humans & Horses

城读 | 下一阶段：围绝经期和更年期女性如何运动与饮食？

CityReads | Next Level

城读 | 城市垂直增长转型：从向外扩张转向垂直增长

CityReads | Urban Upward Growth Transition

城读 | 女性与奥运会：哪个性别为国家赢得了更多的金牌？

CityReads | Women & Olympic Games

城读 | 巴黎如何发明了现代城市生活？

CityReads | How Paris Invented Modern Urban Life?

城读 | 文章推送列表（Contents）

城读 | 2024.03-2024.07

城读 | 更高、更快、更强？摩天大楼发展史

CityReads | Higher, Faster, Stronger? History of Skyscrapers

城读 | 前无古人，后有来者

CityReads | The First But Not the Last

城读 |地理批评：文学中的空间与空间中的文学

CityReads | Geocriticism

分类

时事

民生

政务

教育

文化

科技

财富

体娱

健康

情感

旅行

百科

职场

楼市

企业

乐活

学术

汽车

时尚

创业

美食

幽默

美体

文摘

原创标签

时事社会财经军事教育体育科技汽车科学房产搞笑综艺明星音乐动漫游戏时尚健康旅游美食生活摄影宠物职场育儿情感小说曲艺文化历史三农文学娱乐电影视频图片新闻宗教电视剧纪录片广告创意壁纸头像心灵鸡汤星座命理教育培训艺术文化金融财经健康医疗美妆时尚餐饮美食母婴育儿社会新闻工业农业时事政治星座占卜幽默笑话独立短篇连载作品文化历史科技互联网

发布位置

广东北京山东江苏河南浙江山西福建河北上海四川陕西湖南安徽湖北内蒙古江西云南广西甘肃辽宁黑龙江贵州新疆重庆吉林天津海南青海宁夏西藏香港澳门台湾美国加拿大澳大利亚日本新加坡英国西班牙新西兰韩国泰国法国德国意大利缅甸菲律宾马来西亚越南荷兰柬埔寨俄罗斯巴西智利卢森堡芬兰瑞典比利时瑞士土耳其斐济挪威朝鲜尼日利亚阿根廷匈牙利爱尔兰印度老挝葡萄牙乌克兰印度尼西亚哈萨克斯坦塔吉克斯坦希腊南非蒙古奥地利肯尼亚加纳丹麦津巴布韦埃及坦桑尼亚捷克阿联酋安哥拉