{{Probability distribution
|name = 齐夫定律
|type = 質量
|pdf_image = 的图像,其中N = 10]]
横纵坐标均为对数比例下,齐夫定律的概率质量函数的图像,其中N = 10。横坐标是指数k 。(注意,函数仅在k为整数时有定义,图上的连线不代表函数连续。)
|cdf_image = 的图像,其中N = 10]]
横纵坐标均为对数比例下,齐夫定律的累积分布函数的图像,其中N = 10。横坐标是指数k 。(注意,函数仅在k为整数时有定义,图上的连线不代表函数连续。)
|parameters =s>0\,(实数)
N \in \{1,2,3\ldots\}(正整数)
|support = k \in \{1,2,\ldots,N\}
|pdf = \frac{1/k^s}{H_{N,s}}
|cdf = \frac{H_{k,s}}{H_{N,s}}
|mean = \frac{H_{N,s-1}}{H_{N,s}}
|notation =
|median =
|mode = 1\,
|variance =
|skewness =
|kurtosis =
|entropy = \frac{s}{H_{N,s}}\sum_{k=1}^N\frac{\ln(k)}{k^s}
+\ln(H_{N,s})
|mgf = \frac{1}{H_{N,s}}\sum_{n=1}^N \frac{e^{nt}}{n^s}
|char = \frac{1}{H_{N,s}}\sum_{n=1}^N \frac{e^{int}}{n^s}
|}}
齐夫定律(,IPA:)是由哈佛大學的語言學家于1949年发表的实验定律。它可以表述为:在自然语言的語料庫裡,一个单词出现的频率与它在频率表里的排名成反比。所以,频率最高的单词出现的频率大约是出现频率第二位的单词的2倍,而出现频率第二位的单词则是出现频率第四位的单词的2倍。这个定律被作为任何与冪定律概率分布有关的事物的参考。
例子
最简单的齐夫定律的例子是“1/f function”。给出一组齐夫分布的频率,按照从最常见到非常见排列,第二常见的频率是最常见频率的出现次数的½,第三常见的频率是最常见的频率的1/3,第n常见的频率是最常见频率出现次数的1/n。然而,这并不精确,因为所有的项必须出现一个整数次数,一个单词不可能出现2.5次。
在布朗语料库中,“the”、“of”、“and”是出現頻率最前的三個單詞,其出現的頻數分別為69971次、36411次、28852次,大約佔整個語料庫100萬個單詞中的7%、3.6%、2.9%,其比例約為6:3:2。大約佔整個語料庫的7%(100万单词中出现69971次)。满足齐夫定律中的描述。仅仅前135個字彙就佔了Brown語料庫的一半。
齐夫定律是一个实验定律,而非理论定律,可以在很多非语言学排名中被观察到,例如不同国家中城市的数量、公司的规模、收入排名等。但它的起因是一个争论的焦点。齐夫定律很容易用点阵图观察,坐标分别为排名和频率的对数(log)。比如,“the”用上述表述可以描述为x = log(1), y = log(69971)的点。如果所有的点接近一条直线,那么它就遵循齐夫定律。
遵循该定律的现象
- 英文单词或中文汉字的出现频率:不仅适用于语料全体,也适用于单独的一篇文章
- 网页访问频率
- 城镇人口与城镇等级的关系
- 收入前3%的人的收入
- 地震震级
- 固体破碎时的碎片大小
參見
- 經驗公式
- 词频效应
延伸閱讀
主要:
- George K. Zipf(1949)Human Behavior and the Principle of Least Effort. Addison-Wesley.
- George K. Zipf (1935) The Psychobiology of Language. Houghton-Mifflin.(see citations at http://citeseer.ist.psu.edu/context/64879/0)
次要:
- Lada Adamic. Zipf, Power-laws, and Pareto - a ranking tutorial. http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html
- Alexander Gelbukh and Grigori Sidorov (2001) [http://www.gelbukh.com/CV/Publications/2001/CICLing-2001-Zipf.htm "Zipf and Heaps Laws’ Coefficients Depend on Language"] . Proc. CICLing-2001, Conference on Intelligent Text Processing and Computational Linguistics, February 18–24, 2001, Mexico City. Lecture Notes in Computer Science N 2004, ISSN 0302-9743, ISBN 3-540-41687-0, Springer-Verlag: 332–335.
- Damián H. Zanette (2006) "[http://xxx.arxiv.org/abs/cs.CL/0406015 Zipf's law and the creation of musical context,]" Musicae Scientiae 10: 3-18.
- Kali R. (2003) "The city as a giant component: a random graph approach to Zipf's law," Applied Economics Letters 10: 717-720(4)
*
*
- Axtell, Robert L; [http://www.sciencemag.org/content/293/5536/1818.short Zipf distribution of US firm sizes] , Science, 293, 5536, 1818, 2001, American Association for the Advancement of Science
外部連結
*—An article on Zipf's law applied to city populations
*[http://www.theatlantic.com/issues/2002/04/rauch.htm Seeing Around Corners (Artificial societies turn up Zipf's law)]
*[http://planetmath.org/encyclopedia/ZipfsLaw.html PlanetMath article on Zipf's law]
*[http://www.hubbertpeak.com/laherrere/fractal.htm Distributions de type "fractal parabolique" dans la Nature (French, with English summary)]
*[http://www.newscientist.com/article.ns?id=mg18524904.300 An analysis of income distribution]
*[https://web.archive.org/web/20070623154627/http://www.lexique.org/listes/liste_mots.txt Zipf List of French words]
*[https://web.archive.org/web/20110408115104/http://1.1o1.in/en/webtools/semantic-depth Zipf list for English, French, Spanish, Italian, Swedish, Icelandic, Latin, Portuguese and Finnish from Gutenberg Project and online calculator to rank words in texts]
*[http://uk.arxiv.org/abs/physics/9901035 Citations and the Zipf–Mandelbrot's law]
*[http://demonstrations.wolfram.com/ZipfsLawForUSCities/ Zipf's Law for U.S. Cities] by Fiona Maclachlan, Wolfram Demonstrations Project.
*
*[http://www.geoffkirby.co.uk/ZIPFSLAW.pdf Zipf's Law examples and modelling (1985)]
*[http://www.nature.com/nature/journal/v474/n7350/full/474164a.html Complex systems: Unzipping Zipf's law (2011)]
*[http://terrytao.wordpress.com/2009/07/03/benfords-law-zipfs-law-and-the-pareto-distribution/ Benford’s law, Zipf’s law, and the Pareto distribution] by Terence Tao.
评论 (0)