Robust Statistics - 2nd Edition
鲁棒统计，现代统计方法， Robust Statistics第二版，学习现代统计方法R○ BUST STAT|STCSSecond editionPeter j, huberProfessor of Statistics, retiredKlosters SwitzerlandEⅣ ezio m. RonchettiProfessor of StatisticsUniversity of Geneva, SwitzerlandWILEYA JOHn WileY SONS INC. PUBliCAtIONCopyrightc 2009 by John Wiley Sons, Inc. All rights reservedPublished by John Wiley sons, Inc, Hoboken, New JerseyPublished simultaneously in CanadaNo part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form orby any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except aspermitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the priorwritten permission of the Publisher, or authorization through payment of the appropriate per-copy fee tothe Copyright Clearance Center, Inc, 222 Rosewood Drive, Danvers, MA 01923, (978)750-8400, fax978)750-4470,oronthewebatwww.copyrigom. requests to the publisher for permission shouldbe addressed to the permissions department John Wiley sons, Inc., 11 1 River Street, Hoboken, NJ07030,(201)748-6011,fax(201)748-6008,oronlineathttp:/www.wileycom/go/permissionLimit of Liability /Disclaimer of Warranty: While the publisher and author have used their best efforts inpreparing this book, they make no representations or warranties with respect to the accuracy orcompleteness of the contents of this book and specifically disclaim any implied warranties ofmerchantability or fitness for a particular purpose. No warranty may be created or extended by salesrepresentatives or written sales materials. The advice and strategies contained herein may not be suitablefor your situation. You should consult with a professional where appropriate. Neither the publisher norauthor shall be liable for any loss of profit or any other commercial damages, including but not limitedto special, incidental, consequential, or other damagesFor general information on our other products and services or for technical support, please contact ourCustomer Care Department within the United States at(800)762-2974, outside the United States at(317)572-3993 or fax(317)572-4002.Wiley also publishes its books in a variety of electronic formats. Some content that appears in print maynot be available in electronic format. For information about wiley products, visit our web site atwww.wileycomLibrary of Congress Cataloging-in-Publication Data:Huber Peter JRobust statistics, second edition/ Peter J. Huber, Elvezio ronchettip. cnIncludes bibliographical references and indeISBN978-0-470-12990-6( cloth)1. Robust statistics. I. Ronchetti. elvezio. II. TitleQA276.H7852009519.5-dc222008033283Printed in the United States of america10987654321To the memory o1John w. tukeyThis Page Intentionally Left BlankCONTENTSPrefacePreface to first editionGeneralities1 Why robust Procedures1. 2 What Should a robust procedure achieve?1.2.1 Robust. Nonparametric and Distribution-Free1.2.2 Adaptive procedures1.2.3 Resistant Procedures1.2. 4 Robustness versus Diagnostics1.2.5 Breakdown point1.3 Qualitative Robustness567888911. 4 Quantitative Robustness1.5 Infinitesimal Aspects141.6 Optimal Robustness171.7 Performance Comparisons18CONTENTS1.8 Computation of robust estimates181.9 Limitations to Robustness Theory202 The Weak Topology and its Metrization23eneral remarks232.2 The Weak Topology232.3 Levy and prohorov metrics272.4 The bounded Lipschitz metric322.5 Frechet and Gateaux derivatives366 Hampels Theorem413 The Basic Types of Estimates453. 1 General Remarks453.2 Maximum Likelihood Type Estimates(M-Estimates)3.2.1 Influence Function of m-estimates73.2.2 Asymptotic Properties of M-Estimates483.2.3 Quantitative and Qualitative Robustness of MEstimates3.3 Linear Combinations of Order Statistics(L-Estimates)3.3.1 Influence Function of -Estimates3.3.2 Quantitative and Qualitative robustness of l-Estimates 593. 4 Estimates Derived from Rank Tests(R-estimates3.4.1 Influence Function of R-Estimates623.4.2 Quantitative and Qualitative robustness of R-Estimates 643.5 Asymptotically Efficient M-, L,and R-Estimates674 Asymptotic Minimax Theory for Estimating Location4.1 General remarks4.2 Minimax bias4.3 Minimax Variance: Preliminaries744. 4 Distributions minimizing fisher Information764.5 Determination of Fo by Variational Methods814.6 Asymptotically Minimax M-Estimates914.7 On the minimax Property for L-and R-estimates954.8 Redescending m-estimates74.9 Questions of Asymmetric Contamination101CONTENTSScale Estimates1055.1 General remarks1055.2 M-Estimates of scale1075.3 L-Estimates of scale5.4 R-Estimates of Scale1125.5 Asymptotically efficient Scale estimates1145.6 Distributions Minimizing fisher Information for Scale5.7 Minimax Properties116 Multiparameter Problemsin Particular Joint Estimationof Location and scale1256. 1 General remarks1256.2 Consistency of M-Estimates1266.3 Asymptotic Normality of M-Estimates1306. 4 Simultaneous m-Estimates of Location and scale1336.5 M-Estimates with Preliminary Estimates of Scale1376.6 Quantitative robustness of Joint Estimates of Location and Scale 1396.7 The Computation of M-Estimates of Scale14368Studentizing1457 Regression1497. 1 General remarks1497. 2 The Classical Linear Least Squares Case1547. 2.1 Residuals and Outliers1587.3 Robustizing the Least Squares Approach1607.4 Asymptotics of robust regression Estimates163741 The Cases hp2→0 and hp→07.5 Conjectures and Empirical Results1687.5.1 Symmetric Error Distributions1687.5.2 The Question of Bias1687.6 Asymptotic Covariances and Their estimation1707. 7 Concomitant Scale estimates1727.8 Computation of Regression M-Estimates1757.8.1 The Scale Step1767.8.2 The Location Step with Modified residuals1787.8.3 The Location Step with Modified Weights179CONTENTS7.9 The Fixed Carrier Case: What Size hi?1867. 10 Analysis of Variance1907. 11 LI-estimates and Median polish1937. 12 Other Approaches to Robust Regression1958 Robust Covariance and Correlation Matrices1998. 1 General remarks8.2 Estimation of Matrix Elements Through robust Variances2038.3 Estimation of Matrix Elements Through robust Correlation2048.4 An Affinely equivariant approach2108.5 Estimates Determined by Implicit Equations2128.6 Existence and Uniqueness of Solutions2148.6. 1 The Scatter estimate v2148.6.2 The Location estimate t2198.6.3 Joint Estimation of t and y2208.7 Influence Functions and Qualitative robustness2208.8 Consistency and asymptotic normality2238.9 Breakdown Point48.10 Least informative distributions2258.1058. 10.2 Covariance2278.11 Some Notes on Computation2339 Robustness of Design2399.1 General remarks2399.2 Minimax Global Fit9.3 Minimax Slope24610 Exact Finite Sample Results24910.1 General Remarks24910.2 Lower and Upper Probabilities and Capacities25010.2.1 2-Monotone and 2-Alternating Capacities25510.2.2 Monotone and Alternating Capacities of Infinite Order 25810.3 Robust Tests25910.3. 1 Particular Cases26510.4 Sequential Tests267
- 2020-12-03下载
- 积分：1
晶圆缺陷检测与分类的卷积神经网络
晶圆缺陷检测与分类的卷积神经网络；针对晶圆检验时扫描电镜图像的缺陷检测和缺陷分类两问题，采用了“ ZFNet”的卷积神经网络来分类晶圆缺陷，并基于该分类器实现了一种“基于块的卷积神经网络”缺陷检测算法。为了提高准确率和加快速度，又改动“更快的区域卷积神经网络”实现了另一种检测算法。第卷第期邡鑫,史峥:晶圆缺陌检测与分类的卷积神经网络ZENet classifierDarker ImIn.ril” HumpBitel检测算法示意图在训练检测器时,数据集是检测器原始尺寸的图像,且包含标记好的缺陷区域和类型。我们结构通过·系列数据扩张操作,得到组数据,随机选取相比于检测算法主作为训练集,作为测试集。要从以下三方面进行了针对性的改进算法中需要优化的参数有滑动窗口尺寸滑()针对重复计算卷积的缺点,采用先动步幅、概率阙值、面积阙值,由于无法求出统一计算特征图,再按)进行映射各参数与检测结果的明确关系式,所以采用遍历法优化参截取的办法。如图,先通过卷积网络(数。因为检测到的缺陷尽量正确和尽量检测到所有缺陷是)对输入图像计算得到其特征图,因为在输入图像矛盾的,故以精确率和召回率的调和平均值作为优上的都能映射到特征图上,所以从输入图像上按化目标,也可根据实际需要调整两者权重满足不同侧重。割取图像进行卷积运算可以替代为直接从特征图上按测试结果映射后的范围割取,从而避免多次重复计算卷积。由于用训练好的检测模型对测试集检的大小形状不·,而全连接层的神经元连接数是固定的,测,计算模式下每张图大概耗时如果检测到的缺所以对割取得到的子特征图,通过层次采样到统陷与标准答案的且类型相同,则判为正确,否尺寸以连接到全连接层。则判为错误。得到结果如表,计算得:laut Image精确率Feature Map召回率ROI其屮正确缺陷的平均表检测器测试结果数量正确错误network有缺陷(正类)图映射示意图从检测结果来看该算法基本实现∫对图像上晶圆()针对滑动窗口尺寸单·的缺点,增缺陷的检测和分类,但是值较低,缺陷检测位置不加了滑动窗口的尺寸类型,并且增加由一个全卷积网络准确,检测耗时较长,分析其原囚如下)组成的()检测出错的数据中,缺陷较大的类型易判断错,)来预判断是否有缺陷。本文采用面积缺陷较小的容易被漏掉,说明只使用一种尺寸的滑动框很分别为,长宽比分别为、共难适应尺寸变化范围较大的缺陷种尺寸的滑动窗口,依次计算其中有缺陷的概率,再从中)滑动框步幅减小则算法耗时平方倍增加,而步幅筛选出一定数量最有可能有缺陷的区域,进行非极大值抑过长造成缺陷概率分布图分辨率较差,从而检测到缺陷位制(),最后得到一定数置准确度较差量的候选区域。()相邻滑动框都有大量重叠,所以每个区域都被多()针对缺陷检测位置准确度差的缺点,次重复送入计算卷积,导致算法耗吋较长。在全连接层后连接一个边界回归层在与上述检测算法相似的图像目标检测领域,近来出用来修正缺陷位置,该回归层与分类层并列。现的很好的克服了以上缺点并取得了很好的针对本文的缺陷检测问题,直接套用标准效果,所以下面介绍如何通过改动实现品圆并不能解决问题。因为判断晶圆的缺陷类型通常需缺陷的检测与分类。要结合缺陷区域周围的图形信息,而在预判断是否有C1994-2017ChinaAcademicJournalElcctronicPublishinghOusc.Allrightsrescrved.http://www.cnki.nct计算机工程年月日缺陷吋还进行了边界回归。虽然更加准确的给出缺陷的位()将原尺寸为的图像调整为置,但送入检测网络的特征儿乎不包含缺陷周围图肜信息,使得滑动窗口尺寸能够适应缺陷大小的变化范围,也可以导致缺陷分类不准。故木文对标准徹了一些根据实际情况来具体调整。改动:得到缺陷检测算法如图,卷积网络(()将改为只判断滑动窗口内是否有缺陷,而,)将输入图僚转换成多种特征图;根据不进行边界回归,也就是只计算所有滑动窗口有缺陷的概特征图从滑动窗口中选出最有可能存在缺陷的率,选取可能性最大的个,做非极大值抑制,再选出层根据特征图中抽取出对应特征组成特可能性最大的个进行检测。征向量;检测网络()根据特征向()将卷积层的尺寸加大为,加大感受野量判断缺陷类型,并进行边界回归;最后通过和概率),从而在判断滑动框內是否有缺陷吋能参阈值对候选缺陷进行过滤即可得到最终缺陷。考更多的周围信息。Detection NetworkonFolutionnl actorSoftmaxRuI Puling liver,e Prop卟 edMS+PrubilitessionInput Image 1024*1024Fully 10 dyercrectCcrvchrionalLaver size 747图检测算法示意图模型训练和平均值作为优化目标,并且使用相同的训练集和图中的检测算法也是基于架构实现,因为卷测试集积网络提取的特征类型对相似普遍有效,故其卷积网络的测试结果参数是直接迁移第章分类器的卷积层参数。但是用训练好的检测模型对测试集检测,和的参数则需要通过方法进行训练,标准计算模式下每张图大概耗时,采用相同判定标准,提供了分开和联合两种训练方式。为了节约得到检测结果如表(其中负类总数与表中总数不同是因时间,本文采用联合训练方式,并结合缺陷检测问题的实为同一张图屮可能检测到多个缺陷),计算得际情况调整超参数精确率在训练时,对每张输入图像,要计算的滑动窗口召回率数量庞大(种尺寸的滑动窗口,滑动步幅)。所以从中随机抽取个作为训练集,其中正例其中正确缺陷的平均负例,且正例占比不超过。分类器采用表检测器测试结果损失函数数量正确错误在训练时,设置提供个,从中随有缺陷(正类)机选取个作为训练集,其屮正例无缺陷(负类)负例,且正例占比不超过。另外设置学从结果来看该算法各方面都优于检测算习率分类器采用损失函数,而边界回法和值更高说明检测检测缺陷类型正确归采用函数。且位置准确,而且速度也大大提高(检测一张图像耗时从为了与检测算法对比,在最后通过遍历法缩小到)。如图为检测缺陷示例,共中标注了缺陷优化和概率阈值时,同样以精确率和召回率的调位置、类型和对应概率C1994-2017ChinaAcademicJournalElcctronicPublishinghOusc.Allrightsrescrved.http://www.cnki.nct邡鑫,史峥:晶圆缺陷检测与分类的卷积神经网络I I图检测结果示例图结束语而对图像上的缺陷检测和缺陷分类这两个问题,本文提出的改动后的检测算法能够精准、快速地从图像中检测出缺陷并同吋进行分类。得益于卷积神经网络良好的特征学习能力,该检测算法能够根据标记好缺陷位置和类型的数据自动学习特征,从而尽量避免人工千预,使算法具有较强的适应能力。参考文献徐姗姗刘应安徐昇基于卷积神经网络的木材缺陷识别山东大学学报工学版刘云杨建滨王传旭基于卷积神经网络的苹果缺陷检测算法电子测量技术江帆刘辉王彬等基于模型的图像识别计算机工程C1994-2017ChinaAcademicJournalElcctronicPublishinghOusc.Allrightsrescrved.http://www.cnki.nct
- 2021-05-06下载
- 积分：1
