This book explores minimum divergence methods of statistical machine learning for estimation, regression, prediction, and so forth, in which we engage in information geometry to elucidate their intrinsic properties of the corresponding loss functions, learning algorithms, and statistical models. One of the most elementary examples is Gauss’s least squares estimator in a linear regression model, in which the estimator is given by minimization of the sum of squares between a response vector and a vector of the linear subspace hulled by explanatory vectors. This is extended to Fisher’s maximum likelihood estimator (MLE) for an exponential model, in which the estimator is provided by minimization of the Kullback/Leibler (KL) divergence between a data distribution and a parametric distribution of the exponential model in an empirical analogue. Thus, we envisage a geometric interpretation of such minimization procedures such that a right triangle is kept with Pythagorean identity in the sense of the KL divergence. This understanding sublimates a dualistic interplay between a statistical estimation and model, which requires dual geodesic paths, called m/geodesic and e/geodesic paths, in a framework of information geometry. We extend such a dualistic structure of the MLE and exponential model to that of the minimum divergence estimator and the maximum entropy model, which is applied to robust statistics, maximum entropy, density estimation, principal component analysis, independent component analysis, regression analysis, manifold learning, boosting algorithm, clustering, dynamic treatment regimes, and so forth. We consider a variety of information divergence measures typically including KL divergence to express departure from one probability distribution to another. An information divergence is decomposed into the cross/entropy and the (diagonal) entropy in which the entropy associates with a generative model as a family of maximum entropy distributions; the cross entropy associates with a statistical estimation method via minimization of the empirical analogue based on given data. Thus any statistical divergence includes an intrinsic object between the generative model and the estimation method. Typically, KL divergence leads to the exponential model and the maximum likelihood estimation. It is shown that any information divergence leads to a Riemannian metric and a pair of the linear connections in the framework of information geometry. We focus on a class of information divergence generated by an increasing and convex function U, called U/divergence. It is shown that any generator function U generates the U/entropy and U/divergence, in which there is a dualistic structure between the U/divergence method and the maximum U/entropy model. We observe that a specific choice of U leads to a robust statistical procedure via the minimum U/divergence method. If U is selected as an exponential function, then the corresponding U/entropy and U/divergence are reduced to the Boltzmann/Shanon entropy and the KL divergence; the minimum U/divergence estimator is equivalent to the MLE. For robust supervised learning to predict a class label we observe that the U/boosting algorithm performs well for contamination of mislabel examples if U is appropriately selected. We present such maximal U/entropy and minimum U/divergence methods, in particular, selecting a power function as U to provide flexible performance in statistical machine learning.

• 关于产品：
• ● 正版保障：本网站隶属于中国国际图书贸易集团公司，确保所有图书都是100%正版。
• ● 环保纸张：进口图书大多使用的都是环保轻型张，颜色偏黄，重量比较轻。
• ● 毛边版：即书翻页的地方，故意做成了参差不齐的样子，一般为精装版，更具收藏价值。
• 
  关于退换货：
• 由于预订产品的特殊性，采购订单正式发订后，买方不得无故取消全部或部分产品的订购。
• 由于进口图书的特殊性，发生以下情况的，请直接拒收货物，由快递返回：
• ● 外包装破损/发错货/少发货/图书外观破损/图书配件不全（例如：光盘等）
  并请在工作日通过电话400-008-1110联系我们。
• 签收后，如发生以下情况，请在签收后的5个工作日内联系客服办理退换货：
• ● 缺页/错页/错印/脱线
• 
  关于发货时间：
• 一般情况下：
• ●【现货】 下单后48小时内由北京（库房）发出快递。
• ●【预订】【预售】下单后国外发货，到货时间预计5-8周左右，店铺默认中通快递，如需顺丰快递邮费到付。
• ● 需要开具发票的客户，发货时间可能在上述基础上再延后1-2个工作日（紧急发票需求，请联系010-68433105/3213）；
• ● 如遇其他特殊原因，对发货时间有影响的，我们会第一时间在网站公告，敬请留意。
• 
  关于到货时间：
• 由于进口图书入境入库后，都是委托第三方快递发货，所以我们只能保证在规定时间内发出，但无法为您保证确切的到货时间。
• ● 主要城市一般2-4天
• ● 偏远地区一般4-7天
• 
  关于接听咨询电话的时间：
• 010-68433105/3213正常接听咨询电话的时间为：周一至周五上午8：30～下午5：00，周六、日及法定节假日休息，将无法接听来电，敬请谅解。
• 其它时间您也可以通过邮件联系我们：customer@readgo.cn,工作日会优先处理。
• 
  关于快递：
• ● 已付款订单：主要由中通、宅急送负责派送，订单进度查询请拨打010-68433105/3213。