Chapter 3 (The Reinforcement Learning Problem)

使用matlab读取心电、血压等采集数据.dat和.hea文件，并分图标注显示。内有详细程序说明和读取实例(Using matlab to read ECG, blood pressure and other data collection. Dat and. Hea files and sub-icon Note display. There are detailed instructions and read the example programs)

说明：  象棋MTALAB 程序，还不错的，希望对喜欢象棋，并对MATLAB 感兴趣的同志有用。(MTALAB chess program, but also good, hope to enjoy chess, and of interest to gay MATLAB useful.)

多种降维算法,包括lle,lpp,ltsa(many kinds of dimension reduction method)

aiming at the reliability analysis of meaures

用matlab语言仿真iir滤波器的性能和参数,程序中有详尽的说明(simulation using Matlab language IIR filter performance and parameters, procedures are spelled out)

蒙特卡洛算法也常用于机器学习，特别是强化学习的算法中。一般情况下，针对得到的样本数据集建立相对模糊的模型，通过蒙特卡洛方法对于模型中的参数进行选取，使之于原始数据的残差尽可能的小。从而达到建立模型拟合样本的目的。(Monte Carlo algorithm is also commonly used in machine learning, especially in reinforcement learning algorithm. In general, a relatively fuzzy model is established for the obtained sample data set, and the parameters in the model are selected by Monte Carlo method so that the residual error of the original data is as small as possible. Thus, the purpose of establishing the model fitting sample is achieved.)

adptc the code for adptc its an exellent one

说明：  Lorenz 系统利用龙格库塔来用Matlab编程(Lorenz system using Runge-Kutta to use the Matlab programming)

此例matlab是用cma算法均衡8PSK调制信号，代码清晰无误，仿真图效果很好。(In this case matlab is using the the cma algorithm balanced 8PSK modulation signal, the code is clear and unmistakable, the simulation map works well.)

计算成组滑动的滑窗检测器的最佳门限已知: 击中数N = 128, 组宽n = 8，PF = 10¡ 6，PD = 90 假设以下条件: (a) 信号不起伏 (b) 忽略天线波束调制 1 (c) 计算PD时忽略目标区以外噪声的影响 组门限(第二门限)为K=8 滑窗的门限(第三门限)为L=16 (滑窗中包含的组数为16) 求解: 最佳的KOPT 和LOPT，对这题做了具体仿真实现。需要的朋友，一定知道很有用。(Optimal threshold calculated as group slidable window detector is known: hit number N = 128, the group width n = 8, PF = 106, PD = 90 assuming the following conditions: (a) signal is not undulation ( b) ignore the antenna beam modulation 1 (c) the calculation of PD ignored outside the target area noise of impact group door limit (the second door limit) for K = 8 sliding window of the door limit (third door limit) for L = 16 (sliding window contains group 16) to solve: the best of the KOPT the LOPT, these questions do specific simulation to achieve. A friend in need, we must know to be useful.)