dpcm

Q-learning (Watkins, 1989) is a simple way for agents to learn how to act optimally in controlled Markovian domains. It amounts to an incremental method for dynamic programming which imposes limited computational demands. It works by successively improving its evaluations of the quality of particular actions at particular states. This paper presents and proves in detail a convergence theorem for Q,-learning based on that outlined in Watkins (1989). We show that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action-values are represented discretely. We also sketch extensions to the cases of non-discounted, but absorbing, Markov environments, and where many Q values can be changed each iteration, rather than just one.

说明：  This program do bitplane slicing to embed watermark binary image in the least significant plane.Watermark is recovered even in presence of noise

上海电气MATLAB仿真模型用户手册word文档说明的十分详细()

地震数据处理软件包，包括f-x预测滤波等，非常实用，搞地震方面的可以参考 (Seismic data processing software, very useful, engaging earthquakes can refer to )

在栅格环境下，采用遗传算法实现静态全局路径规划(In a grid environment, using genetic algorithm static global path planning)

采用专家PID设计控制器，实现三阶传递函数的阶跃响应(PID controller is designed by experts to achieve third-order transfer function of the step response)

实现DV-Hop定位算法的仿真,自动生成一定节点数的随即分布图，给出仿真结果的各点定位误差，用曲线图形显示，并可以计算平均误差。(DV-Hop simulation. Produce a randomly distributed nodes and then simulate and give the location error of each node, showing it in figure, and calculate the average error. )

该程序主要进行重力一位界面的反演，该程序精度准确,具有很好的实际应用效果。(The program mainly for gravity inversion of an interface, the program precision, with good practical results.)

电压暂降的故障模拟仿真。可作为设计的电源部分(Voltage dips of fault simulation. Can be used as part of the design of power)

计算小推力轨道转移时间最短优化程序，运行环境为MATLAB，最后在linux环境下运行(Calculate the shortest time low thrust orbit transfer optimization program, the operating environment for MATLAB, the final run in linux environment)