fiekao_V3.6

Image Storage in Access

This code used in Modeling the wireless Propagation channel A simulation approach with Matlab

自己编写的遗产算法程序。在matlab环境下编写的m文件。经测试好用，基本，原理简单。(I have written legacy algorithm. In the matlab environment prepared m files. Tested easy to use, the basic principle is simple.)

OFDM符号定时同步算法，几种经典算法的仿真和比较(OFDM symbol timing synchronization algorithm, simulation and comparison of several classical algorithm)

Chapter 5 of Telecommunication Networks book

Frank-Wolfe算法 matlab(rank-Wolfe, matlab)

说明：  Matlab的系统经典辨识，包括二阶和三阶(Matlab system identification classical)

this go sample code for genetic

IRR数字高通滤波器matlab程序代码(IRR digital high pass filter matlab code)

Q-learning (Watkins, 1989) is a simple way for agents to learn how to act optimally in controlled Markovian domains. It amounts to an incremental method for dynamic programming which imposes limited computational demands. It works by successively improving its evaluations of the quality of particular actions at particular states. This paper presents and proves in detail a convergence theorem for Q,-learning based on that outlined in Watkins (1989). We show that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action-values are represented discretely. We also sketch extensions to the cases of non-discounted, but absorbing, Markov environments, and where many Q values can be changed each iteration, rather than just one.