-
崇志宏:强化学习和深度强化学习
深度学习在强化学习方面的应用所产生的深度强化学习取得快速发展。如何解释深度强化学习优势产生的原因是理解技术的基本方法。强化学习的问题ntel ab数据&智能实验室Agentstate rewardS,||R+=PS=1=8:8:1anR,+1, Environment5o,A0,B1,S1,41,,S2,A2,R3东南大学数据与智能实验室(D& nte lab)强化学习算法的基本范式ntel ab数据&智能实验室Generalized Policy Iteration1. Policy Iteration2. Value iterationevaluationTTU,丌率丌~ greedy(Vdyugreimprovement1. Policy Evaluation博弈2. Policy Improvement1.策略评价逼近策略价值2.策略提高远离策略价值Elements of rlntel ab数据&智能实验室o Policy Valuation Oriented MethodsModel-based or free estimationExp ion or Exploit0 nl ine or0千f|ineExpans ion and Backup Operation(q*)maxnax东南大学数据与智能实验室(D& Inte lab)Position of rlntel ab数据&智能实验室Long short TermPixeICNNPixeIRNNMemory(LSTM)ConvolutionNetworks withFully ConnectedNeural NetworkAutoregressiveNetworkMemoryNetwork(CNN)(FCN)StochasticGradientSecond OrderEarth Mover DistanceDescent (SGD)Algorithms(EMD)NetworksyRt+k+1 St=s, At=ak=0
- 2020-12-09下载
- 积分:1
-
SM2椭圆曲线公钥密码算法
代码实现了SM2算法(国家密码管理局于2010年12月17日发布的椭圆曲线公钥密码算法)。包含验证算法。SM2算法和RSA算法都是公钥密码算法SM2算法是一种更先进安全的算法,在我们国家商用密码体系中被用来替换RSA算法。
- 2020-11-27下载
- 积分:1
-
惯性导航推算(包括数据)
惯性导航推算(包括数据)惯性导航推算(包括数据)惯性导航推算(包括数据)惯性导航推算(包括数据)惯性导航推算(包括数据)
- 2021-05-06下载
- 积分:1
-
T-Splines 4.0 for Rhino5.0中文汉化补丁 破解版下载
T-Splines 4.0 for Rhino5.0中文汉化补丁
- 2017-08-22下载
- 积分:1
-
多幅图像拼接matlab实现 源码下载
多幅图像拼接matlab实现 sift特征提取、描述、匹配、RANSAC、仿射变换
- 2020-12-06下载
- 积分:1
-
心电信号QRS波检测与分析
生理信号中,能够自动的对心电图(Electrocardiograph, ECG)信号进行分析是当前信号处理领域中的研究热点和难点,能够自动的进行心电图信号的分析将会强有力的促进医疗事业的蓬勃发展,同时能够使国民的健康水平有大幅度的提高,对于现代信号处理技术在医疗领域中应用的将会产生重大的突破。对于心电信号的分析有很广泛的研究内容以及研究方法,其中能够快速准确的定位心电信号中 QRS 波群和 P、T 波,是心电图信号分析的一个关键环节,心电信号中往往拥有过多的信号干扰,去除信号的干扰是准确检测各种特征波的前提。截止到现在为止,当前对于心电信号的滤波方法研究以及对于特征波形的定位中还存在着许多的不
- 2021-05-06下载
- 积分:1
-
MATLAB 优化问题 26个测试函数
MATLAB 优化问题 26个测试函数,直接使用即可,唉,前段时间费了好久时间写的,后来发现在网上有库,囧,给大家分享下。。。。
- 2020-12-03下载
- 积分:1
-
ST FOC 5.0说明书 快速入门 SDK v5.0.pdf
ST FOC 5.0说明书 配合 开源库 https://download.csdn.net/download/hxinstar/10322042使用UM2374List of tablesList of tablesTable 1. List of acronymsTable 2Document revision history..23UM2374 Rey 13/24List of figuresUM2374List of figuresFigure 1. ST MC Workbench -Icon and installation folder treeFigure 2. ST MC Workbench-GUI expanded top viewFigure 3. ST Motor Profiler-GUI889Figure 5. ST Motor Profiler-SM-PMSM parameters exampleFigure 4. ST Motor Profiler- Hardware setup list examples1011Figure 6. ST Motor Profiler-l-PMSM parameters exampleFigure 7. ST Motor Profiler-Measurement results12Figure 8. ST Motor Profiler-Save window13Figure 9. ST MC Workbench - New Project window14Figure 10. ST MC Workbench -New Project Info window14Figure 11. ST MC Workbench -Project Settings15Figure 12. ST MC Workbench-Project Settings window.15Figure 13. ST MC Workbench -Project generation button16Figure 14. ST MC Workbench -Workspace selectionFigure 15. ST MC Workbench -Project generation build infoFigure19. ST MC Workbench- Use of the motor control and monitoring.∴、∴,"…,,∴…….17Figure 16. IDE-MC Project view example18Figure 17. STMC Workbench-Motor monitoring button.19Figure 18. ST MC Workbench -Motor monitoring GUI204/24UM2374 Rey 1/UM2374General informationGeneral informationThe Mc sDK is used for the development of motor-control applications running on STM3232-bit microcontrollers based on the arm Cortex-M processorTable 1 presents the definition of acronyms that are relevant for a better understanding ofthis documentTable 1. List of acronymsAcronymDescriptionGUIGraphical user interfaceIDEIntegrated development environmentFOCField-oriented controlFWFirmwareMotor controlMC WBMotor control Workbench(STMicroelectronics sw tool)MPMotor Profiler(STMicroelectronics software tool)PMSMPermanent-magnet synchronous motorPWMPulse-width modulationSDKSoftware development kitVCVector controlMore information about ST MC Workbench is provided in the stm32 motor control SDKv5.0toolsusermanual(um2380)availableatwww.st.comarmUM2374 Rey 15/24Motor control ecosystem setupUM23742Motor control ecosystem setupA suitable ST Motor Control ecosystem environment includesA PC running the needed Mc software toolsA third-party IDEa third-party ANSI C-compilerA JTAG/SWD interface for debugging and programmingAn STMicroelectronics application board with one of the STM32 microcontrollerssupported. It drives the power stage and featuresPWM outputs to gate driverADC channels to measure currentsDC bus voltageA three-phase PMsM motol· A power supplyRefer to the STM32 motor control software development kit(Mc sDk data brief(DB3548)atwww.st.comandtothereleasenoteformoredetails2.1Software tool setupThe STMicroelectronics motor-control ecosystem runs on a pc with Windows7The following Pc software tools are correctly installedST MC Workbench (v5.0.0 or later)STM32CubeMX(v4 24.0 or later)ST-LINK/2(v4.0.0 or later)Any supported IDEIAR Embedded Workbench@ for Arm(v7.80.4Keil MDK tools (v5.24.2 or later)Ac6 System Workbench(v2.3.0 or later)(a)Refer to the respective user manuals for proper installation. STMicroelectronics documentsareavailablefromtheinternetsiteatwwwst.comSTM32 motor control SDK v5.0 tools user manual (UM2380STM32 CubeMX for STM32 configuration and initialization c code generation usermanual (UM1718)STM32 ST-LINK utility software description user manual(UM0892)The AC6 tool framework is not supported in SDK v5.0 but in later versions6/24UM2374 Rey 1/UM2374Motor control ecosystem setup22Hardware setupThe connection of the STMicroelectronics application board to the pc requires a USBType-A connector. Refer to the description of the application board for details on the USBcableA dedicated description card is delivered with each STMicroelectronics application board forproper installation For more details, refer to the user manual of the board available atwww.st.comThe selected hardware can be one of the three setups· The complete MC KitOne of the complete inverter boardsAny STM32 evaluation board combined with one of the ST evaluation power stagesthat include the mc connectorUM2374 Rey 17/24Getting StartedUM23743Getting StartedWarning: Check that the board is correctly configured for the motorcontrol application and supplied with the expected inputvoltageNoteRefer to the user manual of the related hardware to setup the correct configuration, voltagerange, serial communication capabilities, and programming/debugging interface3.1Hardware connectionConnect a uSb cable between the pc and the stmicroelectronics application board andthe JTAG/SWD programming cable if it is different from the USB cable3.2Motor profilingLaunch the ST MC Workbench software tool either byclicking on its iconrunning it directly from the installation folder treeBoth ways of launching the ST MC Workbench are illustrated in Figure 1Figure 1. ST MC Workbench- Icon and installation folder treeI STMicroelectrorics感FOC SDKLv.3.0MotorControlv500WorkBenchST Motor Control Workbenchd ST Motor profileren the st motor profiler tool either byUsing its dedicated button in the St Mc Workbench GUl as illustrated in Figure 2Running it directly from the installation folder tree as illustrated in Figure 1Figure 2. ST MC Workbench-GUl expanded top viewFile Tools Help Documet ta ionNew ProjectLoad Project4 About HelpMotor ProfilRcGert ProJEcts己tdbrsDRpower board8/24UM2374 Rey 1/UM2374Getting StartedClick on the Select Boards button to display the list of supported boards as shown onFigure 3 and select the STMicroelectronics application board setup. Figure 4 on page 10presents examples from this listNoteThe ST Motor Profiler tool may be used only with ST hardware in the list of supportedsetups.Figure 3. ST Motor Profiler-GUI2 ST Motor Profile.l:e augmentedMotor ProfilersPole pairsPe row to detecbeed and Current /mitsMaκSpet1600FPMn7 Select Board∧pk02530pkMagnetic: SM-PMSN○-NSMMechanIcal mode lO CenElectrical modelOW000UM2374 Rey 19/24Getting StartedUM2374Figure 4. ST Motor Profiler-Hardware setup list examplesE ST Motor ProfiY Hideabsolete boarde arch Control board by narSe arch power boac bv nareControl boardower BoardxCancelHide boards with warningNUCLEO-F302R8X-NUCLEO-HMOTM1 3shNUCLEO-F302R8X-NUCLEO-HMOBM1 3shT2F302R8T6L6230PDSTM32F302R8T6STL22ON6FT●Acf8m:m3SELNRV2 Emiol connectorC Product Web PageG Product Web PageC Product Web PageC Product Web PageNUCLEO-F303RESTEVAL-IPMO5F 3ShNUCLEO.F303RESTEVAL-IPM108 3sh●Aiv命Ativ● Ac livSn Ngor ombreI connectorST-LINKV2C Product Web PageC Product Web PageC Product Web PageC Product Web PageClick on the sTmicroelectronics hardware setup to select it and configure the st motorProfiler toolAs an example, Figure 4 shows the selection of the P-NUCLEO-IHM001 motor controlNucleo pack with NucLEo-F302R8 and X-NUCLEO-IHMO7M1After hardware setup selection, fill in the parameter fields with the motor informationThe number of pole pairs of the motor(mandatory fieldThe Max Speed of the motor(optional field)by default, the st Motor Profiler tool searches for the maximum allowed speedmatching the motor and the hardware setup usedThe Max Current allowed by the motor(optional field)By default, it is the maximum peak current deliverable by the hardware setupThe nominal dC bus voltage used by the hardware setup(optional field)By default, it is the power supply stage as either the bus voltage for low voltageapplications(DC voltage), or the RMs value for high voltage application(Ac voltage)The magnetic built-in type(mandatory field)By default, the SM-PMSM is selectedThe Ld/Lq ratio(mandatory field only when l-PMSM built-in is selected as shown inFigure 6 on page 1110/24UM2374 Rey 1/
- 2020-11-29下载
- 积分:1
-
VSG虚拟同步发电机
simulink仿真文件,一个DC/AC的电路逆变器控制,使用虚拟同步发电机技术(VSG)控制方法,运行顺利,仿真结果波形良好。
- 2020-12-12下载
- 积分:1
-
四轴飞行器主控板设计原理图与PCB
【实例简介】四轴飞行器主控板设计原理图与PCB四轴飞行器不是儿童玩具。它太昂贵而且太危险,不适于用于玩具。不要在人的上空飞行!
- 2021-11-14 00:44:16下载
- 积分:1