In order to satisfy the requirement of high speed and real-time processing for 1000-unit class adaptive optics (AO) system in telescope and free space laser communication system, a generic high speed and real-time processing platform on one board is proposed. Multi-core center processing unit (CPU) is arranged for wave-front real-time computing, combined with high speed frame-grabber, to achieve the purpose of high frame-frequency. Xenomai real-time operation system combined with Linux operation system is used to satisfy the requirement of low latency. A compact real-time controller is assembled in one computer. Computing power of 51 giga floatingpoint operations per second (GFLOPS) and communication band-width of 102 GB/s are achieved in a computer with 6-core, via vector instruction optimization and processing in parallel with multi-core CPU. The emulation result shows that processing frequency can be up to 2000 Hz for 1145-unit AO system with 949 sub-apertures, and the delay is below 240 μs. This processor is introduced to AO system for laser communication via adjusting the parameters, and Strehl ratio of 0.61 is achieved after correction. This indicates the scheme can satisfy the requirement of high speed and low latency for AO system with actuators below 1145 unit, with the merit of general purpose.