To meet the need of human-machine interaction of the portable equipment, an embedded finger-interaction system was designed,and the algorithms applied to the system,such as skin color segmentation, convex hull computation,and fingertip detection, were investigated and the hardware was also implemented. Firstly, according to the clustering characters of skin color, a human hand was segmented via building the skin color model by analyzing the characters of common color spaces. Then, the classic Graham-scan method was improved based on the radial-scan method , and the convex hull of the human hand was computed quickly. Furthermore, the algorithm of fingertip detection which uses the curve of human finger was discussed. Finally, the hardware structure based on the Digital Signal Processing(DSP) and Field Programming Gate Array(FPGA) was introduced. Experimental results indicate that the detecting precision is 95.2% for a natural stretched finger, 92.6% for the bended finger and 90.1% for other fingers under the disturbance,respectively. Moreover,the maximum offset of fingertip location is 2.12 mm and the location time is 23 ms. The system is natural and friendly, and has strong stabilization and real-time characteristcs.