Optical encryption inherently provides strong security advantages, with hybrid optoelectronic systems offering additional degrees of freedom by integrating optical and algorithmic domains. However, existing optical encryption schemes heavily rely on electronic computation, limiting overall efficiency, while the physical keys are susceptible to damage, compromising both security and system stability. To overcome these challenges, we introduce the Quasi Periodic Optical Key (QPOK), which combines long range order with short range disorder, enabling enhanced security and robustness against damage within a single platform. By leveraging diffraction symmetry, our design enables optics-driven encryption, effectively shifting the optoelectronic balance toward photonic processing. Moreover, we innovatively apply deep learning to reconstruct the complex optical ciphertext field using only amplitude data and cryptographic keys, simultaneously achieving data compression and improved security. Within this framework, the key space includes continuously tunable parameters such as wavelength, propagation distance, phase modulation, and Q-POK geometry, significantly expanding cryptographic diversity. Our system also demonstrates robust cryptographic reliability by reducing inter-class distances by over 50% and tolerating up to 20% ciphertext loss. Our framework represents a new generation of physically grounded, algorithmically enhanced optical cryptosystems, laying a foundational pathway for scalable, hardware-integrated information security paradigms.