Rate distortion optimization (RDO) plays an important role in a JPEG2000 encoder. An improved RDO algorithm is presented in this paper. The proposed algorithm is suitable for integrated circuit implementation and can reduce the computational cost. A hardware architecture which includes control unit, memory, divider, and data converter is also given to implement the algorithm. The circuit, based on the improved algorithm, has been integrated in a JPG2000 chip codec core.