1. A method for performing video coding with ordered entropy slices, the method comprising: providing a plurality of entropy slices within a picture to one or more of a plurality of processing elements, wherein each entropy slice comprises a plurality of blocks; and starting each of the processing elements to perform a Context-based Adaptive Binary Arithmetic Coding (CABAC) processing of a coding procedure for a corresponding entropy slice; wherein CABAC states of a current entropy slice is initialized as CABAC states of a previous entropy slice after processing D B blocks of the previous entropy slice, wherein D B is a positive integer and is less than a number of blocks in a row of the entropy slice; the plurality of entropy slices is placed to be processed in a specified order into corresponding processing elements within the plurality of processing elements such that the processing comprises at least a CABAC form of entropy coding, and the previous entropy slice and the current entropy slice are processed by different processing elements within the plurality of processing elements in an order such that start times of processing the previous entropy slice and the current entropy slice are different but processing the previous entropy slice and the current entropy slice is still done in parallel; and CABAC processing comprises a plurality of processes and although CABAC start time processing for the previous entropy slice and the current entropy slice is different, a same one of the processes of CABAC processing is done in parallel at the same time during at least a portion of the processing time.