1. A computer program product for removing tenant initialization check per tenant for compiled code, the computer program product comprising: one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising: program instructions to receive a request to create a tenant; program instructions to create the tenant; program instructions to mark a current thread of the tenant as not eligible to run just-in-time (JIT) code, wherein the marking indicates that when a method is invoked, a non-JIT version of the method is executed; program instructions to execute initialization of a first class from an optimization list, wherein the optimization list is a configurable list of classes to be initialized prior to running JIT code; program instructions to determine that class initialization has been executed for all classes on the optimization list; and program instructions, responsive to determining that there are no more classes on the optimization list, to adjust the marking to indicate that the current thread is eligible to run JIT code and that the tenant may run JIT code without an initialization check.