EAGER TOKENIZATION OF PROGRAMS AND DISTRIBUTION OF TOKEN SEQUENCES TO CLIENT

Methods and systems are provided for increasing the speed at which source code is incrementally compiled by eagerly tokenizing the source code and retaining the sequence of tokens for later use of the compiler. The token sequence may be stored along with a snapshot of the execution state of the program. This snapshot represents the program logic as well as a specific state of the program. The snapshot can be sent to the client, which then recreates the state of the program. Fast startup time of programs on the client is achieved by incrementally compiling only the parts of the program that are executed. Rather than tokenizing the program each time a small portion of it is compiled, the sequence of tokens stored in the snapshot may be used.