Scalable transaction processing pipeline

A system for processing a plurality of tasks is disclosed. Each task has a plurality of component subtasks. The system may process N tasks and each task includes a first subtask, and a second subtask. The system for processing the plurality of tasks comprises a scalable transaction processing pipeline (STPP). The STPP comprises a plurality of processing elements, including at least a first processing element and a second processing element, the first processing element is adapted to process the first subtask of each task. The second processing element is adapted to process the second subtask of each task. Each successive processing element is adapted to process a corresponding subtask or subtasks of each task. The first processing element processes the first subtask of each task. When the first processing element finishes the processing of the first subtask, the second processing element processes the second subtask of each task. The STPP further includes a plurality of data structures and a plurality of data managers. Each data manager is adapted to manage a data structure. An interconnect couples each processing element to at least one data manager. The interconnect manages the data flow between the interconnect and the processing elements, and between the interconnect and the data managers.