SYSTEM AND METHOD FOR GENERATING DIFFERENTIAL DIAGNOSIS IN A HEALTHCARE ENVIRONMENT

A system for generating a differential diagnosis in a healthcare environment is presented. The system includes a receiver configured to receive one or more user inputs and generate a plurality of input streams. The system further includes a processor including a multi-stream neural network, a training module, and a differential diagnosis generator. The multi-stream neural network includes a plurality of feature extractor sub-networks and a combiner sub-network. The training module includes a feature optimizer configured to train each feature-extractor sub-network individually, and a combiner optimizer configured to train the plurality of feature extractor sub-networks and the combiner sub-network together. The training module is configured to alternate between the feature optimizer and the combiner optimizer until a training loss reaches a defined saturation value. The differential diagnosis generator is configured to generate the differential diagnosis based on a combined feature set generated by the trained multi-stream network.