New vatalanib analogs: Design, synthesis, in silico study and biological evaluation for anticancer activity

•A new series of vatalanib analogs based on quinoxaline has been designed, synthesized, and biologically evaluated as anticancer candidates.•Cytotoxic activities were evaluated against HepG2 and HCT116 cell lines.•In vitro VEGFR-2 inhibitory activity, cell cycle and apoptosis rate were evaluated for the most promising candidate.•Molecular docking and in silico ADMET study studies were carried out for the synthesized compounds. In our attempts to improve pharmacokinetics and pharmacodynamics characters of vatalanib, four strategies of the drug design were applied to design and synthesis new quinoxaline based vatalanib analogs. Antiproliferative activities of the synthesized compounds were investigated against two tumor cell lines (HepG2 and HCT‐116) using vatalanib as a positive control. The new candidates showed promising anticancer activity against two tested cancer cell lines with IC50 values ranging from 6.04 ± 0.19 to 100.15 ± 3.26 µM, in particular compounds 11b and 11c which were more potent than vatalanib. The most potent was the 4-benzoylquinoxaline derivative 11b (IC50 = 6.04 ± 0.19 µM and 15.58 ± 0.58 µM) compared to vatalanib (IC50 of 25.27 ± 0.84 µM and 43.91 ± 1.64 µM) against HepG2 and HCT116, respectively. The selectivity indices of 11b were found to be approximately 14 and 5 towards HepG2 and HCT116, respectively. While vatalanib showed selectivity indices of about 5 and 3 towards HepG2 and HCT116, respectively. The most promising compound 11b was further investigated in HepG‐2 cells for its apoptotic effect, cell cycle arrest and in vitro VEGFR-2 inhibitory activity as the main mechanisms of cell death. It was found that 11b can induce apoptosis and arrest the cell cycle at the at G1 phase in addition to, compound 11b showed effective inhibition of VEGFR-2 with IC50 of 0.918 ± 0.033 µM compared to vatalanib (IC50 of 0.265 ± 0.009 µM). Deep computational studies were created for the designed compounds including molecular docking, physicochemical properties, profiling pharmacokinetics, ADMET studies, and toxicity predictions to evaluate the prospective drug candidates. The results of the docking study were consistent with biological testing, furthermore, in silico ADMET study revealed the superior pharmacokinetics characters of the new candidates over vatalanib. So, the current work suggests that the 4-benzoylquinoxaline-1-yl-acetamide derivatives, especially 11b, can serve as lead molecules for development of new effective anticancer drugs.