Background: Primary liver cancer, predominantly hepatocellular carcinoma (HCC), is a significant global health issue, ranking as the sixth most diagnosed cancer and the third leading cause of cancer-related mortality. Accurate and early diagnosis of HCC is crucial for effective treatment, as HCC and non-HCC malignancies like intrahepatic cholangiocarcinoma (ICC) exhibit different prognoses and treatment responses. Traditional diagnostic methods, including liver biopsy and contrast-enhanced ultrasound (CEUS), face limitations in applicability and objectivity. Objective: The primary objective of this study was to develop an advanced, light-weighted classification network capable of distinguishing HCC from other non-HCC malignancies by leveraging the automatic analysis of brightness changes in CEUS images. The ultimate goal was to create a user-friendly and cost-efficient computer-aided diagnostic tool that could assist radiologists in making more accurate and efficient clinical decisions. Methods: This retrospective study encompassed a total of 161 patients, comprising 131 diagnosed with HCC and 30 with non-HCC malignancies. To achieve accurate tumor detection, the YOLOX network was employed to identify the region of interest (ROI) on both B-mode ultrasound and CEUS images. A custom-developed algorithm was then utilized to extract brightness change curves from the tumor and adjacent liver parenchyma regions within the CEUS images. These curves provided critical data for the subsequent analysis and classification process. To analyze the extracted brightness change curves and classify the malignancies, we developed and compared several models. These included one-dimensional convolutional neural networks (1D-ResNet, 1D-ConvNeXt, and 1D-CNN), as well as traditional machine-learning methods such as support vector machine (SVM), ensemble learning (EL), K-nearest neighbor (KNN), and decision tree (DT). The diagnostic performance of each method in distinguishing HCC from non-HCC malignancies was rigorously evaluated using four key metrics: Area under the receiver operating characteristic (AUC), accuracy (ACC), sensitivity (SE), and specificity (SP). Results: The evaluation of the machine-learning methods revealed AUC values of 0.70 for SVM, 0.56 for ensemble learning, 0.63 for KNN, and 0.72 for the decision tree. These results indicated moderate to fair performance in classifying the malignancies based on the brightness change curves. In contrast, the deep learning models demonstrated significantly higher AUCs, with 1D-ResNet achieving an AUC of 0.72, 1D-ConvNeXt reaching 0.82, and 1D-CNN obtaining the highest AUC of 0.84. Moreover, under the five-fold cross-validation scheme, the 1D-CNN model outperformed other models in both accuracy and specificity. Specifically, it achieved accuracy improvements of 3.8% to 10.0% and specificity enhancements of 6.6% to 43.3% over competing approaches. The superior performance of the 1D-CNN model highlighted its potential as a powerful tool for accurate classification. Conclusion: The 1D-CNN model proved to be the most effective in differentiating HCC from non-HCC malignancies, surpassing both traditional machine-learning methods and other deep learning models. This study successfully developed a user-friendly and cost-efficient computer-aided diagnostic solution that would significantly enhances radiologists' diagnostic capabilities. By improving the accuracy and efficiency of clinical decision-making, this tool has the potential to positively impact patient care and outcomes. Future work may focus on further refining the model and exploring its integration with multimodal ultrasound data to maximize its accuracy and applicability.