代码之家  ›  专栏  ›  技术社区  ›  Md Farhad Mokter

若集群的数量不等于基本事实标签,我该如何评估集群性能?

  •  0
  • Md Farhad Mokter  · 技术社区  · 3 年前

    我一直在尝试学习无监督的机器学习模型。 我想知道预测聚类的数量是大于还是小于地面实况标签的数量,那么我们如何计算准确性。是否有任何具体的指标来解决这种差异?

    我试过用k均值和silhhoutte。我有一个有5个标签的医学图像,但算法返回4个标签。

    0 回复  |  直到 3 年前
        1
  •  0
  •   ASH    3 年前

    当集群的数量未知或不预先确定时,评估集群性能变得更具挑战性。在这种情况下,可以使用几种方法来评估集群性能:

    Internal Evaluation Metrics: Internal evaluation metrics assess the quality of the clustering based on the data itself, without relying on external information or the true number of clusters. Examples of internal evaluation metrics include the Silhouette coefficient, Davies-Bouldin index, Calinski-Harabasz index, and Dunn index. These metrics provide a measure of compactness, separation, or overall clustering quality.
    
    External Evaluation Metrics: External evaluation metrics compare the clustering results with some external reference, such as known class labels if available. However, these metrics are not suitable when the number of clusters is not equal to the number of classes. If you have class labels, you could consider transforming the clustering results into a classification problem by assigning cluster labels to the data points and then use traditional classification evaluation metrics such as accuracy, precision, recall, or F1 score.
    
    Stability-based Methods: Stability-based methods evaluate clustering stability by assessing the consistency of clustering results across multiple iterations or subsets of the data. Techniques like stability index, bootstrapping, or consensus clustering can provide insights into the robustness of the clustering algorithm and help determine the optimal number of clusters.
    
    Visual Inspection: Visual inspection can be a useful approach to evaluate clustering results. Plotting the data points in a low-dimensional space using dimensionality reduction techniques (e.g., t-SNE, PCA) and coloring the points according to the clustering results can provide an intuitive visualization of the clusters. However, this method is subjective and might not provide a quantitative measure of performance.
    

    值得注意的是,聚类评估是一个具有挑战性的问题,尤其是当聚类数量未知或与基本事实不同时。不同的评估方法有其优势和局限性,因此建议使用多种方法的组合,并考虑数据集和聚类任务的具体特征和目标。