会议信息
Bench 2025: BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing
登录查看会议网址

截稿日期:
2025-09-15 Extended
通知日期:
2025-10-21
会议日期:
2025-12-03
会议地点:
Chengdu, China
届数:
17
浏览: 15796   关注: 2   参加: 1

征稿
The Bench conference encompasses a wide range of topics in benchmarks, datasets, metrics, indexes, measurement, evaluation, optimization, supporting methods and tools, and other best practices in computer science, medicine, finance, education, management, etc. Bench's multidisciplinary and interdisciplinary emphasis provides an ideal environment for developers and researchers from different areas and communities to discuss practical and theoretical work. The topics of interest include, but are not limited to the following:

Topics

Evaluation theory and methodology
Formal specification of evaluation requirements
Development of evaluation models
Design and implementation of evaluation systems
Analysis of evaluation risk
Cost modeling for evaluations
Accuracy modeling for evaluations
Evaluation traceability
Identification and establishment of evaluation conditions
Equivalent evaluation conditions
Design of experiments
Statistical analysis techniques for evaluations
Methodologies and techniques for eliminating confounding factors in evaluations
Analytical modeling techniques and validation of models
Simulation and emulation-based modeling techniques and validation of models
Development of methodologies, metrics, abstractions, and algorithms specifically tailored for evaluations

The engineering of evaluation
Benchmark design and implementation
Benchmark traceability
Establishing least equivalent evaluation conditions
Index design, implementation
Scale design, implementation
Evaluation standard design and implementations
Evaluation and benchmark practice
Tools for evaluations
Real-world evaluation systems
Testbed

Data set
Explicit or implicit problem definition deduced from the data set
Detailed descriptions of research or industry datasets, including the methods used to collect the data and technical analyses supporting the quality of the measurements
Analyses or meta-analyses of existing data
Systems, technologies, and techniques that advance data sharing and reuse to support reproducible research
Tools that generate large-scale data while preserving their original characteristics
Evaluating the rigor and quality of the experiments used to generate the data and the completeness of the data description

Benchmarking
Summary and review of state-of-the-art and state-of-the-practice
Searching and summarizing industry best practice
Evaluation and optimization of industry practice
Retrospective of industry practice
Characterizing and optimizing real-world applications and systems
Evaluations of state-of-the-art solutions in the real-world setting

Measurement and testing
Workload characterization
Instrumentation, sampling, tracing, and profiling of large-scale, real-world applications and systems
Collection and analysis of measurement and testing data that yield new insights
Measurement and testing-based modeling (e.g., workloads, scaling behavior, and assessment of performance bottlenecks)
Methods and tools to monitor and visualize measurement and testing data
Systems and algorithms that build on measurement and testing-based findings
Reappraisal of previous empirical measurements and measurement-based conclusions
Reappraisal of previous empirical testing and testing-based conclusions
最后更新 Dou Sun 在 2025-09-13
相关期刊
CCF全称影响因子出版商ISSN
IEEE Geoscience and Remote Sensing Magazine9.6IEEE2473-2397
IEEE Communications Magazine8.2IEEE0163-6804
Control Engineering Practice4.6Elsevier0967-0661
IEEE Internet Computing Magazine4.4IEEE1089-7801
Structural and Multidisciplinary Optimization4.0Springer1615-147X
Medical & Biological Engineering & Computing2.6Springer0140-0118
Engineering Optimization2.2Taylor & Francis0305-215X
Applied Mathematics & Optimization1.7Springer0095-4616
Numerical Functional Analysis and Optimization1.400Taylor & Francis0163-0563
Journal of Combinatorial Optimization0.900Springer1382-6905