贝叶斯优化
第七部分：人在回路
EN

人在回路

偏好优化既依靠人来完成，也作用于人本身。本部分汇集这些方法用于真实用户的情况：在交互式设计工具中，研究不仅测量人是否得到了好的设计，还测量人是否认为设计属于自己；在外骨骼、假肢、助听器和神经植入物中，风险直接关乎身体；在建筑、车辆、实验室和工业中，工具已经就绪，实际使用过的人却很少。

本书的核心论点正是以这些研究为证据。算法已经足够好用，制约它们的是测量（第 45.1 节）。真实回路中的反馈并不稳定；人的回答方式不同于调校方法时所用的模拟用户；优化器的提问方式还会改变人对任务的体验，因此一次会话既是估计，也是干预。对照严格的研究更常得到的是“以更少的迭代或更低的成本得到相同的结果”，而不是“更好的结果”；一些简单的替代办法，包括让人自行调节装置，有时效果也不相上下。各章报告每项研究时都给出其设计与具体数字，供读者判断每项发现能推广到什么程度。

本部分以第 19 章为前提，可以先于研究前沿各章阅读。

本部分各章

  1. 32 交互式设计与人机交互

    2017 至 2026 年间让真人进入回路的交互式设计研究及其发现：六条研究线索，能动感与性能之间一贯存在的权衡，真实会话中反馈的不稳定，关于反馈形式、群体先验、专业水平和解释的证据，以及与强基线比较的结果。

  2. 33 可穿戴机器人、健康与辅助技术

    依据人的偏好调节外骨骼、假肢、助听器、神经植入物与机器人控制器：哪些人参与了研究，测量了什么，结果如何验证，以及算法调节与人自行调节装置相比效果如何。

  3. 34 建成环境、科学与工业

    建筑、车辆、专家引导的科学研究与工业：这些领域已有偏好优化的工具和方法，真人参与却很少；本章还比较各应用领域的证据，并核查关于这些应用的常见说法能否成立。

第七部分参考文献

本部分各章共引用 176 篇文献。

  1. Abdelrahman, M., and Miller, C. (2022). Targeting occupant feedback using digital twins: Adaptive spatial-temporal thermal preference sampling to optimize personal comfort models. Building and Environment. doi:10.1016/j.buildenv.2022.109090. 第 34 章
  2. Adachi, M., Planden, B., Howey, D. A., Osborne, M. A., Orbell, S., Ares, N., Muandet, K., and Chau, S. L. (2024). Looping in the Human Collaborative and Explainable Bayesian Optimization. International Conference on Artificial Intelligence and Statistics. 第 32 章 第 34 章
  3. Adachi, M., Chau, S. L., Xu, W., Singh, A., Osborne, M. A., and Muandet, K. (2025). Bayesian Optimization for Building Social-Influence-Free Consensus. arXiv. 预印本 第 34 章
  4. Alili, A., Nalam, V., Li, M., Liu, M., Feng, J., Si, J., and Huang, H. (2023). A Novel Framework to Facilitate User Preferred Tuning for a Robotic Knee Prosthesis. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 第 33 章
  5. Amsterdam UMC (2008). Personalization of Hearing Aids through Bayesian Preference Elicitation. Trial registry, onderzoekmetmensen.nl. 非同行评审 第 33 章
  6. Arens, P., Quirk, D. A., Pan, W., Yacoby, Y., Doshi-Velez, F., and Walsh, C. J. (2025). Preference-based assistance optimization for lifting and lowering with a soft back exosuit. Science Advances. doi:10.1126/sciadv.adu2099. 第 33 章 第 34 章
  7. Arun Kumar A V, Shilton, A., Gupta, S., Rana, S., Greenhill, S., and Venkatesh, S. (2024). Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties. ECML PKDD 2024. 第 34 章
  8. Astudillo, R., Lin, Z. J., Bakshy, E., and Frazier, P. (2023). qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimization. International Conference on Artificial Intelligence and Statistics. 第 34 章
  9. Astudillo, R., Li, K., Tucker, M., Cheng, C. X., Ames, A. D., and Yue, Y. (2025). Preferential Multi-Objective Bayesian Optimization. Transactions on Machine Learning Research. 第 33 章 第 34 章
  10. Avelino, R. M., Sevastjanova, R., Van Mele, T., Block, P., and El-Assady, M. (2026). Creativity from Friction: Human-AI Interaction for Exploratory Structural Design. ICML 2026 Workshop on Human-AI Co-Creativity. 研讨会论文 第 32 章
  11. Awalgaonkar, N., Bilionis, I., Liu, X., Karava, P., and Tzempelikos, A. (2019). Learning Personalized Thermal Preferences via Bayesian Active Learning with Unimodality Constraints. arXiv. 预印本 第 34 章
  12. Baek, S., Park, S., and Kim, D. (2026). Context-Continuous Preference Learning for Exoskeleton Personalization. arXiv. 预印本 第 33 章
  13. Balling, L. W., Mølgaard, L. L., Townend, O., and Nielsen, J. B. B. (2021). The Collaboration between Hearing Aid Users and Artificial Intelligence to Optimize Sound. Seminars in Hearing. doi:10.1055/s-0041-1735135. 第 33 章
  14. Baltzell, L. S., Xia, J., and Kalluri, S. (2018). Efficient characterization of individual differences in compression ratio preference. The Journal of the Acoustical Society of America. doi:10.1121/1.5067390. 第 32 章 第 33 章
  15. Basu, C., Yang, Q., Hungerman, D., Singhal, M., and Dragan, A. D. (2017). Do You Want Your Autonomous Car To Drive Like You? Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. doi:10.1145/2909824.3020250. 第 34 章
  16. Bemporad, A., and Piga, D. (2021). Global optimization based on active preference learning with radial basis functions. Machine Learning. 第 33 章
  17. Benavoli, A., Azzimonti, D., and Piga, D. (2021b). Choice functions based multi-objective Bayesian optimisation. arXiv. 预印本 第 34 章
  18. Biswas, A., Liu, Y., Creange, N., Liu, Y.-C., Jesse, S., Yang, J.-C., … Vasudevan, R. K. (2024). A dynamic Bayesian optimized active recommender system for curiosity-driven partially Human-in-the-loop automated experiments. npj Computational Materials. 第 34 章
  19. Biswas, A., Funakubo, H., and Liu, Y. (2026). Human-AI Collaborative Autonomous Experimentation With Proxy Modeling for Comparative Observation. arXiv. 预印本 第 34 章
  20. Bıyık, E., and Sadigh, D. (2018). Batch Active Preference-Based Learning of Reward Functions. Conference on Robot Learning. 第 33 章
  21. Bıyık, E., Palan, M., Landolfi, N. C., Losey, D. P., and Sadigh, D. (2019). Asking Easy Questions: A User-Friendly Approach to Active Reward Learning. Conference on Robot Learning. 第 33 章
  22. Bıyık, E., Huynh, N., Kochenderfer, M. J., and Sadigh, D. (2020). Active Preference-Based Gaussian Process Regression for Reward Learning. Robotics: Science and Systems. doi:10.15607/RSS.2020.XVI.041. 第 33 章
  23. Bıyık, E., Talati, A., and Sadigh, D. (2021). APReL: A Library for Active Preference-based Reward Learning Algorithms. arXiv. 软件 第 33 章
  24. Bıyık, E., Losey, D. P., Palan, M., Landolfi, N. C., Shevchuk, G., and Sadigh, D. (2022). Learning Reward Functions from Diverse Sources of Human Feedback: Optimally Integrating Demonstrations and Preferences. The International Journal of Robotics Research. doi:10.1177/02783649211041652. 第 33 章
  25. Brochu, E., de Freitas, N., and Ghosh, A. (2007). Active Preference Learning with Discrete Choice Data. Advances in Neural Information Processing Systems. 第 32 章
  26. Broukhim, A., Shen, Y., Ammanabrolu, P., and Weibel, N. (2025). Preference-Based Learning in Audio Applications: A Systematic Analysis. arXiv. 预印本 第 33 章
  27. Catkin, B., and Patoglu, V. (2023). Preference-Based Human-in-the-Loop Optimization for Perceived Realism of Haptic Rendering. IEEE Transactions on Haptics. doi:10.1109/toh.2023.3266726. 第 32 章
  28. Cella, C., Ristic, M., Faroni, M., Zanchettin, A. M., and Rocco, P. (2026). Adaptive Human-Robot Collaborative Painting Combining Preference-Based Optimization and Dynamic Motion Primitives. IEEE Robotics and Automation Letters. doi:10.1109/LRA.2026.3683596. 第 33 章
  29. Cercola, M., Lomuscio, M., Piga, D., and Formentin, S. (2026b). Regularized GLISp for sensor-guided human-in-the-loop optimization. IFAC Journal of Systems and Control. doi:10.1016/j.ifacsc.2026.100368. 第 34 章
  30. Chakraborty, T., Wirth, C., and Seifert, C. (2025a). Comparative Explanations: Explanation Guided Decision Making for Human-in-the-Loop Preference Selection. Explainable Artificial Intelligence. doi:10.1007/978-3-032-08317-3_7. 第 32 章
  31. Chakraborty, T., Koelle, M., Schlötterer, J., Schlicker, N., Wirth, C., and Seifert, C. (2025b). Explanation format does not matter; but explanations do – An Eggsbert study on explaining Bayesian Optimisation tasks. Information Systems Frontiers. doi:10.1007/s10796-025-10671-6. 第 32 章
  32. Chan, L., Liao, Y.-C., Mo, G. B., Dudley, J. J., Cheng, C.-L., Kristensson, P. O., and Oulasvirta, A. (2022). Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction Techniques. CHI Conference on Human Factors in Computing Systems. doi:10.1145/3491102.3501850. 第 32 章
  33. Chiu, C.-H., Koyama, Y., Lai, Y.-C., Igarashi, T., and Yue, Y. (2020). Human-in-the-loop differential subspace search in high-dimensional latent space. ACM Transactions on Graphics. doi:10.1145/3386569.3392409. 第 32 章
  34. Choi, D., Son, K., Yu, J., Jung, H., and Kim, J. (2026). IdeaBlocks: Expressing and Reusing Divergent Intents for Graphic Design Exploration using Generative AI. Proceedings of the 2026 Designing Interactive Systems Conference. doi:10.1145/3800645.3813005. 第 32 章
  35. Chong, T. L. H., Shen, I.-C., Sato, I., and Igarashi, T. (2021). Interactive Optimization of Generative Image Modelling using Sequential Subspace Search and Content-based Guidance. Computer Graphics Forum. doi:10.1111/cgf.14188. 第 32 章
  36. Choung, O.-H., Vianello, R., Segler, M., Stiefl, N., and Jiménez-Luna, J. (2023). Extracting medicinal chemistry intuition via preference machine learning. Nature Communications. doi:10.1038/s41467-023-42242-1. 第 34 章
  37. Colella, F., Daee, P., Jokinen, J., Oulasvirta, A., and Kaski, S. (2020). Human Strategic Steering Improves Performance of Interactive Optimization. Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization. doi:10.1145/3340631.3394883. 第 32 章
  38. Colley, M., Jansen, P., Keskar, M., and Rukzio, E. (2025). Improving External Communication of Automated Vehicles Using Bayesian Optimization. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3706598.3714187. 第 32 章
  39. Colley, M., Jansen, P., Krauss, S., and Rukzio, E. (2026). Multi-Session User Experience Assessments of Computationally Optimized Automated Vehicle Functionality Visualizations. Proceedings of the 18th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. doi:10.1145/3828157.3828785. 第 32 章
  40. Cosner, R., Tucker, M., Taylor, A., Li, K., Molnár, T., Ubelacker, W., … Ames, A. (2022). Safety-Aware Preference-Based Learning for Safety-Critical Control. Learning for Dynamics and Control Conference. 第 33 章
  41. Coutinho, J. P., Castillo, I., and Reis, M. S. (2024). Human-in-the-loop controller tuning using Preferential Bayesian Optimization. IFAC-PapersOnLine. doi:10.1016/j.ifacol.2024.08.306. 第 33 章
  42. Coutinho, J. P., Peng, Y., Rendall, R., Ma, K., Chin, S.-T., Castillo, I., and Reis, M. S. (2026). Efficient human-in-the-loop MPC tuning with multi-task preferential Bayesian optimization. Control Engineering Practice. 第 33 章
  43. Csomay-Shanklin, N., Tucker, M., Dai, M., Reher, J., and Ames, A. D. (2022). Learning Controller Gains on Bipedal Walking Robots via User Preferences. 2022 International Conference on Robotics and Automation (ICRA). doi:10.1109/icra46639.2022.9811541. 第 33 章
  44. Dang, T., Pham, L.-H., Truong, S. T., Glenn, A., Nguyen, W., Pham, E. A., … Luong, T. (2025). Preferential Multi-Objective Bayesian Optimization for Drug Discovery. ICLR 2025 Workshop. 研讨会论文 第 34 章
  45. de Vries, W., van Kampen, J., and Salazar, M. (2024). A Human-optimized Model Predictive Control Scheme and Extremum Seeking Parameter Estimator for Slip Control of Electric Race Cars. arXiv. 预印本 第 34 章
  46. De Witte, S., Taets, J., Retzler, A., Crevecoeur, G., and Lefebvre, T. (2025). How to Capture Human Preference: Commissioning of a Robotic Use-Case via Preferential Bayesian Optimisation. arXiv. 预印本 第 33 章
  47. Deneault, J. R., Kim, W., Kim, J., Gu, Y., Chang, J., Maruyama, B., Myung, J. I., and Pitt, M. A. (2025). Preferential Bayesian optimization improves the efficiency of printing objects with subjective qualities. Digital Discovery. 第 34 章
  48. Díaz, M. A., Nuzzo, S., Flynn, L., Beckerle, P., Verstraten, T., and De Pauw, K. (2026). User preference in the personalized control of an ankle prosthesis: a case study. Journal of NeuroEngineering and Rehabilitation. doi:10.1186/s12984-026-01931-w. 第 33 章
  49. Ding, Y., Kim, M., Kuindersma, S., and Walsh, C. J. (2018). Human-in-the-Loop Optimization of Hip Assistance with a Soft Exosuit during Walking. Science Robotics. 第 33 章
  50. Dudley, J. J., Jacques, J. T., and Kristensson, P. O. (2019). Crowdsourcing Interface Feature Design with Bayesian Optimization. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3290605.3300482. 第 32 章
  51. Dudley, J., Oulasvirta, A., Chan, L., and Kristensson, P. O. (2026). Putting the Human Back in the Loop: A Review of Interactive Bayesian Optimization. ACM Computing Surveys. 第 32 章
  52. Farooqi, H., Zhao, Z., Darrow, D., Lamperski, A., and Netoff, T. I. (2025). An augmented preference-based Bayesian approach for optimizing neuromodulation stimulation parameters using meta learning. Journal of Neural Engineering. 第 33 章
  53. Fauvel, T., and Chalk, M. (2022). Human-in-the-loop optimization of visual prosthetic stimulation. Journal of Neural Engineering. 第 33 章
  54. Feith, N., and Rueckert, E. (2024). Integrating Human Expertise in Continuous Spaces: A Novel Interactive Bayesian Optimization Framework with Preference Expected Improvement. 2024 21st International Conference on Ubiquitous Robots (UR). doi:10.1109/ur61395.2024.10597501. 第 33 章
  55. Fernandes Junior, F. E., Langerak, T., Keränen, M., Shi, D., Alipova, A., and Oulasvirta, A. (2026). Integrating Multi-Source Feedback in Computational Design. ACM Transactions on Interactive Intelligent Systems. doi:10.1145/3848025. 第 32 章
  56. Fortuna, A., Lorenzini, M., Leonori, M., Gandarias, J., Balatti, P., Cho, Y., De Momi, E., and Ajoudani, A. (2024). A Personalizable Controller for the Walking Assistive omNi-Directional Exo-Robot (WANDER). 2024 IEEE International Conference on Robotics and Automation (ICRA). doi:10.1109/icra57147.2024.10611368. 第 33 章
  57. Gilbert, M. L., Deroche, M. L. D., Jiradejvong, P., Chan Barrett, K., and Limb, C. J. (2022). Cochlear Implant Compression Optimization for Musical Sound Quality in MED-EL Users. Ear & Hearing. 第 33 章
  58. Gmeiner, F., Yang, H., Yao, L., Holstein, K., and Martelaro, N. (2023). Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3544548.3580999. 第 32 章
  59. González, J., Dai, Z., Damianou, A., and Lawrence, N. D. (2017). Preferential Bayesian Optimization. International Conference on Machine Learning. 第 32 章
  60. Granley, J., Fauvel, T., Chalk, M., and Beyeler, M. (2023). Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses. Advances in Neural Information Processing Systems. 第 33 章
  61. Haltia, A., Hyvönen, V., and Kaski, S. (2026). Elicitation-Augmented Bayesian Optimization. arXiv. 预印本 第 34 章
  62. Hawkins-Hooker, A., Duckworth, P., and Bent, O. (2023). Preferential Bayesian Optimisation for Protein Design with Ranking-Based Fitness Predictors. NeurIPS 2023 MLSB Workshop. 研讨会论文 第 34 章
  63. Hiranaka, A., Hwang, M., Lee, S., Wang, C., Fei-Fei, L., Wu, J., and Zhang, R. (2023). Primitive Skill-based Robot Learning from Human Evaluative Feedback. 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). doi:10.1109/iros55552.2023.10341912. 第 34 章
  64. Huber, F., Rojas Gonzalez, S., and Astudillo, R. (2025). Bayesian Preference Elicitation for Decision Support in Multi‐Objective Optimization. Journal of Multi-Criteria Decision Analysis. 第 34 章
  65. Ignatenko, T., Kondrashov, K., Cox, M., and de Vries, B. (2025). On preference learning based on sequential Bayesian optimization with pairwise comparison. Artificial Intelligence. 第 33 章
  66. Ingraham, K. A., Remy, C. D., and Rouse, E. J. (2022). The role of user preference in the customized control of robotic exoskeletons. Science Robotics. 第 33 章 第 34 章
  67. Ingraham, K. A., Tucker, M., Ames, A. D., Rouse, E. J., and Shepherd, M. K. (2023). Leveraging user preference in the design and evaluation of lower-limb exoskeletons and prostheses. Current Opinion in Biomedical Engineering. 第 33 章
  68. Iwai, K., Kumagae, Y., Koyama, Y., Hamasaki, M., and Goto, M. (2025). Constrained Preferential Bayesian Optimization and Its Application in Banner Ad Design. Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. 第 32 章
  69. Jansen, P. (2025). Human-in-the-Loop Optimization for Inclusive Design: Balancing Automation and Designer Expertise. CHI 2025 Workshop Access InContext. 研讨会论文 第 32 章
  70. Jansen, P., Colley, M., Krauß, S., Hirschle, D., and Rukzio, E. (2025). OptiCarVis: Improving Automated Vehicle Functionality Visualizations Using Bayesian Optimization to Enhance User Experience. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3706598.3713514. 第 32 章
  71. Janwani, N., Lerner, M. T., Young, A. J., and Tucker, M. (2026). Multi-Objective Human-in-the-Loop Bayesian Optimization of a Lower-Limb Exoskeleton. arXiv. 预印本 第 33 章
  72. Kadner, F., Keller, Y., and Rothkopf, C. A. (2021). AdaptiFont: Increasing Individuals' Reading Speed with a Generative Font Model and Bayesian Optimization. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3411764.3445140. 第 32 章
  73. Kanarik, K. J., Osowiecki, W. T., Lu, Y., Talukder, D., Roschewsky, N., Park, S. N., … Gottscho, R. A. (2023). Human–machine collaboration for improving semiconductor process development. Nature. 第 34 章
  74. Kim, G., and Sergi, F. (2025). Validation of Dynamic Bayesian Optimization for a Non-Stationary Human-in-the-Loop Optimization Problem. bioRxiv. 预印本 第 33 章
  75. Kim, E., Min, B., Xia, H., and Kim, J. (2026). Elicitive User Interfaces: Designing How Users Shape Generative Interfaces. arXiv. 预印本 第 32 章
  76. Kobalczyk, K., Lin, Z. J., Letham, B., Zhao, Z., Balandat, M., and Bakshy, E. (2026). LILO: Bayesian Optimization with Natural Language Feedback. International Conference on Machine Learning. 第 34 章
  77. Koch, J., Lucero, A., Hegemann, L., and Oulasvirta, A. (2019). May AI? Design Ideation with Cooperative Contextual Bandits. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3290605.3300863. 第 32 章
  78. Koyama, Y., and Goto, M. (2022). BO as Assistant: Using Bayesian Optimization for Asynchronously Generating Design Suggestions. Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. doi:10.1145/3526113.3545664. 第 32 章
  79. Koyama, Y., and Igarashi, T. (2018). Computational Design with Crowds. Computational Interaction. 第 32 章
  80. Koyama, Y., Sato, I., Sakamoto, D., and Igarashi, T. (2017). Sequential line search for efficient visual design optimization by crowds. ACM Transactions on Graphics. 第 32 章
  81. Koyama, Y., Sato, I., and Goto, M. (2020). Sequential Gallery for Interactive Visual Design Optimization. ACM Transactions on Graphics. doi:10.1145/3386569.3392444. 第 32 章
  82. Kristiadi, A., Strieth-Kalthoff, F., Subramanian, S. G., Fortuin, V., Poupart, P., and Pleiss, G. (2024b). How Useful is Intermittent, Asynchronous Expert Feedback for Bayesian Optimization? AABI 2024. 研讨会论文 第 34 章
  83. Kuroki, S., Nakagawa, M., Yoshida, S., Koyama, Y., and Tadashi, K. (2026). LAPPI: Interactive Optimization with LLM-Assisted Preference-Based Problem Instantiation. IEEE Access. doi:10.1109/access.2026.3679052. 第 32 章
  84. Kwon, Y., Tsurumine, Y., Shimmura, T., Kawamura, S., and Matsubara, T. (2022). Physically Consistent Preferential Bayesian Optimization for Food Arrangement. IEEE Robotics and Automation Letters. doi:10.1109/lra.2022.3207560. 第 33 章
  85. Langerak, T., Zhang, R., Wang, Z., Kristensson, P. O., and Oulasvirta, A. (2026). Cost-Aware Bayesian Optimization for Prototyping Interactive Devices. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3772318.3791024. 第 32 章
  86. Leahy, K., Daly, S. R., McKilligan, S., and Seifert, C. M. (2020). Design Fixation From Initial Examples: Provided Versus Self-Generated Ideas. Journal of Mechanical Design. 第 32 章
  87. Lee, U. H., Shetty, V. S., Franks, P. W., Tan, J., Evangelopoulos, G., Ha, S., and Rouse, E. J. (2023). User preference optimization for control of ankle exoskeletons using sample efficient active learning. Science Robotics. 第 33 章
  88. Lee, S. W., Choi, J., and Hyun, K. H. (2026). Part-level 3D shape generation driven by user intention inference with preferential Bayesian optimization. Scientific Reports. doi:10.1038/s41598-026-38916-7. 第 32 章
  89. Li, K., Tucker, M., Bıyık, E., Novoseller, E., Burdick, J. W., Sui, Y., … Ames, A. D. (2021). ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton Gait Preference Landscapes. 2021 IEEE International Conference on Robotics and Automation (ICRA). doi:10.1109/icra48506.2021.9560840. 第 33 章 第 34 章
  90. Li, Z., Liao, Y.-C., and Holz, C. (2025a). Efficient Visual Appearance Optimization by Learning from Prior Preferences. Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology. doi:10.1145/3746059.3747622. 第 32 章
  91. Li, Z., Gebhardt, C., Liao, Y.-C., and Holz, C. (2026a). Automating UI Optimization through Multi-Agentic Reasoning. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI 2026). doi:10.1145/3772318.3791444. 第 32 章
  92. Li, Y., Colley, M., Gui, X., Rendon Cardona, C. C., Jansen, P., Sandor, C., and Igarashi, T. (2026b). BlurDriving: Investigating How Personalized Blur Techniques Impact Drivers' Performance in Virtual Reality. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. doi:10.1145/3831646. 第 32 章
  93. Li, Z., Liao, Y.-C., and Holz, C. (2026f). Preference-Guided Prompt Optimization for Text-to-Image Generation. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3772318.3791443. 第 32 章
  94. Liao, Y.-C., Dudley, J. J., Mo, G. B., Cheng, C.-L., Chan, L., Oulasvirta, A., and Kristensson, P. O. (2023). Interaction Design With Multi-Objective Bayesian Optimization. IEEE Pervasive Computing. doi:10.1109/mprv.2022.3230597. 第 32 章
  95. Liao, Y.-C., Desai, R., Pierce, A. M., Taylor, K. E., Benko, H., Jonker, T. R., and Gupta, A. (2024a). A Meta-Bayesian Approach for Rapid Online Parametric Optimization for Wrist-based Interactions. Proceedings of the CHI Conference on Human Factors in Computing Systems. doi:10.1145/3613904.3642071. 第 32 章
  96. Liao, Y.-C., Mo, G. B., Dudley, J. J., Cheng, C.-L., Chan, L., Kristensson, P. O., and Oulasvirta, A. (2024b). Practical approaches to group-level multi-objective Bayesian optimization in interaction technique design. Collective Intelligence. doi:10.1177/26339137241241313. 第 32 章
  97. Liao, Y.-C., Streli, P., Li, Z., Gebhardt, C., and Holz, C. (2025). Continual Human-in-the-Loop Optimization. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3706598.3713603. 第 32 章
  98. Liao, Y.-C., Belo, J., Moon, H.-S., Steimle, J., and Feit, A. M. (2026). Efficient Human-in-the-Loop Optimization via Priors Learned from User Models. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3772318.3791976. 第 32 章
  99. Lin, Z. J., Astudillo, R., Frazier, P., and Bakshy, E. (2022). Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes. International Conference on Artificial Intelligence and Statistics. 第 34 章
  100. Liu, Y., and Kalinin, S. V. (2025). Pareto-Optimal Experimentation: Human-Guided Multi-Objective Bayesian Optimization in Scanning Probe Microscopy. Nano Letters. 第 34 章
  101. Liu, C., Ling, S., and Jacobson, A. (2026b). GimmBO: Interactive Generative Image Model Merging via Bayesian Optimization. ACM Transactions on Graphics. doi:10.1145/3811293. 第 32 章
  102. Liu, X.-Y., Li, G., Wang, W., and Hou, Z.-G. (2026d). Personalized Lower-limb Exoskeleton Assistance via Preference-based Bayesian Optimization. arXiv. 预印本 第 33 章
  103. Maberry, A., and Martin, A. E. (2026). Just Noticeable Difference of Impedance Parameters While Walking in an Ankle Exoskeleton. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 第 33 章
  104. Marcos, M., Mur-Labadia, L., and Martinez-Cantin, R. (2025). Random rotational embedding Bayesian optimization for human-in-the-loop personalized music generation. PLOS One. doi:10.1371/journal.pone.0335853. 第 32 章
  105. McCourt, M., and Dewancker, I. (2019). Sampling Humans for Optimizing Preferences in Coloring Artwork. ICML 2019 Workshop on Human in the Loop Learning. 研讨会论文 第 32 章
  106. Meinhardt, L.-M., Schramm, C., Jansen, P., Colley, M., and Rukzio, E. (2025). Fly Away: Evaluating the Impact of Motion Fidelity on Optimized User Interface Design via Bayesian Optimization in Automated Urban Air Mobility Simulations. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3706598.3713288. 第 32 章
  107. Menn, J., Stenger, D., and Trimpe, S. (2026b). Preferential Bayesian Optimization with Crash Feedback. IEEE Robotics and Automation Letters. doi:10.1109/LRA.2026.3665446. 第 33 章
  108. Meta Platforms, Inc. (2026d). Bayesian optimization with preference exploration (BOPE tutorial, documentation v0.18.1). botorch.org. 软件 第 34 章
  109. Meta Platforms, Inc. (2026l). CHANGELOG (versions 1.2 to 1.3). GitHub. 软件 第 34 章
  110. Mikkola, P., Todorović, M., Järvi, J., Rinke, P., and Kaski, S. (2020). Projective Preferential Bayesian Optimization. International Conference on Machine Learning. 第 32 章 第 34 章
  111. Mo, G., Dudley, J., Chan, L., Liao, Y.-C., Oulasvirta, A., and Kristensson, P. O. (2024). Cooperative Multi-Objective Bayesian Design Optimization. ACM Transactions on Interactive Intelligent Systems. doi:10.1145/3657643. 第 32 章
  112. Myers, V., Bıyık, E., Anari, N., and Sadigh, D. (2021). Learning Multimodal Rewards from Rankings. Conference on Robot Learning. 第 33 章
  113. Nandy, A., and Goucher-Lambert, K. (2025). Exploring the Effectiveness of Interactive Preference Learning for Adapting Designs to Abstract Semantic Attributes. Journal of Mechanical Design. 第 32 章
  114. Nielsen, J., Nielsen, J., and Larsen, J. (2015). Perception-based Personalization of Hearing Aids using Gaussian Processes and Active Learning. IEEE/ACM Transactions on Audio, Speech, and Language Processing. 第 33 章
  115. Niwa, R., Yoshida, S., Koyama, Y., and Ushiku, Y. (2025). Cooperative Design Optimization through Natural Language Interaction. Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology. doi:10.1145/3746059.3747789. 第 32 章
  116. Ou, C., Buschek, D., Mayer, S., and Butz, A. (2022). The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures. Mensch und Computer 2022. doi:10.1145/3543758.3543761. 第 32 章 第 34 章
  117. Ou, C., Mayer, S., and Butz, A. (2023). The Impact of Expertise in the Loop for Exploring Machine Rationality. Proceedings of the 28th International Conference on Intelligent User Interfaces. doi:10.1145/3581641.3584040. 第 32 章
  118. Owaki, T., Koyama, Y., Nakano, T., Yamaguchi, T., Goto, M., and Sakai, H. (2026). Learning Feasibility-Aware Latent Spaces for Preference-Based Exploration of Procedural Automotive Wheel Designs. arXiv. 预印本 第 32 章
  119. Palan, M., Landolfi, N. C., Shevchuk, G., and Sadigh, D. (2019). Learning Reward Functions by Integrating Human Demonstrations and Preferences. Robotics: Science and Systems. doi:10.15607/RSS.2019.XV.023. 第 33 章
  120. Park, K., and Collins, S. H. (2026). Simultaneous Forward and Inverse Human-in-the-Loop Optimization. Conference on Robot Learning. 第 33 章
  121. Peng, Y.-H., Bigham, J. P., and Wu, J. (2026). Efficient Personalization of Generative User Interfaces. arXiv. 预印本 第 32 章
  122. Poggensee, K. L., and Collins, S. H. (2021). How adaptation, training, and customization contribute to benefits from exoskeleton assistance. Science Robotics. 第 33 章
  123. Previtali, D., Mazzoleni, M., Ferramosca, A., and Previdi, F. (2023). GLISp-r: a preference-based optimization algorithm with convergence guarantees. Computational Optimization and Applications. 第 33 章
  124. Rajagopalan, R., Dutta, D., Wei, Y.-L., and Roy Choudhury, R. (2026). Personalized Image Generation via Human-in-the-loop Bayesian Optimization. International Conference on Machine Learning. 第 32 章
  125. Ramella, G., Ijspeert, A., and Bouri, M. (2025). Rapid Online Learning of Hip Exoskeleton Assistance Preferences. 2025 IEEE International Conference on Robotics and Automation (ICRA). doi:10.1109/icra55743.2025.11128809. 第 33 章
  126. Ran, W., Chen, H., Xia, T., Nishimura, Y., Guo, C., and Yin, Y. (2023). Online Personalized Preference Learning Method Based on In-Formative Query for Lane Centering Control Trajectory. Sensors. doi:10.3390/s23115246. 第 34 章
  127. Rodemann, J., Croppi, F., Arens, P., Sale, Y., Herbinger, J., Bischl, B., … Casalicchio, G. (2024). Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration. arXiv. 预印本 第 32 章
  128. Roveda, L., Maggioni, B., Marescotti, E., Shahid, A. A., Maria Zanchettin, A., Bemporad, A., and Piga, D. (2021). Pairwise Preferences-Based Optimization of a Path-Based Velocity Planner in Robotic Sealing Tasks. IEEE Robotics and Automation Letters. 第 33 章
  129. Sadigh, D., Dragan, A., Sastry, S., and Seshia, S. (2017). Active Preference-Based Learning of Reward Functions. Robotics: Science and Systems XIII. 第 33 章
  130. Sandholtz, N., Miyamoto, Y., Bornn, L., and Smith, M. (2023). Inverse Bayesian Optimization: Learning Human Acquisition Functions in an Exploration vs Exploitation Search Task. Bayesian Analysis. doi:10.1214/21-BA1303. 第 32 章
  131. Sankagiri, S., Etesami, J., Fatemi, P., and Grossglauser, M. (2026). Recycling History: Efficient Recommendations from Contextual Dueling Bandits. Algorithmic Learning Theory. 第 34 章
  132. Saracay, I., Schmidt, L., and Guestrin, C. (2026). Beyond expert users: agents should help users construct preferences, not just elicit them. Conference on Language Modeling (COLM 2026). 第 32 章
  133. Schäfer, N., Zhao, G., Li, B., Kupnik, M., Seyfarth, A., Beckerle, P., and Grimmer, M. (2026). User preference-based human-in-the-loop tuning of exoskeleton assistance during walking. npj Biomedical Innovations. doi:10.1038/s44385-026-00085-7. 第 33 章
  134. Schoinas, E., Rastogi, A., Carter, A., Granley, J., and Beyeler, M. (2025). Evaluating Deep Human-in-the-Loop Optimization for Retinal Implants Using Sighted Participants. 2025 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). doi:10.1109/embc58623.2025.11253762. 第 32 章 第 33 章
  135. Shao, K., Chakrabarty, A., Mesbah, A., and Romeres, D. (2024). Coactive Preference-Guided Multi-Objective Bayesian Optimization: An Application to Policy Learning in Personalized Plasma Medicine. IEEE Control Systems Letters. 第 33 章
  136. Shen, J., Hu, J., Dudley, J. J., and Kristensson, P. O. (2022). Personalization of a Mid-Air Gesture Keyboard using Multi-Objective Bayesian Optimization. 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). doi:10.1109/ismar55827.2022.00088. 第 32 章
  137. Slade, P., Kochenderfer, M. J., Delp, S. L., and Collins, S. H. (2022). Personalizing exoskeleton assistance while walking in the real world. Nature. 第 33 章
  138. Slade, P., Atkeson, C., Donelan, J. M., Houdijk, H., Ingraham, K. A., Kim, M., … Collins, S. H. (2024). On human-in-the-loop optimization of human–robot interaction. Nature. 第 33 章
  139. Søgaard Jensen, N., Hau, O., Bagger Nielsen, J. B., Bundgaard Nielsen, T., and Vase Legarth, S. (2019). Perceptual Effects of Adjusting Hearing-Aid Gain by Means of a Machine-Learning Approach Based on Individual User Preference. Trends in Hearing. doi:10.1177/2331216519847413. 第 32 章 第 33 章 第 34 章
  140. Song, Y., Gebhardt, C., Liao, Y.-C., and Holz, C. (2025). Preference-Guided Multi-Objective UI Adaptation. Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology. doi:10.1145/3746059.3747645. 第 32 章
  141. Sui, Y., Yue, Y., and Burdick, J. W. (2017a). Correlational Dueling Bandits with Application to Clinical Treatment in Large Decision Spaces. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. doi:10.24963/ijcai.2017/389. 第 33 章
  142. Sui, Y., Zhuang, V., Burdick, J., and Yue, Y. (2018b). Stagewise Safe Bayesian Optimization with Gaussian Processes. International Conference on Machine Learning. 第 32 章 第 33 章
  143. Sun, L., Ma, H., An, H., and Wei, Q. (2024). An Individual Prosthesis Control Method with Human Subjective Choices. Biomimetics. doi:10.3390/biomimetics9020077. 第 33 章
  144. Sundin, I., Voronov, A., Xiao, H., Papadopoulos, K., Bjerrum, E. J., Heinonen, M., … Engkvist, O. (2022). Human-in-the-loop assisted de novo molecular design. Journal of Cheminformatics. doi:10.1186/s13321-022-00667-8. 第 34 章
  145. Susak, J., Liu, Y., Jansen, P., and Colley, M. (2026). ProVoice: Designing Proactive Functionality for In-Vehicle Conversational Assistants using Multi-Objective Bayesian Optimization to Enhance Driver Experience. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3772318.3791877. 第 32 章
  146. Taddei, S., Koppen, W., Alfio, E., Nuzzo, S., Flynn, L., Diaz, M. A., … Verstraten, T. (2026). Bayesian Preference Elicitation: Human-In-The-Loop Optimization of An Active Prosthesis. arXiv. 预印本 第 33 章
  147. Tanaka, M., Ono, K., and Yamada, S. (2026). Human-in-the-Loop Bayesian Optimization Approach to Supporting Early-Stage Architectural Design. CAADRIA proceedings. doi:10.52842/conf.caadria.2026.1.347. 第 32 章
  148. Tasnim, N. Z., Ni, A., Lobarinas, E., and Kehtarnavaz, N. (2024). A Review of Machine Learning Approaches for the Personalization of Amplification in Hearing Aids. Sensors. doi:10.3390/s24051546. 第 33 章
  149. Tatsukawa, Y., Shen, I.-C., Dogan, M. D., Qi, A., Koyama, Y., Shamir, A., and Igarashi, T. (2025). FontCraft: Multimodal Font Design Using Interactive Bayesian Optimization. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3706598.3713863. 第 32 章
  150. Theiner, L., Hirt, S., Steinke, A., and Findeisen, R. (2025). Exploiting Prior Knowledge in Preferential Learning of Individualized Autonomous Vehicle Driving Styles. 2025 European Control Conference (ECC). doi:10.23919/ecc65951.2025.11186827. 第 34 章
  151. Theiner, L., Pfefferkorn, M., Zhao, Y., Hirt, S., and Findeisen, R. (2026). Efficient Controller Learning from Human Preferences and Numerical Data Via Multi-Modal Surrogate Models. European Control Conference. 第 34 章
  152. Tucker, M. (2023). Enabling Robust and User-Customized Bipedal Locomotion on Lower-Body Assistive Devices via Hybrid System Theory and Preference-Based Learning. California Institute of Technology. doi:10.7907/j9hk-xa17. 学位论文 第 33 章
  153. Tucker, M., Cheng, M., Novoseller, E., Cheng, R., Yue, Y., Burdick, J. W., and Ames, A. D. (2020a). Human Preference-Based Learning for High-dimensional Optimization of Exoskeleton Walking Gaits. 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). doi:10.1109/iros45743.2020.9341416. 第 33 章
  154. Tucker, M., Novoseller, E., Kann, C., Sui, Y., Yue, Y., Burdick, J. W., and Ames, A. D. (2020b). Preference-Based Learning for Exoskeleton Gait Optimization. 2020 IEEE International Conference on Robotics and Automation (ICRA). 第 33 章
  155. Tucker, M., Csomay-Shanklin, N., Ma, W.-L., and Ames, A. D. (2021). Preference-Based Learning for User-Guided HZD Gait Generation on Bipedal Walking Robots. 2021 IEEE International Conference on Robotics and Automation (ICRA). doi:10.1109/icra48506.2021.9561515. 第 33 章
  156. Tucker, M., Li, K., Yue, Y., and Ames, A. D. (2022). POLAR: Preference Optimization and Learning Algorithms for Robotics. arXiv. 预印本 第 33 章
  157. Vyas, D., Brummet, R., Anwar, Y., Jensen, J., Jorgensen, E., Wu, Y.-H., and Chipara, O. (2022). Personalizing over-the-counter hearing aids using pairwise comparisons. Smart Health. doi:10.1016/j.smhl.2021.100231. 第 33 章 第 34 章
  158. Wadinambiarachchi, S., Kelly, R. M., Pareek, S., Zhou, Q., and Velloso, E. (2024). The Effects of Generative AI on Design Fixation and Divergent Thinking. Proceedings of the CHI Conference on Human Factors in Computing Systems. 第 32 章
  159. Wang, W., Xu, W., and Jones, C. N. (2025c). Human-in-the-loop: Real-time Preference Optimization. arXiv. 预印本 第 34 章
  160. Wang, W., Shi, J., and Jones, C. N. (2025d). Personalized Building Climate Control with Contextual Preferential Bayesian Optimization. arXiv. 预印本 第 34 章
  161. Weichert, D., Ernis, G., Worthmann, M., Ryzko, P., and Seifert, L. (2025). When Less is More: A Story of Failing Bayesian Optimization Due to Additional Expert Knowledge. arXiv. 预印本 第 32 章 第 34 章
  162. Wen, C., Phung, T., Mehrotra, P., Gulwani, S., Beaty, R. E., Nagashima, T., and Singla, A. (2026). Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Models. arXiv. 预印本 第 32 章
  163. Xiong, J., Lee, S., Karava, P., and Tzempelikos, A. (2017). Personalized visual satisfaction profiles from comparative preferences using Bayesian inference. Energy Procedia. 第 34 章
  164. Xiong, J., Tzempelikos, A., Bilionis, I., Awalgaonkar, N. M., Lee, S., Konstantzos, I., Sadeghi, S. A., and Karava, P. (2018). Inferring personalized visual satisfaction profiles in daylit offices from comparative preferences using a Bayesian approach. Building and Environment. 第 34 章
  165. Xiong, J., Awalgaonkar, N. M., Tzempelikos, A., Bilionis, I., and Karava, P. (2020). Efficient learning of personalized visual preferences in daylit offices: An online elicitation framework. Building and Environment. 第 34 章
  166. Xu, W., Wang, W., Jiang, Y., Svetozarevic, B., and Jones, C. (2024b). Principled Preferential Bayesian Optimization. International Conference on Machine Learning. 第 34 章
  167. Xu, P., Zheng, S., Ye, Y., Bai, C., Xu, S., Geng, H., Ho, T.-Y., and Yu, B. (2026). RankTuner: When Design Tool Parameter Tuning Meets Preference Bayesian Optimization. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems. 第 34 章
  168. Yamamoto, K., Koyama, Y., and Ochiai, Y. (2022). Photographic Lighting Design with Photographer-in-the-Loop Bayesian Optimization. Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. doi:10.1145/3526113.3545690. 第 32 章
  169. Yuan, L.-P., Dudley, J. J., Kristensson, P. O., and Qu, H. (2025). Personalized Dual-Level Color Grading for 360-degree Images in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics. 第 32 章
  170. Zhang, J., Fiers, P., Witte, K. A., Jackson, R. W., Poggensee, K. L., Atkeson, C. G., and Collins, S. H. (2017). Human-in-the-loop optimization of exoskeleton assistance during walking. Science. 第 33 章
  171. Zhang, R., Zhu, X., Pourebadi Khotbehsara, M., Dao, W., Bıyık, E., and Culbertson, H. (2026b). Vibrotactile Preference Learning: Uncertainty-Aware Preference Learning for Personalized Vibration Feedback. Proceedings of the 34th ACM Conference on User Modeling, Adaptation and Personalization. doi:10.1145/3774935.3806784. 第 32 章
  172. Zhao, Z., Ahmadi, A., Hoover, C., Grado, L., Peterson, N., Wang, X., … Netoff, T. I. (2021). Optimization of Spinal Cord Stimulation Using Bayesian Preference Learning and Its Validation. IEEE Transactions on Neural Systems and Rehabilitation Engineering. doi:10.1109/tnsre.2021.3113636. 第 33 章
  173. Zhou, Y., Koyama, Y., Goto, M., and Igarashi, T. (2020). Generative Melody Composition with Human-in-the-Loop Bayesian Optimization. CSMC-MuMe 2020. 第 32 章
  174. Zhou, Y., Koyama, Y., Goto, M., and Igarashi, T. (2021). Interactive Exploration-Exploitation Balancing for Generative Melody Composition. 26th International Conference on Intelligent User Interfaces. 第 32 章
  175. Zhu, M., Bemporad, A., and Piga, D. (2021). Preference-based MPC calibration. 2021 European Control Conference (ECC). doi:10.23919/ecc54610.2021.9654900. 第 34 章
  176. Zhu, M., Piga, D., and Bemporad, A. (2022). C-GLISp: Preference-Based Global Optimization Under Unknown Constraints With Applications to Controller Calibration. IEEE Transactions on Control Systems Technology. 第 32 章 第 34 章