Changkun Ou/Library

ReplicHAI

Shared by Changkun Ou with everyone

586 entries Export .bib
Year ↓ Title added Authors Venue
Preprint 2025 MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers Luo et al. arXiv
Preprint 2025 MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use Wu et al. arXiv
Blog post 2025 Measuring AI Ability to Complete Long Tasks METR
Preprint 2025 MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents Jiang et al. arXiv
Preprint 2025 MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents Tan et al. arXiv
Preprint 2025 Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge Gou et al. arXiv
Preprint 2025 MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering Chan et al. arXiv
Preprint 2025 MLGym: A New Framework and Benchmark for Advancing AI Research Agents Nathani et al. arXiv
Preprint 2025 MLRC-Bench: Can Language Agents Solve Machine Learning Research Challenges? Zhang et al. arXiv
Preprint 2025 Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving Zan et al. arXiv
Preprint 2025 MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents Zhu et al. arXiv
Journal article 2025 Multilaboratory Experiments Are the Next Big Thing in HCI Oppenlaender Interactions
Preprint 2025 NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security Shao et al. arXiv
Preprint 2025 OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents Kuntz et al. arXiv
Webpage 2025 OSWorld site and OSWorld-Verified leaderboard Lab
Conference paper 2025 PaperBench: Evaluating AI's Ability to Replicate AI Research Starace et al. Proceedings of the 42nd International Conference on Machine Learning
Preprint 2025 PaperBench: Evaluating AI's Ability to Replicate AI Research Starace et al. arXiv
Conference paper 2025 Phantom Costs in Human-Robot Interaction: A Replication Study Lebrun et al. Proceedings of the 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI '25)
Journal article 2025 Predicting the replicability of social and behavioural science claims in COVID-19 preprints Marcoci et al. Nature Human Behaviour
Preprint 2025 R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents Jain et al. arXiv
Conference paper 2025 Rating Roulette: Self-Inconsistency in LLM-As-A-Judge Frameworks Haldar, Hockenmaier Findings of the Association for Computational Linguistics: EMNLP 2025
Preprint 2025 RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts Wijk et al. arXiv
Preprint 2025 REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewards Stojanovski et al. arXiv
Preprint 2025 RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedback Miao et al. arXiv
Preprint 2025 Reflective Paper-to-Code Reproduction Enabled by Fine-Grained Verification Zhou et al. arXiv
Webpage 2025 Remote Labor Index CAIS
Preprint 2025 Remote Labor Index: Measuring AI Automation of Remote Work Mazeika et al. arXiv
Preprint 2025 ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers? Ye et al. arXiv
Preprint 2025 ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers? Ye et al. arXiv
Conference paper 2025 REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Hu et al. Findings of the Association for Computational Linguistics: ACL 2025
Conference paper 2025 REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Hu et al. Findings of the Association for Computational Linguistics: ACL 2025
Preprint 2025 ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code Hua et al. arXiv
Conference paper 2025 ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code Hua et al. Advances in Neural Information Processing Systems
Preprint 2025 ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery Chen et al. arXiv
Preprint 2025 SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers Xiang et al. arXiv
Conference paper 2025 SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers Xiang et al. Conference on Language Modeling (COLM)
Preprint 2025 ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use Li et al. arXiv
Journal article 2025 Six Fallacies in Substituting Large Language Models for Human Participants Lin Advances in Methods and Practices in Psychological Science
Preprint 2025 Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows Lei et al. arXiv
Preprint 2025 StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models Guo et al. arXiv
Preprint 2025 SWE-bench Goes Live! Zhang et al. arXiv
Preprint 2025 SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks? Deng et al. arXiv
Preprint 2025 SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering? Miserendino et al. arXiv
Preprint 2025 SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents Rashid et al. arXiv
Preprint 2025 SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents Badertdinov et al. arXiv
Preprint 2025 SWE-smith: Scaling Data for Software Engineering Agents Yang et al. arXiv
Preprint 2025 SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents Mündler et al. arXiv
Conference paper 2025 The 2025 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results Belz et al. Proceedings of the 4th Workshop on Generation, Evaluation and Metrics
Conference paper 2025 The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models Patil et al. Proceedings of the 42nd International Conference on Machine Learning
Preprint 2025 The BrowserGym Ecosystem for Web Agent Research Chezelles et al. arXiv
Conference paper 2025 The State of Replication at IEEE ISMAR and IEEE VR: A Scoping Literature Review (2010–2024) and Online Survey Arefin et al. 2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Preprint 2025 The SWE-Bench Illusion: When State-of-the-Art LLMs Remember Instead of Reason Liang et al. arXiv
Preprint 2025 TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks Xu et al. arXiv
Preprint 2025 ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities Lu et al. arXiv
Preprint 2025 Training Software Engineering Agents and Verifiers with SWE-Gym Pan et al. arXiv
Webpage 2025 Vending-Bench 2 Labs
Preprint 2025 Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents Backlund, Petersson arXiv
Preprint 2025 Why Do Multi-Agent LLM Systems Fail? Cemri et al. arXiv
Preprint 2025 WideSearch: Benchmarking Agentic Broad Info-Seeking Wong et al. arXiv
Preprint 2025 WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks Boisvert et al. arXiv
Conference paper 2024 "AI enhances our performance, I have no doubt this one will do the same": The Placebo effect is robust to negative descriptions of AI Kloft et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 "Are we all in the same boat?" Customizable and Evolving Avatars to Improve Worker Engagement and Foster a Sense of Community in Online Crowd Work Groot, Gadiraju Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 $τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains Yao et al. arXiv
Conference paper 2024 A Longitudinal In-the-Wild Investigation of Design Frictions to Prevent Smartphone Overuse Haliburton et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations Miller arXiv
Preprint 2024 Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations Miller arXiv
Preprint 2024 AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents Ma et al. arXiv
Preprint 2024 AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents Debenedetti et al. arXiv
Preprint 2024 AgentGym: Evolving Large Language Model-based Agents across Diverse Environments Xi et al. arXiv
Preprint 2024 AI Agents That Matter Kapoor et al. arXiv
Preprint 2024 AI Agents That Matter Kapoor et al. arXiv
Webpage 2024 Aider LLM Leaderboards (Polyglot) Aider
Preprint 2024 AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents Xu et al. arXiv
Preprint 2024 AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents Trivedi et al. arXiv
Webpage 2024 Artifacts at CHI 2024 Chairs
Preprint 2024 AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks? Yoran et al. arXiv
Preprint 2024 BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation Li et al. arXiv
Journal article 2024 Can Generative AI improve social science? Bail Proceedings of the National Academy of Sciences
Conference paper 2024 Changing Lanes Toward Open Science: Openness and Transparency in Automotive User Research Ebel et al. Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Preprint 2024 Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference Chiang et al. arXiv
Preprint 2024 Commit0: Library Generation from Scratch Zhao et al. arXiv
Journal article 2024 CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark Siegel et al. Transactions on Machine Learning Research
Preprint 2024 DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models Huang et al. arXiv
Preprint 2024 DiscoveryBench: Towards Data-Driven Discovery with Large Language Models Majumder et al. arXiv
Preprint 2024 DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents Jansen et al. arXiv
Journal article 2024 Do Videogame Rewards Influence Players' Subsequent Prosocial Engagement? A Preregistered Partial Replication Study on the Role of Reward and Reasoning Kammermann et al. International Journal of Human-Computer Studies
Conference paper 2024 Doorways Do Not Always Cause Forgetting: Studying the Effect of Locomotion Technique and Doorway Visualization in Virtual Reality Gemert et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 Doorways Do Not Always Cause Forgetting: Studying the Effect of Locomotion Technique and Doorway Visualization in Virtual Reality Gemert et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 Effects of Point Size and Opacity Adjustments in Scatterplots Strain et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 Embracing Transparency: A Study of Open Science Practices Among Early Career HCI Researchers Chakravorti et al. arXiv
Preprint 2024 Evaluating Very Long-Term Conversational Memory of LLM Agents Maharana et al. arXiv
Preprint 2024 Generative Agent Simulations of 1,000 People Park et al. arXiv
Conference paper 2024 Glanceable Data Visualizations for Older Adults: Establishing Thresholds and Examining Disparities Between Age Groups While et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 Glanceable Data Visualizations for Older Adults: Establishing Thresholds and Examining Disparities Between Age Groups While et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 How Beginning Programmers and Code LLMs (Mis)read Each Other Nguyen et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 Identifying the Risks of LM Agents with an LM-Emulated Sandbox Ruan et al. arXiv
Conference paper 2024 Independent Validation of the Player Experience Inventory: Findings from a Large Set of Video Game Players Perrig et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks Hu et al. arXiv
Preprint 2024 InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents Zhan et al. arXiv
Computer program 2024 Inspect Institute
Computer program 2024 Inspect Evals contributors
Conference paper 2024 Integrating Measures of Replicability into Scholarly Search: Challenges and Opportunities Wu et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Blog post 2024 Introducing SWE-bench Verified OpenAI
Preprint 2024 LAB-Bench: Measuring Capabilities of Language Models for Biology Research Laurent et al. arXiv
Preprint 2024 LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code Jain et al. arXiv
Webpage 2024 LMArena LMArena
Preprint 2024 Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks Fourney et al. arXiv
Computer program 2024 METR Task Standard METR
Preprint 2024 ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code Tang et al. arXiv
Preprint 2024 MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation Huang et al. arXiv
Conference paper 2024 Model-based Evaluation of Recall-based Interaction Techniques Gori et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models Ko et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Journal article 2024 Nonstandard Errors Menkveld et al. The Journal of Finance
Conference paper 2024 Odds and Insights: Decision Quality in Exploratory Data Analysis Under Uncertainty Sarma et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automation Wang et al. arXiv
Preprint 2024 OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web Kapoor et al. arXiv
Preprint 2024 OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments Xie et al. arXiv
Preprint 2024 Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study Li et al. arXiv
Blog post 2024 Raising the bar on SWE-bench Verified with Claude 3.5 Sonnet Anthropic
Conference paper 2024 Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming Mozannar et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 RedCode: Risky Code Execution and Generation Benchmark for Code Agents Guo et al. arXiv
Journal article 2024 Report of the AEA Data Editor Vilhuber AEA Papers and Proceedings
Preprint 2024 SciCode: A Research Coding Benchmark Curated by Scientists Tian et al. arXiv
Webpage 2024 SEAL Leaderboards AI
Preprint 2024 SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents Cheng et al. arXiv
Conference paper 2024 Self-Efficacy and Security Behavior: Results from a Systematic Review of Research Methods Borgert et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 Sicknificant Steps: A Systematic Review and Meta-analysis of VR Sickness in Walking-based Locomotion for Virtual Reality Gemert et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows? Cao et al. arXiv
Preprint 2024 SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation Ma et al. arXiv
Preprint 2024 StreamBench: Towards Benchmarking Continuous Improvement of Language Agents Wu et al. arXiv
Conference paper 2024 SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories Bogin et al. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Preprint 2024 SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories Bogin et al. arXiv
Preprint 2024 SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains? Yang et al. arXiv
Preprint 2024 SWE-Bench+: Enhanced Coding Benchmark for LLMs Aleithan et al. arXiv
Preprint 2024 SWE-bench: Can Language Models Resolve Real-World GitHub Issues? Jimenez et al. arXiv
Conference paper 2024 That's Rough! Encoding Data into Roughness for Physicalization Du et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 The Illusion of Artificial Inclusion Agnew et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 The State of Reproducibility Stamps for Visualization Research Papers Isenberg 2024 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV)
Conference paper 2024 To Cut or Not To Cut? A Systematic Exploration of Y-Axis Truncation Long, Kay Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 TravelPlanner: A Benchmark for Real-World Planning with Language Agents Xie et al. arXiv
Conference paper 2024 Understanding Reader Takeaways in Thematic Maps Under Varying Text, Detail, and Spatial Autocorrelation Fan et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 User Characteristics in Explainable AI: The Rabbit Hole of Personalization? Nimmo et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 Using Large Language Models to Create AI Personas for Replication, Generalization and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findings Yeykelis et al. arXiv
Journal article 2024 Vis Repligogy: Towards a Culture of Facilitating Replication Studies in Visualization Pedagogy and Research Syeda et al. EuroVis 2024 - Education Papers
Preprint 2024 VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agents Liu et al. arXiv
Preprint 2024 VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks Koh et al. arXiv
Preprint 2024 WebArena: A Realistic Web Environment for Building Autonomous Agents Zhou et al. arXiv
Preprint 2024 WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Lù et al. arXiv
Preprint 2024 WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models He et al. arXiv
Conference paper 2024 Which Artificial Intelligences Do People Care About Most? A Conjoint Experiment on Moral Consideration Ladak et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Preprint 2024 Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale Bonatti et al. arXiv
Preprint 2024 WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks? Drouin et al. arXiv
Conference paper 2024 “AI Enhances Our Performance, I Have No Doubt This One Will Do the Same”: The Placebo Effect Is Robust to Negative Descriptions of AI Kloft et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Conference paper 2024 “I finally felt I had the tools to control these urges”: Empowering Students to Achieve Their Device Use Goals With the Reduce Digital Distraction Workshop Lyngs et al. Proceedings of the CHI Conference on Human Factors in Computing Systems
Journal article 2023 A discipline-wide investigation of the replicability of Psychology papers over the past two decades Youyou et al. Proceedings of the National Academy of Sciences
Preprint 2023 API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs Li et al. arXiv
Conference paper 2023 Breaking Barriers: Workshop on Open Data Practices in AutoUI Research Ebel et al. Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Conference paper 2023 CALVI: Critical Thinking Assessment for Literacy in Visualizations Ge et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Journal article 2023 Can AI language models replace human participants? Dillion et al. Trends in Cognitive Sciences
Conference paper 2023 Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022 Niksirat et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022 Niksirat et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting Dang et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Co-Writing with Opinionated Language Models Affects Users’ Views Jakesch et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Code Code Evolution: Understanding How People Change Data Science Notebooks Over Time Raghunandan et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Comparing Measures of Perceived Challenge and Demand in Video Games: Exploring the Conceptual Dimensions of CORGIS and VGDS Flint et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Preprint 2023 CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion Ding et al. arXiv
Conference paper 2023 Designing Resource Allocation Tools to Promote Fair Allocation: Do Visualization and Information Framing Matter? Verma et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Different Researchers, Different Results? Analyzing the Influence of Researcher Experience and Data Type During Qualitative Analysis of an Interview and Survey Study on Security Advice Ortloff et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability Yurrita et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Preprint 2023 GAIA: a benchmark for General AI Assistants Mialon et al. arXiv
Preprint 2023 Gorilla: Large Language Model Connected with Massive APIs Patil et al. arXiv
Preprint 2023 Holistic Evaluation of Language Models Liang et al. arXiv
Conference paper 2023 Home Is Where the Smart Is: Development and Validation of the Cybersecurity Self-Efficacy in Smart Homes (CySESH) Scale Borgert et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Preprint 2023 InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback Yang et al. arXiv
Conference paper 2023 Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems He et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Less About Privacy: Revisiting a Survey About the German COVID-19 Contact Tracing App Häring et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Preprint 2023 LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning Liu et al. arXiv
Conference paper 2023 Matching Mind and Method: Augmented Decision-Making with Digital Companions based on Regulatory Mode Theory Tretter et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Preprint 2023 Mind2Web: Towards a Generalist Agent for the Web Deng et al. arXiv
Computer program 2023 OpenAI Evals OpenAI
Journal article 2023 Out of One, Many: Using Language Models to Simulate Human Samples Argyle et al. Political Analysis
Conference paper 2023 Phone Sleight of Hand: Finger-Based Dexterous Gestures for Physical Interaction with Mobile Phones Yeh et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Journal article 2023 Replicating replicability modeling of psychology papers Mottelson, Kontogiorgos Proceedings of the National Academy of Sciences
Conference paper 2023 Replication and Extension of Video Game Demand Scale with a Turkish-Speaking Gamer Population Kosa, Bowman Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Replication and Extension of Video Game Demand Scale with a Turkish-Speaking Gamer Population Kosa, Bowman Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Journal article 2023 Replication games: how to make reproducibility research more systematic Brodeur et al. Nature
Journal article 2023 Reply to Crockett et al. and Mottelson and Kontogiorgos: Machine learning’s scientific significance and future impact on replicability research Youyou et al. Proceedings of the National Academy of Sciences
Preprint 2023 RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems Liu et al. arXiv
Conference paper 2023 Save A Tree or 6 kg of CO2? Understanding Effective Carbon Footprint Interventions for Eco-Friendly Vehicular Choices Mohanty et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Journal article 2023 The limitations of machine learning models for predicting scientific replicability Crockett et al. Proceedings of the National Academy of Sciences
Journal article 2023 The State of Play of Reproducibility in Statistics: An Empirical Analysis Xiong, Cribben The American Statistician
Preprint 2023 ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs Qin et al. arXiv
Preprint 2023 ToolQA: A Dataset for LLM Question Answering with External Tools Zhuang et al. arXiv
Conference paper 2023 User Preference and Performance using Tagging and Browsing for Image Labeling Fruchard et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Conference paper 2023 Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies Aher et al. Proceedings of the 40th International Conference on Machine Learning
Conference paper 2023 Visual Belief Elicitation Reduces the Incidence of False Discovery Koonchanok et al. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Preprint 2023 WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents Yao et al. arXiv
Journal article 2023 What's in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science Crüwell et al. Psychological Science
Conference paper 2023 Zeitgebers, Time Judgments, and VR: A Constructive Replication Study Andrich et al. 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
Conference paper 2022 A Retrospective Study of One Decade of Artifact Evaluations Winter et al. Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

‹ Prev 201–400 of 586 Next ›

/ filter · j k or ↑ ↓ select · Enter open page · c copy BibTeX