Research · products · teaching
I am Boxi Yu, a software engineering researcher at Lero. I study how to test and evaluate coding agents and AI systems so that people can decide when to trust them, then turn those lessons into tools people can use and courses people can learn from.
Strengthening tests and examining the reliability of benchmark results.
Using relations between programs and executions to detect inconsistencies.
Controlled transformations reveal errors in vision and language systems.
LightAD, OpenRCA 2.0, and CLEANet examine model efficiency, causal diagnosis, and robustness to contaminated data.
Coverage- and mutation-driven test augmentation rejected 19.71% of previously passing patches in our evaluation of 30 agents on SWE-Bench Verified.
Generated unit tests exposed 345 erroneous patches that had originally passed SWE-Bench evaluation, showing how test quality changes conclusions about coding agents.
A benchmark that scores business outcomes and process compliance separately for LLM agents in regulated customer-experience workflows, built with Genesys.
An empirical comparison of classical and deep learning approaches examines accuracy and computational cost across five log datasets.
Teaching · interactive lecture notes
For five courses, I build one interactive page per lecture: from AI literacy for everyone, through a first Python program, data structures and linear algebra, to building software with coding agents. Every program and interactive check has been run, and every output shown is the real one.
Open course in Chinese and English · Designer: Boxi Yu · 中文版
Eight shared modules on using AI, checking what it says, and knowing when not to use it, with tracks for K12, university, working adults, seniors, and teachers. The core module, C4, teaches how to check AI: it makes mistakes, so learn to catch them.
CUHK–Shenzhen · Instructor: Prof. Pinjia He
From number systems to recursion, classes, and data structures, ending with how large language models work. Step through what Python does in memory, predict each output before it appears, and finish every lecture with a self-check.
Python and Java versions · Instructors: Boxi Yu and Yintong Huo
The structures behind every program, from arrays and linked lists to search trees, hash tables, heaps, and graphs, with complexity and proof methods as the common language. Pick Python or Java: the concepts are shared, the code is in your language.
Open course in English · Designer: Boxi Yu · Inspired by MIT 18.06
From three pictures of a linear system to the singular value decomposition and computing with matrices. Every number in the notes is computed by running code, and every unit ends with a machine-learning example and a section on working with AI: what to ask, and how to check the answer.
CUHK–Shenzhen · Fall 2026 · Instructor: Jinsheng Ba · Official course site
How LLMs and agents work, then how to use them across the software lifecycle: prompts, MCP and skills, requirements, coding, and team collaboration. Step through the agent loop, prompts, and tool calls, then try each step with a coding agent of your own.
Interactive notes and videos built with 培玉智能. I designed AI for All and LA101, teach Data Structures with Yintong Huo, and co-designed the AIE1001 and CSC4801 notes; their slides and course content belong to each instructor.
Agents generate. You verify, decide and explain.
A practical twelve-week course for building with coding agents while keeping specifications, tests, review, security, and judgment in the loop.
I have also mentored ten students. All ten co-authored peer-reviewed papers with me at ICSE, ESEC/FSE, or ISSTA, and eight are now Ph.D. students. See where they went.
Co-founder
Alongside my research I co-founded OneAI and Pacific Studio, where we build AI products that keep people in the decision seat.
ONEAI
Turn a learning objective into a question set, rubric, and student-level feedback loop. Teachers stay in the decision seat; AI handles the first pass.
In use at four schools in Guangzhou and Shenzhen, including olympiad training in mathematics, physics, chemistry, biology, and informatics at The Affiliated High School of South China Normal University and Guangzhou University Affiliated Middle School.
Co-founder · build, prove, understand
Three products from Pacific Studio, which I co-founded, show how AI can support the software lifecycle: ship the work, check the proof, and read the ideas that shape it.
Build
Issue-driven orchestration for the full software lifecycle, with Claude Code, Codex, and Gemini CLI working across design, development, testing, and deployment.
Prove
AI-assisted formal verification that turns plain code into machine-checked proof goals, with an offline workflow for C, Java, Dafny, and Rust.
Understand
An interactive paper reader that combines layout-aware parsing, sentence-level highlights, bilingual reading, and answers that point back to the source.
AI education · free and open
A good tutor is still a luxury. I want every child to understand why maths works, whatever their family can pay and whichever language they speak. So I make teaching, starting with maths, that is free to watch and free to reuse, with AI tools I release as open source.
Learn
Short K–12 maths videos in English and Chinese. Each answers one “why” and draws it so you can see it. Organised by stage rather than school year, with the matching year in China, the US, the UK, and Singapore.
Try
The same stage-based approach for the other K–12 subjects, from Chinese and English to physics, history, and computing. Each subject starts from a few core ideas, and every lesson is something to try with your own hands.
Make
The tools behind the videos: a format for describing a teaching scene and a vector animation engine, so any teacher can make videos like these without a studio.
I started Boxi Learn, which takes the stage-based approach of Boxi Math to other K–12 subjects. It has 109 hands-on lessons across nine subjects so far, from Chinese and English to physics, history, and computing, in English and Chinese. See education equity.
We released CXBench, a benchmark built with Genesys that scores LLM agents in regulated customer-experience workflows on both the business outcome and the required process. Across seven models, 80.1% of outcome-passing runs failed a process check. The paper is now on arXiv; see the research summary.
I started Boxi Math, free K–12 maths videos in English and Chinese that show why maths works, organised by stage rather than school year. The videos and text are CC BY 4.0, and the tools behind them are open source at animind-ai. See education equity.
BlogMore time for coaching, a tutor that is always there
What changes when olympiad coaches and students work with AI: better preparation and problem selection for teachers, and help that is available whenever a student is stuck.