avatar

Qiangqiang Mao

Ph.D. @ University of British Columbia | Machine Learning Optimization | LLM

I am passionate about applying trustworthy machine learning, through the lens of optimization, to solve real-world decision support problems, and am actively looking for research/job opportunities in both fundamental and applied machine learning.

Bio Sketch

I am currently pursuing a Ph.D. degree at the University of British Columbia in Vancouver, Canada. Prior to this, I received my bachelor’s and master’s degrees from China University of Petroleum in Qingdao, China, in 2019 and 2022.

My research focuses on machine learning optimization (optimal lightweight and interpretable decision tree) and its decision support applications in diverse industrial scenarios including both traditional and renewable energy systems, and control problems.
I mainly develop a set of tree-based algorithms (decision tree, random forest and reinforcement learning with decision tree policy) and address the following four questions, especially for real-world industrial applications: (1) Can a single tree outperform an entire forest? (2) Do we really need hundreds of machine learning models for tabular data-driven applications? (3) Do we have to rely on heavy black-box convolutional neural networks for image classification? (4) Can reinforcement learning and learning-based control be interpretable as decision tree?

Beyond these machine learning optimization studies, recently working on test time training and adaptation for large language model (LLM and MoE) using sparse learning.


Recent News


Research Highlights

Fundamental Machine Learning

Research Image
NeurIPS 2025

Differentiable Decision Tree via "ReLU+Argmin" Reformulation

Mao Q., Ren J., Wang Y., Zou C., Zheng J., and Cao Y.

Advances in Neural Information Processing Systems 2025. Spotlight Paper.

This study proposes RADDT, a novel differentiable decision tree to address two key challenges: high accuracy and differentiability. Its enables large-scale, gradient-based optimization, making it effective even for million-scale datasets through distributed multi-GPUs acceleration.

Research Image

Can a Single Tree Outperform an Entire Forest?

Mao Q. and Cao Y.

arXiv:2411.17003. 2024

This study, GET, significantly improves decision tree's accuracy by unconstrained tree reformulation and increasingly-accurate soft approximation.

Research Image
TMLR

A Moving-horizon Approximate Branch-and-Reduce Method for Deep Classification Trees.

Zou C., Ren J., Mao Q., Liu J., Lai M. and Cao Y.

Transactions on Machine Learning Research. 2026. revision.

This study addresses scalability challenges in deep trees using bilevel optimization with an approximate solution for the lower-level problem.

Research Image

A GPU-accelerated Moving-horizon Algorithm for Training Deep Classification Trees on Large Datasets

Ren J., Osuna V., Okamoto M., Mao Q., Cao L., Hua K., and Cao Y.

arXiv:2311.06952. 2023.

Large Language Models

Research Image
ICML Workshop 2026

Unmasking the Hidden Fairness, Bias, and Safety Costs of Compression with Mixture-of-Expert Models.

Szentmiklossy E., Lasby M., Mao Q., Raza S., and Ioannou Y.

International Conference on Machine Learning. 2026. Trustworthy AI Workshop.

This study investigate how compression changes fairness and safety behavior in MoE language models.

Research Image
CVPR 2026

UReFTA: Breaking the Weight Reconstruction Bottleneck in Tensorized Parameter-efficient Fine-tuning.

Zheng J., Tang A., Mao Q., Lin Z., and Cao Y.

IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2026.

This study presents a tensor-based PEFT approach with a single tensor-rank parameter for large models that achieves extremely low trainable parameter counts by leveraging the low-rank structure of weight tensors.

Decision Support

Research Image

A Decision Support Engine for Infill Drilling Attractiveness Evaluation Using Rule-based Cognitive Computing Under Expert Uncertainties

Mao Q., Ma X., and Wang Y.

Journal of Petroleum Science and Engineering. 2022.

This study developes a rules set-based reasoning engine for drilling target recommendation and well placement optimization.

Research Image
SPE ATCE 2025

Do We Really Need Hundreds of Machine Learning Models in Industry?

Mao Q., Yang X., Yang J. and Cao Y.

SPE Annual Technical Conference and Exhibition. 2025.

This study challenges recent practice in tabular data-driven petroleum applications by proposing a decision tree-based paradigm with 26 applications. It emphasizes practical field demands of accuracy, interpretability and lightweight structure.

Process Monitoring & Fault Detection

Research Image

Visual Process Monitoring of Biomass Conversion Reactors Using Transfer Learning and Generative AI.

Mao Q., Yip B., Xu C., Garg S., Guo P. and Cao Y.

Computer and Chemical Engineering. 2025.

This study proposes a GenAI-based data augmentation and tailored transfer learning strategy to address data scarcity, specifically for the faulty smoke events during biomass-to-biochar conversion processes.

Research Image
SPE ATCE 2025

Stop Using CNN: Knowledge Distillation for An Interpretable and Lightweight Decision Tree in Rod Pump Working Condition Diagnosis

Mao Q., Yang X., Yang J. and Cao Y.

SPE Annual Technical Conference and Exhibition. 2025.

This study challenges recent reliance on black-box, heavy models in dynamometer card-based fault diagnosis by proposing an interpretable and lightweight decision tree alternative. The proposed paradigm is also applied to other image classification tasks.

Control

Research Image

Exact Learning of Model Predictive Control Laws Using Oblique Decision Trees with Linear Predictions

Ren J., Mao Q., Zhao T. and Cao Y.

IEEE Conference on Decision and Control. 2025.

This study presents a successful application of our proposed differentiable decision tree (tree with linear predictions) in explicit model predictive control.

Research Image

Deep Learning-based Approximation of Model Predictive Control Laws Using Mixture Networks

Okamoto M., Ren J., Mao Q., Liu J. and Cao Y.

IEEE Transactions on Automation Science and Engineering. 2025.

This study addresses a major limitation of one-to-many mappings in deep learning-based model predictive control.

Contact Me

  • maoq@student.ubc.ca
  • 2360 East Mall
    Vancouver, BC, Canada, V6T 1Z3