News

  • 🎉 AAAI 2025: Our paper "QORT-Former: Query-Optimized Real-Time Transformer for Understanding Two Hands Manipulating Objects" has been accepted! Check out our poster!

Publications

  • QORT-Former: Query-Optimized Real-Time Transformer for Understanding Two Hands Manipulating Objects. Accepted at AAAI 2025.
    Authors: Elkhan Ismayilzada*, MD Khalequzzaman Chowdhury Sayem* (Co-First Author), Yihalem Yimolal Tiruneh, Mubarrat Tajoar Chowdhury, Muhammadjon Boboev, Seungryul Baek.
    In this paper, we present a query-optimized real-time Transformer (QORT-Former), the first Transformer-based real-time framework for 3D pose estimation of two hands and an object. Our approach optimizes queries to balance efficiency and accuracy, leveraging hand-object contact information and a three-step feature update mechanism. Our method achieves real-time pose estimation at 53.5 FPS on an RTX 3090TI GPU while outperforming state-of-the-art models on H2O and FPHA datasets.
    Project Page | Paper | Code
  • Towards Fine-Grained Text Generation from 3D Hand Geometry for Hand Mesh Reconstruction. (Under Review)