Shiyao Xu (徐诗瑶)

Email: xusy[at]stu.pku.edu.cn/xsy9915[at]gmail.com   Github  CV  Google Scholar  Twitter  Zhihu

I am Shiyao Xu (徐诗瑶), currently a final year master student in Wangxuan Institute of Computer Techonology(WICT) at Peking University, China, supervised by Zhouhui Lian. I'm a member of CSCL group led by Prof. Zhouhui Lian, and also a research intern in XR-Lab at DAMO Academy, Alibaba Group. I'm now fortunately supervised by Lingzhi Li and Dr. Li Shen in Alibaba. I did my bachelors at Dalian University of Technology, China, 2020.

I am looking for a PhD position or full-time, -paid research assistant opportunity starting from now. Please freely contact me! :)

My research interests lie in neural rendering and generation models.

profile photo
News!🔥
  • [News!]2022.10: Recieve a graduate school scholarship!
  • [News!]Happy to announce that our paper "Your3dEmoji"" is accepted by SIGGRAPH ASIA 2022 Tech. Comm.!🤪 See you in Korea!
  • 2022.08: Serve as a Student Volunteer (virtual) in SIGGRAPH 2022.
  • ⚽️ A member of PKU Women Football Club. Also a founder of our college women's football team.(I'm also a fan of Arsenal F.C.🔫🔴⚪️)
    		•
    Publications and Preprints
    		DeSRF: Deformable Stylized Radiance Field
    Shiyao Xu, Lingzhi Li, Li Shen, Zhouhui Lian
    In Submission

    We propose a more efficient method, DeSRF, to stylize the radiance field, which also transfers style information to the geometry according to the input style.
    		Your3dEmoji: Creating Personalized Emojis via One-shot 3D-aware Cartoon Avatar Synthesis
    Shiyao Xu, Lingzhi Li, Li Shen, Yifang Men, Zhouhui Lian
    SIGGRAPH ASIA 2022 Technical Communication
    [PDF] [DOI] [Code]

    We propose a novel 3D generative model to translate a real-world face image into its corresponding 3D avatar with only a single style example provided. Our model is 3D-aware in sense and also able to do attribute editing, such as smile, age, etc directly in the 3D domain.
    		Dynamic Texture Transfer using PatchMatch and Transformers
    Guo Pu*, Shiyao Xu*, Zhouhui Lian
    Under Review

    We propose an automatically method to transfer the dynamic texture of a given video to a still image.

    Abstract
      How to automatically transfer the dynamic texture of a given video to the target still image is a challenging and ongoing problem. In this paper, we propose to handle this task via a simple yet effective model that utilizes both PatchMatch and Transformers. The key idea is to decompose the task of dynamic texture transfer into two stages, where the start frame of the target video with the desired dynamic texture is synthesized in the first stage via a distance map guided texture transfer module based on the PatchMatch algorithm. Then, in the second stage, the synthesized image is decomposed into structure-agnostic patches, according to which their corresponding subsequent patches can be predicted by exploiting the powerful capability of Transformers equipped with VQ-VAE for processing long discrete sequences. After getting all those patches, we apply a Gaussian weighted average merging strat- egy to smoothly assemble them into each frame of the target stylized video. Experimental results demonstrate the effectiveness and superiority of the proposed method in dynamic texture transfer compared to the state of the art.
    Experiences
  • Reviewers for journals: IEEE Transactions on Affective Computing(TAC/TAFFC).
  • 2022.08: Serve as a Student Volunteer (virtual) in SIGGRAPH 2022.
  • 2021.08-Present: Research Intern at XR-Lab, DAMO Academy, Alibaba Inc, supervised by Lingzhi Li and Dr. Li Shen.
  • 2021.07-2021.08: Machine Learning Intern at Apple, Beijing.
  • Spring 2021: TA of Elementary Number Theory for undergraduate students, Peking University
  • 2020.06: Join PKU-CSCL Lab led by Prof. Zhouhui Lian. Start my CV/CG jounery!
  • 2020.07: Graduate from Dalian University of Technology! 🍻 Thanks to Prof. Kun Lu and Prof. Shimin Shan for my undergraduate guidance!
  • 2016.09-2020.07: B.Eng. in School of Software, Dalian University of Technology. Major in Big Data and Machine Learning.
    		•

    I play: ⚽️🏊🏻‍♀️🏃🏻‍♀️🎾🥊🏂🎸

    Build the bridge between 2D and 3D world. Do some cool research!😎

    Last modified: 13/11/2022