Skip to content
@TsinghuaC3I

TsinghuaC3I

Center for Collaborative & Conversational Intelligence at Tsinghua University

The Center for Collaborative & Conversational Intelligence (C3I) is affiliated with the Department of Electronic Engineering at Tsinghua University and is led by Professor Bowen Zhou.

Our research objectives are as follows:

  1. Specialization and Alignment of Foundation Models: This involves in-depth research on the architecture design, training, and alignment of foundation models, exploring specialization in reasoning.
  2. Multi-Dimensional Collaborative Research: Based on a cognitive collaboration framework incorporating both System 1 and System 2, this area explores collaboration between large and small models, multimodal collaboration, and human-machine collaboration. It also investigates the interpretable mechanisms of neurodynamics and theories of sustainable hybrid human-machine intelligence.
  3. Application Development for Scientific Discovery: Focused on the biomedical field, this research utilizes collaborative interaction technologies to drive knowledge innovation and promote scientific discoveries and technological advancements.

Popular repositories Loading

  1. SoRA SoRA Public

    [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models

    Python 70 9

  2. UltraMedical UltraMedical Public

    [NeurIPS 2024 D&B Track, Spotlight] UltraMedical: Building Specialized Generalists in Biomedicine

    Python 65 1

  3. Intuitive-Fine-Tuning Intuitive-Fine-Tuning Public

    Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process

    Python 22

  4. LLM4BioHypoGen LLM4BioHypoGen Public

    [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

    Python 11

  5. FS-GEN FS-GEN Public

    Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.

    Python 10 2

  6. LPA LPA Public

    [EMNLP 2024, Main Confernece] Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

    Python 5

Repositories

Showing 9 of 9 repositories
  • FS-GEN Public

    Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.

    TsinghuaC3I/FS-GEN’s past year of commit activity
    Python 10 2 1 0 Updated Nov 19, 2024
  • LPA Public

    [EMNLP 2024, Main Confernece] Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

    TsinghuaC3I/LPA’s past year of commit activity
    Python 5 0 0 0 Updated Nov 5, 2024
  • UltraMedical Public

    [NeurIPS 2024 D&B Track, Spotlight] UltraMedical: Building Specialized Generalists in Biomedicine

    TsinghuaC3I/UltraMedical’s past year of commit activity
    Python 65 1 0 0 Updated Sep 26, 2024
  • CRaSh Public

    The source code of the EMNLP 2023 main conference paper: "CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model."

    TsinghuaC3I/CRaSh’s past year of commit activity
    Python 4 0 1 0 Updated Aug 26, 2024
  • CoGenesis Public

    CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following. ACL@2024 Main Conference

    TsinghuaC3I/CoGenesis’s past year of commit activity
    Python 4 0 1 0 Updated Aug 7, 2024
  • Intuitive-Fine-Tuning Public

    Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process

    TsinghuaC3I/Intuitive-Fine-Tuning’s past year of commit activity
    Python 22 0 2 0 Updated Aug 2, 2024
  • LLM4BioHypoGen Public

    [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

    TsinghuaC3I/LLM4BioHypoGen’s past year of commit activity
    Python 11 0 1 0 Updated Jul 15, 2024
  • .github Public
    TsinghuaC3I/.github’s past year of commit activity
    0 0 0 0 Updated Apr 27, 2024
  • SoRA Public

    [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models

    TsinghuaC3I/SoRA’s past year of commit activity
    Python 70 9 8 0 Updated Mar 5, 2024

Top languages

Loading…

Most used topics

Loading…