RepoBaidu (ERNIE)Baidu (ERNIE)published Jul 3, 2020seen 5d

PaddlePaddle/Knover

Python

Open original ↗

Captured source

source ↗
GH
GitHub/github.com/PaddlePaddle/Knover
PaddlePaddle/Knover repository metadata
Source ↗
published Jul 3, 2020seen 5dcaptured 8hhttp 200method plain

PaddlePaddle/Knover

Description: Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle

Language: Python

License: Apache-2.0

Stars: 671

Forks: 126

Open issues: 64

Created: 2020-07-03T08:14:38Z

Pushed: 2024-03-06T03:28:32Z

Default branch: develop

Fork: no

Archived: no

README:

Knover

Knover is a toolkit for knowledge grounded dialogue generation based on PaddlePaddle. Knover allows researchers and developers to carry out efficient training/inference of large-scale dialogue generation models.

What's New:

  • October 2022: We are opening [Q-TOD](projects/Q-TOD/README.md), a novel query-driven task-oriented dialogue system.
  • March 2022: We are opening [PLATO-KAG](projects/PLATO-KAG/README.md), an unsupervised learning approach for end-to-end knowledge-grounded conversation modeling.
  • February 2022: We are opening our TOD-DA dataset, models and code in [DSTC10-Track2](projects/DSTC10-Track2/README.md).
  • December 2021: We are opening the dialogue generation model of [PLATO-XL](projects/PLATO-XL/README.md), with up to 11 billion parameters.
  • October 2021: We are opening [AG-DST](projects/AG-DST/README.md), an amendable generation for dialogue state tracking.
  • February 2021: We are opening our implementation (Team 19) in [DSTC9-Track1](projects/DSTC9-Track1/README.md).
  • July 2020: We are opening [PLATO-2](projects/PLATO-2/README.md), a large-scale generative model with latent space for open-domain dialogue systems.

Requirements and Installation

  • python version >= 3.7
  • paddlepaddle-gpu version >= 2.4.0
  • You can install PaddlePaddle following the instructions.
  • The specific version of PaddlePaddle is also based on your CUDA version (recommended version: 10.1) and CuDNN version (recommended version: 7.6). See more information on PaddlePaddle document about GPU support
  • sentencepiece
  • termcolor
  • If you want to run distributed training, you'll also need NCCL
  • Install Knover locally:
git clone https://github.com/PaddlePaddle/Knover.git
cd Knover
pip3 install -e .
  • Or you can setup PYTHONPATH only:
export PYTHONPATH=/abs/path/to/Knover:$PYTHONPATH

Basic usage

  • See [usage document](docs/usage.md).

Disclaimer

This project aims to facilitate further research progress in dialogue generation. Baidu is not responsible for the 3rd party's generation with the pre-trained system.

Contact information

For help or issues using Knover, please submit a GitHub issue.