PaddlePaddle/PaddleGAN

PaddlePaddle/PaddleGAN

Description: PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, Wav2Lip, picture repair, image editing, photo2cartoon, image style transfer, GPEN, and so on.

Language: Python

License: Apache-2.0

Stars: 8044

Forks: 1238

Open issues: 131

Created: 2020-06-18T10:56:01Z

Pushed: 2024-07-03T15:05:24Z

Default branch: develop

Fork: no

Archived: no

README: English | [简体中文](./README_cn.md)

PaddleGAN

PaddleGAN provides developers with high-performance implementation of classic and SOTA Generative Adversarial Networks, and supports developers to quickly build, train and deploy GANs for academic, entertainment and industrial usage.

GAN-Generative Adversarial Network, was praised by "the Father of Convolutional Networks" Yann LeCun (Yang Likun) as [One of the most interesting ideas in the field of computer science in the past decade]. It's the one research area in deep learning that AI researchers are most concerned about.

🎪 Hot Activities

• 2021.4.15~4.22

GAN 7 Days Course Camp: Baidu Senior Research Developers help you learn the basic and advanced GAN knowledge in 7 days!

Courses videos and related materials: https://aistudio.baidu.com/aistudio/course/introduce/16651

🚀 Recent Updates

• 👶 Young or Old？：[StyleGAN V2 Face Editing](./docs/en_US/tutorials/styleganv2editing.md)-Time Machine！ 👨‍🦳
• [Online Toturials](https://aistudio.baidu.com/aistudio/projectdetail/3251280?channelType=0&channel=0)

• 🔥 Latest Release: [PP-MSVSR](./docs/en_US/tutorials/video_super_resolution.md) 🔥
• Video Super Resolution SOTA models

• 😍 Boy or Girl？：[StyleGAN V2 Face Editing](./docs/en_US/tutorials/styleganv2editing.md)-Changing genders！ 😍
• [Online Toturials](https://aistudio.baidu.com/aistudio/projectdetail/2565277?contributionType=1)

• 👩‍🚀 A Space Odyssey ：[LapStyle](./docs/zh_CN/tutorials/lap_style.md) image translation take you travel around the universe👨‍🚀

• [Online Toturials](https://aistudio.baidu.com/aistudio/projectdetail/2343740?contributionType=1)

• 🧙‍♂️ Latest Creative Project：create magic/dynamic profile for your student ID in Hogwarts 🧙‍♀️

• [Online Toturials](https://aistudio.baidu.com/aistudio/projectdetail/2288888?channelType=0&channel=0)

• 💞 Add Face Morphing function💞 : you can perfectly merge any two faces and make the new face get any facial expressions!

• Tutorials: https://aistudio.baidu.com/aistudio/projectdetail/2254031

• Publish a new version of First Oder Motion model by having two impressive features:
• High resolution 512x512
• Face Enhancement
• Tutorials: https://github.com/PaddlePaddle/PaddleGAN/blob/develop/docs/zh_CN/tutorials/motion_driving.md

• New image translation ability--transfer photo into oil painting style:

• Complete tutorials for deployment: https://github.com/wzmsltw/PaintTransformer

Document Tutorial

Installation

• Environment dependence:
• PaddlePaddle >= 2.1.0
• Python >= 3.6
• CUDA >= 10.1
• Full installation tutorial

Starter Tutorial

• [Quick start](./docs/en_US/get_started.md)
• [Data Preparation](./docs/en_US/data_prepare.md)
• [Instruction of APIs](./docs/en_US/apis/apps.md)
• [Instruction of Config Files](./docs/en_US/config_doc.md)

Model Tutorial

• [Pixel2Pixel](./docs/en_US/tutorials/pix2pix_cyclegan.md)
• [CycleGAN](./docs/en_US/tutorials/pix2pix_cyclegan.md)
• [LapStyle](./docs/en_US/tutorials/lap_style.md)
• [PSGAN](./docs/en_US/tutorials/psgan.md)
• [First Order Motion Model](./docs/en_US/tutorials/motion_driving.md)
• [FaceParsing](./docs/en_US/tutorials/face_parse.md)
• [AnimeGANv2](./docs/en_US/tutorials/animegan.md)
• [U-GAT-IT](./docs/en_US/tutorials/ugatit.md)
• [Photo2Cartoon](./docs/en_US/tutorials/photo2cartoon.md)
• [Wav2Lip](./docs/en_US/tutorials/wav2lip.md)
• [Single Image Super Resolution(SISR)](./docs/en_US/tutorials/single_image_super_resolution.md)
• Including: RealSR, ESRGAN, LESRCNN, PAN, DRN
• [Video Super Resolution(VSR)](./docs/en_US/tutorials/video_super_resolution.md)
• Including: ⭐ PP-MSVSR ⭐, EDVR, BasicVSR, BasicVSR++
• [StyleGAN2](./docs/en_US/tutorials/styleganv2.md)
• [Pixel2Style2Pixel](./docs/en_US/tutorials/pixel2style2pixel.md)
• [StarGANv2](docs/en_US/tutorials/starganv2.md)
• [MPR Net](./docs/en_US/tutorials/mpr_net.md)
• [FaceEnhancement](./docs/en_US/tutorials/face_enhancement.md)
• [PReNet](./docs/en_US/tutorials/prenet.md)
• [SwinIR](./docs/en_US/tutorials/swinir.md)
• [InvDN](./docs/en_US/tutorials/invdn.md)
• [AOT-GAN](./docs/en_US/tutorials/aotgan.md)
• [NAFNet](./docs/en_US/tutorials/nafnet.md)
• [GFPGan](./docs/en_US/tutorials/gfpgan.md)
• [GPEN](./docs/en_US/tutorials/gpen.md)

Composite Application

• [Video restore](./docs/en_US/tutorials/video_restore.md)

Online Tutorial

You can run those projects in the AI Studio to learn how to use the models above:

|Online Tutorial | link | |--------------|-----------| |Motion Driving-multi-personal "Mai-ha-hi" | Click and Try | |Restore the video of Beijing hundreds years ago|Click and Try| |Motion Driving-When "Su Daqiang" sings "unravel" |Click and Try|

Examples

Face Morphing

Image Translation

Old video restore

Motion driving

Super resolution

Makeup shifter

Face cartoonization

Realistic face cartoonization

Photo animation

Lip-syncing

Changelog

• v2.1.0 (2021.12.8)
• Release a video super-resolution model PP-MSVSR and multiple pre-training weights
• Release several SOTA video super-resolution models and their pre-trained models such as BasicVSR, IconVSR and BasicVSR++
• Release the light-weight motion-driven model(Volume compression: 229M->10.1M), and optimized the fusion effect
• Release high-resolution FOMM and Wav2Lip pre-trained models
• Release several interesting applications based on StyleGANv2, such as face inversion, face fusion and face editing
• Released Baidu’s self-developed and effective style transfer model LapStyle and its interesting applications, and launched the official website [experience…