Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
fe85ad4
feat: add script for AIHub data preprocessing
sdlvkqmv Jan 7, 2026
32a4692
forked av2av, speech-resynthesis
sdlvkqmv Jan 11, 2026
4038aee
added fairseq as submodule
sdlvkqmv Jan 11, 2026
6b7831b
CodeHiFiGANModel_spk에서 훈련 로직 추가 : 훈련시 code duration 처리하도록 forward 수정
sdlvkqmv Jan 11, 2026
d1e5472
generator로 CodeHiFiGANModel_spk 받도록하는 훈련 스크립트 추가
sdlvkqmv Jan 11, 2026
7ab99d1
update gitignore, notebooks
sdlvkqmv Jan 11, 2026
0453e24
checkpoint 확인 노트북
sdlvkqmv Jan 15, 2026
3722379
changed dependencies and directories
sdlvkqmv Jan 15, 2026
a972449
changed gitignore
sdlvkqmv Jan 16, 2026
2581bd2
adding speech resynthesis as submodule
sdlvkqmv Jan 16, 2026
0e14acd
add submodules
sdlvkqmv Jan 16, 2026
e760696
학습 스크립트 의존성 환경
sdlvkqmv Jan 16, 2026
47019bf
dependency checlk
sdlvkqmv Jan 16, 2026
62414c3
Update readme
sdlvkqmv Jan 16, 2026
7f0c93b
Revise README for cloning and setup instructions
sdlvkqmv Jan 16, 2026
b32cb0a
Update README.md
sdlvkqmv Jan 16, 2026
e99873d
modified to receive unit.pt files as input data
sdlvkqmv Jan 17, 2026
fcdcdcd
feat: script for processing data path into manifest
sdlvkqmv Jan 17, 2026
d7ca6b5
changed logic error
sdlvkqmv Jan 17, 2026
fc2940a
added train-val data path cofig
sdlvkqmv Jan 17, 2026
49b5cf9
changed data loading to map onto cpu first
sdlvkqmv Jan 17, 2026
6bacf88
Delete av2av-main/unit2av/config_test.json
sdlvkqmv Jan 17, 2026
4dc8b66
config set for train script (added data path)
sdlvkqmv Jan 17, 2026
d800c7c
어디 수정했는지 명확히 보이도록 바꿈
sdlvkqmv Jan 17, 2026
6f24718
feat: added parser logic
sdlvkqmv Jan 17, 2026
9452087
Revise README for environment setup and training
sdlvkqmv Jan 17, 2026
545361b
feat: added best model saving logic
sdlvkqmv Feb 6, 2026
8e16886
fix: logic fix for mel_spectrogram func
sdlvkqmv Feb 6, 2026
dc2cf82
feat : save_video function - if input bbox is None, write original fr…
sdlvkqmv Feb 6, 2026
dcbd55a
docs: Update project README and add documentation for unit2av.
sdlvkqmv Feb 6, 2026
533be84
change train_unit2a directory
sdlvkqmv Feb 6, 2026
a68c2a5
docs: Add README for lip detection and extraction scripts.
sdlvkqmv Feb 6, 2026
67696da
docs: update project documentation in README.
sdlvkqmv Feb 6, 2026
b81dfcd
feat: Add lip extraction Conda environment and documentation.
sdlvkqmv Feb 6, 2026
9a7740c
Rename
sdlvkqmv Feb 6, 2026
fbcd64a
rename
sdlvkqmv Feb 6, 2026
8cba743
changed directory
sdlvkqmv Feb 6, 2026
9055965
change readme
sdlvkqmv Feb 6, 2026
f5c4b1b
environment setting guide added
sdlvkqmv Feb 6, 2026
245aaad
feat: added korean option for target lang
sdlvkqmv Feb 6, 2026
5dbd096
깃 정리중
sdlvkqmv Feb 8, 2026
a3f18d0
feat: Changed FaceRenderer checkpoint loading logic for matching inpu…
sdlvkqmv Feb 8, 2026
7910592
Changed inference file name to match its purpose
sdlvkqmv Feb 8, 2026
8067d88
added Script for training unit2a
sdlvkqmv Feb 8, 2026
e1053df
changed name to match its purpose
sdlvkqmv Feb 8, 2026
2b51c12
Changed import logic
sdlvkqmv Feb 8, 2026
7f7a731
CHanged directory and import logic
sdlvkqmv Feb 8, 2026
45006e0
Change README
sdlvkqmv Feb 8, 2026
9cd9824
Delete unnecessary resoureces
sdlvkqmv Feb 8, 2026
5a6821e
deleted unnecessary resources
sdlvkqmv Feb 8, 2026
d3588fb
Changed directory structure
sdlvkqmv Feb 8, 2026
23714fc
changed readme name
sdlvkqmv Feb 8, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
23 changes: 23 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
*.png
*.jpg
*.csv
*.mp4

*.env

*.zip

__pycache__/
*.pyc

data/

*.pt
*.pth

*.wav
*.tar
*.bin

.conda/
.venv/
3 changes: 3 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[submodule "fairseq"]
path = fairseq
url = https://github.com/facebookresearch/fairseq.git
6 changes: 0 additions & 6 deletions README.md

This file was deleted.

28 changes: 28 additions & 0 deletions README_environment.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
# 1. 환경 설정
```bash
# 1. 레포지토리 클론
git clone https://github.com/Prometheus-AI-3team/NetfLips.git

cd NetfLips

# 2. 서브모듈(fairseq) update
git submodule init
git submodule update

# 2. Conda 기본 환경 생성
conda env create -f environment.yml
conda activate unit2a

# 3. Pip 다운그레이드 (메타데이터 에러 방지)
pip install "pip<24.1"

# 4. PyTorch 설치 (CUDA 11.7 기준)
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1+cu117 --extra-index-url https://download.pytorch.org/whl/cu117

# 5. 나머지 라이브러리 설치
pip install -r requirements.txt

# 6. Fairseq 설치
cd av2av-main/fairseq
pip install -e .
```
10 changes: 10 additions & 0 deletions av2unit/avhubert/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
# Copyright (c) Facebook, Inc. and its affiliates.
#
# This source code is licensed under the MIT license found in the
# LICENSE file in the root directory of this source tree.

from .hubert import * # noqa
# from .hubert_asr import * # noqa
from .hubert_dataset import *
from .hubert_pretraining import *
# from .hubert_criterion import *
Loading