AIFFEL Life

[Day73] 번역가는 대화에도 능하다

nevermet 2020. 12. 26. 15:19

오늘은 자연어처리 심화과정 실습을 하는 날이었습니다. 그동안 번역하는 딥러닝 모델을 발전시켜오고 있었는데, 이번엔 질문을 하면 대답하는 딥러닝을 Transformer를 이용하여 만들어 보는 시간이었습니다. 유용한 자료를 아래에 공유합니다.

1. 흙수저 대학생에서 데드풀 신드롬을 일으킨 영화 번역가가 되다 [번역가 황석희]

www.youtube.com/watch?v=8zfYINYNS38

2. Konlpy install

konlpy.org/ko/latest/install/

 

설치하기 — KoNLPy 0.5.2 documentation

우분투 Supported: Xenial(16.04.3 LTS), Bionic(18.04.3 LTS), Disco(19.04), Eoan(19.10) Install dependencies # Install Java 1.8 or up $ sudo apt-get install g++ openjdk-8-jdk python3-dev python3-pip curl Install KoNLPy $ python3 -m pip install --upgrade p

konlpy.org

3. SentencePiece (github)

github.com/google/sentencepiece

 

google/sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation. - google/sentencepiece

github.com

4. 트랜스포머(Transformer)

wikidocs.net/31379

 

위키독스

온라인 책을 제작 공유하는 플랫폼 서비스

wikidocs.net

5. Transformer (Attention Is All You Need) 구현하기 1

paul-hyun.github.io/transformer-01/

 

Transformer (Attention Is All You Need) 구현하기 (1/3)

How to implement the transformer model

paul-hyun.github.io

6. Transformer (Attention Is All You Need) 구현하기 2

paul-hyun.github.io/transformer-02/

 

Transformer (Attention Is All You Need) 구현하기 (2/3)

How to implement the transformer model

paul-hyun.github.io

7. Transformer (Attention Is All You Need) 구현하기 3

paul-hyun.github.io/transformer-03/

 

Transformer (Attention Is All You Need) 구현하기 (3/3)

How to implement the transformer model

paul-hyun.github.io

8. Transformer with Python and TensorFlow 2.0 – Attention Layers

rubikscode.net/2019/08/05/transformer-with-python-and-tensorflow-2-0-attention-layers/

 

Transformer with Python and TensorFlow 2.0 - Attention Layers

In this and next couple of articles we will be able to see how one can implement one of these monumental architectures.

rubikscode.net

9. gensim-data

github.com/RaRe-Technologies/gensim-data

 

RaRe-Technologies/gensim-data

Data repository for pretrained NLP models and NLP corpora. - RaRe-Technologies/gensim-data

github.com

10. Chatbot_data

github.com/songys/Chatbot_data

 

songys/Chatbot_data

Chatbot_data_for_Korean. Contribute to songys/Chatbot_data development by creating an account on GitHub.

github.com

11. wordvectors

github.com/Kyubyong/wordvectors

 

Kyubyong/wordvectors

Pre-trained word vectors of 30+ languages. Contribute to Kyubyong/wordvectors development by creating an account on GitHub.

github.com