-
[Day73] 번역가는 대화에도 능하다AIFFEL Life 2020. 12. 26. 15:19
오늘은 자연어처리 심화과정 실습을 하는 날이었습니다. 그동안 번역하는 딥러닝 모델을 발전시켜오고 있었는데, 이번엔 질문을 하면 대답하는 딥러닝을 Transformer를 이용하여 만들어 보는 시간이었습니다. 유용한 자료를 아래에 공유합니다.
1. 흙수저 대학생에서 데드풀 신드롬을 일으킨 영화 번역가가 되다 [번역가 황석희]
www.youtube.com/watch?v=8zfYINYNS38
2. Konlpy install
설치하기 — KoNLPy 0.5.2 documentation
우분투 Supported: Xenial(16.04.3 LTS), Bionic(18.04.3 LTS), Disco(19.04), Eoan(19.10) Install dependencies # Install Java 1.8 or up $ sudo apt-get install g++ openjdk-8-jdk python3-dev python3-pip curl Install KoNLPy $ python3 -m pip install --upgrade p
konlpy.org
3. SentencePiece (github)
github.com/google/sentencepiece
google/sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation. - google/sentencepiece
github.com
4. 트랜스포머(Transformer)
위키독스
온라인 책을 제작 공유하는 플랫폼 서비스
wikidocs.net
5. Transformer (Attention Is All You Need) 구현하기 1
paul-hyun.github.io/transformer-01/
Transformer (Attention Is All You Need) 구현하기 (1/3)
How to implement the transformer model
paul-hyun.github.io
6. Transformer (Attention Is All You Need) 구현하기 2
paul-hyun.github.io/transformer-02/
Transformer (Attention Is All You Need) 구현하기 (2/3)
How to implement the transformer model
paul-hyun.github.io
7. Transformer (Attention Is All You Need) 구현하기 3
paul-hyun.github.io/transformer-03/
Transformer (Attention Is All You Need) 구현하기 (3/3)
How to implement the transformer model
paul-hyun.github.io
8. Transformer with Python and TensorFlow 2.0 – Attention Layers
rubikscode.net/2019/08/05/transformer-with-python-and-tensorflow-2-0-attention-layers/
Transformer with Python and TensorFlow 2.0 - Attention Layers
In this and next couple of articles we will be able to see how one can implement one of these monumental architectures.
rubikscode.net
9. gensim-data
github.com/RaRe-Technologies/gensim-data
RaRe-Technologies/gensim-data
Data repository for pretrained NLP models and NLP corpora. - RaRe-Technologies/gensim-data
github.com
10. Chatbot_data
github.com/songys/Chatbot_data
songys/Chatbot_data
Chatbot_data_for_Korean. Contribute to songys/Chatbot_data development by creating an account on GitHub.
github.com
11. wordvectors
github.com/Kyubyong/wordvectors
Kyubyong/wordvectors
Pre-trained word vectors of 30+ languages. Contribute to Kyubyong/wordvectors development by creating an account on GitHub.
github.com
'AIFFEL Life' 카테고리의 다른 글
[Day75] 해커톤 5번째 (0) 2020.12.26 [Day74] 용종을 검출하는 인공지능 (0) 2020.12.26 [Day72] 퀴즈 푸는 인공지능 (0) 2020.12.26 [Day70] 해커톤 4번째 (0) 2020.12.25 [Day69] 음성도 트랜스포머로... (0) 2020.12.25