codertimo/BERT-pytorch: Google AI 2018 BERT pytorch implementation

5355

STARS

124

WATCHERS

1192

FORKS

ISSUES

BERT-pytorch's Language Statistics

codertimo's Other Repos

codertimo/KorQuAD-Question-Generation: question generation model with KorQuAD dataset

Last Updated: 2021-10-02
codertimo/han2jamo: 한글을 자모로 바꿔주는 가장 빠른 라이브러리

Last Updated: 2022-01-01
codertimo/ngrok-clone: clone version of ngrok with @GBS-Skile (GO lang side project)

Last Updated: 2022-01-01
codertimo/wikiextractor: A tool for extracting plain text from Wikipedia dumps

Last Updated: 2021-10-07
codertimo/paper-log: 읽어야 하는 논문들을 관리하고, 읽은 논문들의 기록을 남기는 공간

Last Updated: 2021-10-05
codertimo/go-study: GO language practice

Last Updated: 2021-12-25
codertimo/codertimo: Lightweight CV

Last Updated: 2021-12-26
codertimo/python-template: python project template for personal projects! 🙋‍♀️

Last Updated: 2022-07-23
codertimo/ELMO-tf: ELMO tensorflow implementation

Last Updated: 2021-12-25
codertimo/Vision: Sidewalk Detection Algorithm based on Line Detection

Last Updated: 2022-01-06
codertimo/Universal-Transformer:

Last Updated: 2022-07-17
codertimo/korean2num: 한글숫자 -> 숫자

Last Updated: 2021-12-26
codertimo/Ransomware: Java 기반 랜섬웨어 바이러스 Encryptor와 Decrypter

Last Updated: 2022-07-28
codertimo/Tensorflow-Study: Code of TensorFlow Study : Sung Kim's 모두를 위한 딥러닝

Last Updated: 2021-09-06
codertimo/ConveRT-pytorch: ConveRT Paper Pytorch Implementation

Last Updated: 2022-05-25
codertimo/BERT-pytorch: Google AI 2018 BERT pytorch implementation

Last Updated: 2023-03-03

Star history of BERT-pytorch

Issue history of BERT-pytorch

BERT-pytorch Recent Issues

Issue Title	State	Comments	Created Date	Updated Date	Closed Date
how to fine tune model with trained weight	open	0	2023-01-10	2023-02-24	-
What dataset did you use to train model?	open	1	2022-10-19	2023-02-24	-
why specify `ignore_index=0` in the NLLLoss function in BERTTrainer?	open	1	2022-07-07	2023-03-07	-
Pooler layer?	open	0	2022-01-17	2022-01-17	-
It keeps trying to use CUDA despite --with_cuda False option	open	0	2021-11-05	2023-02-24	-
dataset / dataset.py have one erro?	open	0	2021-08-22	2023-02-24	-
Why not use torch.no_grad when evaluating test data?	open	1	2021-07-03	2023-02-24	-
why language_model.py has different vectors	open	1	2021-06-27	2023-03-17	-
The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.	open	0	2021-03-23	2023-02-24	-
IndexError	open	2	2021-03-05	2022-01-10	-
In Next Sentence Prediction task,the original code may choose the same line when you try to use the negative sample	open	0	2020-12-07	2023-03-19	-
transformer.py 中的forword方法调用的SublayerConnection类。实现残差链接和标准化的实现	open	1	2020-09-23	2023-03-23	-
embedding/position.py with RuntimeError if d_model is odd	open	2	2020-06-15	2023-02-24	-
predict next sentence ony? it also can do SQA assignments?	open	0	2019-10-22	2023-02-05	-
Did you have tried to use ipdb to set breakpoint in __get__item__, which is a funtion from BERTDataset	open	1	2019-10-21	2023-03-06	-
Vocab's load_vectors seems to be an old method?	open	0	2019-10-08	2023-03-08	-
Fix Bug in getting random line	open	0	2019-06-14	2022-12-23	-
Erroneous Code	open	0	2019-06-10	2021-12-25	-
How can I finetune with this project	open	5	2019-04-11	2023-02-24	-
self.d_k = d_model // h gives 64 dimension ?	open	1	2019-04-07	2023-02-16	-
will "random.randint(self.corpus_lines if self.corpus_lines < 1000 else 1000)" report error?	open	1	2019-02-20	2023-02-24	-
made a script to generate bert pre-train data	open	0	2018-12-20	2023-01-01	-
Making Wikipedia Corpus	open	1	2018-10-30	2023-02-28	-
the format of input	open	4	2018-10-29	2022-01-10	-
Pretrained model transfer to pytorch	open	8	2018-10-24	2022-12-21	-
how to get dataset.small from corpus.small	closed	1	2018-10-23	2022-12-27	2018-10-23
How to embedding segment lable	closed	3	2018-10-22	2023-02-24	2018-10-24
Is there any result?	closed	1	2018-10-18	2023-02-20	2018-10-18
Is it possible to train BERT?	open	7	2018-10-17	2023-02-26	-