페이지

2022년 5월 17일 화요일

1.4.2 Natural Language Processing

 Machine Translation. In the past, machine translation algorithms were usually based on statistical machine translation models, which were also the technology used by Google's translation system before 2016. In November 2016, Google launched the Google Neural Machine Translation(GNMT) system based on the Seq2Seq model. For the first time, the direct translation technology from source lanuage to target language was realized with 50~90% improvement on multiple tasks. Commonly used machine translation models are Seq2Seq, BERT, GPT, and GPT-2, Among them, the GPT-2 model proposed by OpenAI has about 1.5 billion parameters. At the begining, OpenAI refused to open-source the GPT-2 model due to technical security reasons. Chatbot is also a mainstream task of natural language processing. Machines automatically learn to talk to humans, provide satisfactory automatic responses to simple human demands, and improve customer service efficiency and service quality. Chatbot is often used in consulting esystems, entertrainment systems, and smart homes.

댓글 없음: