Efficient GAN-based Method for Extractive Summarization

سال انتشار: 1401
نوع سند: مقاله ژورنالی
زبان: انگلیسی
مشاهده: 172

فایل این مقاله در 12 صفحه با فرمت PDF قابل دریافت می باشد

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این مقاله:

شناسه ملی سند علمی:

JR_JECEI-10-2_003

تاریخ نمایه سازی: 20 تیر 1401

چکیده مقاله:

kground and Objectives: Text summarization plays an essential role in reducing time and cost in many domains such as medicine, engineering, etc. On the other hand, manual summarization requires much time. So, we need an automated system for summarizing. How to select sentences is critical in summarizing. Summarization techniques that have been introduced in recent years are usually greedy in the choice of sentences, which leads to a decrease in the quality of the summary. In this paper, a non-greedily method for selecting essential sentences from a text is presented.Methods: The present paper presents a method based on a generative adversarial network and attention mechanism called GAN-AM for extractive summarization. Generative adversarial networks have two generator and discriminator networks whose parameters are independent of each other. First, the features of the sentences are extracted by two traditional and embedded methods. We extract ۱۲ traditional features. Some of these features are extracted from sentence words and others from the sentence. In addition, we use the well-known Skip-Gram model for embedding. Then, the features are entered into the generator as a condition, and the generator calculates the probability of each sentence in summary. A discriminator is used to check the generated summary of the generator and to strengthen its performance. We introduce a new loss function for discriminator training that includes generator output, real and fake summaries of each document. During training and testing, each document enters the generator with different noises. It allows the generator to see many combinations of sentences that are suitable for quality summaries.Results: We evaluate our results on CNN/Daily Mail and Medical datasets. Summaries produced by the generator show that our model performs better than other methods compared based on the ROUGE metric. We apply different sizes of noise to the generator to check the effect of noise on our model. The results indicate that the noise-free model has poor results.Conclusion: Unlike recent works, in our method, the generator selects sentences non-greedily. Experimental results show that the generator with noise can produce summaries that are related to the main subject.

نویسندگان

S.V. Moravvej

Department of Electrical and Computer Engineering, Isfahan University of Technology, Isfahan, Iran.

M.J. Maleki Kahaki

Department of Electrical and Computer Engineering, University of Kashan, Kashan, Iran.

M. Salimi Sartakhti

Department of Electrical and Computer Engineering, Amirkabir University of Technology, Tehran, Iran.

M. Joodaki

Department of Electrical and Computer Engineering, Isfahan University of Technology, Isfahan, Iran.

مراجع و منابع این مقاله:

لیست زیر مراجع و منابع استفاده شده در این مقاله را نمایش می دهد. این مراجع به صورت کاملا ماشینی و بر اساس هوش مصنوعی استخراج شده اند و لذا ممکن است دارای اشکالاتی باشند که به مرور زمان دقت استخراج این محتوا افزایش می یابد. مراجعی که مقالات مربوط به آنها در سیویلیکا نمایه شده و پیدا شده اند، به خود مقاله لینک شده اند :
  • S. Samiei, M. Joodaki, N. Ghadiri, "A scalable pattern mining ...
  • S.V. Moravvej, A. Mirzaei, M. Safayani, "Biomedical text summarization using ...
  • R. Mitkov, The Oxford handbook of computational linguistics. Oxford University ...
  • I. Mani, M. Maybury, "Automatic summarization John Benjamin’s publishing Co," ...
  • M. Joodaki, N. Ghadiri, Z. Maleki, M.L. Shahreza, "A scalable ...
  • M. Kågebäck, O. Mogren, N. Tahmasebi, D. Dubhashi, "Extractive summarization ...
  • M. Jang, P. Kang, "Learning-free unsupervised extractive summarization model," IEEE ...
  • Y. Liu, P. Liu, "SimCLS: A simple framework for contrastive ...
  • Z. Cao, F. Wei, W. Li, S. Li, "Faithful to ...
  • Y. Wu, B. Hu, "Learning to extract coherent summary via ...
  • A. Abdi, S. Hasan, S.M. Shamsuddin, N. Idris, J. Piran, ...
  • S. Lamsiyah, A. El Mahdaouy, B. Espinasse, S.E.A. Ouatik, "An ...
  • S. Murarka, A. Singhal, "Query-based single document summarization using hybrid ...
  • S. Akter, A.S. Asa, M.P. Uddin, M.D. Hossain, S.K. Roy, ...
  • M. Joodaki, N. Ghadiri, A.H. Atashkar, "Protein complex detection from ...
  • T. Hirao, H. Isozaki, E. Maeda, Y. Matsumoto, "Extracting important ...
  • S.Y. Ashkoofaraz, S.N.H. Izadi, M. Tajmirriahi, M. Roshanzamir, M.A. Soureshjani, ...
  • S. Vakilian, S.V. Moravvej, A. Fanian, "Using the Artificial Bee ...
  • S. H. Mirshojaei, B. Masoomi, "Text summarization using cuckoo search ...
  • S. Vakilian, S. V. Moravvej, A. Fanian, "Using the cuckoo ...
  • F.B. Goularte, S.M. Nassar, R. Fileto, H. Saggion, "A text ...
  • W.S. El-Kassas, C.R. Salama, A.A. Rafea, H.K. Mohamed, "EdgeSumm: Graph-based ...
  • S.V. Moravvej, M. Joodaki, M.J.M. Kahaki, M.S. Sartakhti, "A method ...
  • M.S. Sartakhti, M.J.M. Kahaki, S.V. Moravvej, M. javadi Joortani, A. ...
  • S.V. Moravvej, M.J.M. Kahaki, M.S. Sartakhti, A. Mirzaei, "A method ...
  • H. Liang, X. Sun, Y. Sun, Y. Gao, "Text feature ...
  • Z. Cao, F. Wei, L. Dong, S. Li, M. Zhou, ...
  • R. Nallapati, F. Zhai, B. Zhou, "Summarunner: A recurrent neural ...
  • J.Á. González, E. Segarra, F. García-Granada, E. Sanchis, L.ı.F. Hurtado, ...
  • K. Al-Sabahi, Z. Zuping, M. Nadher, "A hierarchical structured self-attentive ...
  • W. Nie, N. Narodytska, A. Patel, "Relgan: Relational generative adversarial ...
  • M. Lewis, A. Fan, "Generative question answering: Learning to answer ...
  • T. Vo, "SGAN۴AbSum: A Semantic-Enhanced Generative Adversarial Network for Abstractive ...
  • R. Paulus, C. Xiong, R. Socher, "A deep reinforced model ...
  • M. Moradi, "Frequent itemsets as meaningful events in graphs for ...
  • Z. Wu, R. Koncel-Kedziorski, M. Ostendorf, H. Hajishirzi, "Extracting summary ...
  • T. Safavi, C. Belth, L. Faber, D. Mottin, E. Müller, ...
  • R. Mihalcea, P. Tarau, "Textrank: Bringing order into text," in ...
  • S. H. Zhong, Y. Liu, B. Li, J. Long, "Query-oriented ...
  • M. Yousefi-Azar, L. Hamey, "Text summarization using unsupervised deep learning," ...
  • S. V. Moravvej, S.J. Mousavirad, M.H. Moghadam, M. Saadatmand, "An ...
  • Q. Dou, Y. Lu, P. Manakul, X. Wu, M.J. Gales, ...
  • Y. Zhang, Y. Peng, "Research on answer selection based on ...
  • J. Devlin, M.W. Chang, K. Lee, K. Toutanova, "Bert: Pre-training ...
  • Y. Liu, "Fine-tune BERT for extractive summarization," arXiv preprint arXiv:۱۹۰۳.۱۰۳۱۸, ...
  • Y. Liu and M. Lapata, "Text summarization with pretrained encoders," ...
  • I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, ...
  • M. Mirza, S. Osindero, "Conditional generative adversarial nets," arXiv preprint ...
  • T. Mikolov, K. Chen, G. Corrado, J. Dean, "Efficient estimation ...
  • K. M. Hermann, T. Kocisky, E. Grefenstette, L. Espeholt, W. ...
  • C.Y. Lin, "Rouge: A package for automatic evaluation of summaries," ...
  • نمایش کامل مراجع