Preferred Language
Articles
/
GheZh5IBVTCNdQwCRLMn
Improving Pre-trained CNN-LSTM Models for Image Captioning with Hyper-Parameter Optimization
...Show More Authors

The issue of image captioning, which comprises automatic text generation to understand an image’s visual information, has become feasible with the developments in object recognition and image classification. Deep learning has received much interest from the scientific community and can be very useful in real-world applications. The proposed image captioning approach involves the use of Convolution Neural Network (CNN) pre-trained models combined with Long Short Term Memory (LSTM) to generate image captions. The process includes two stages. The first stage entails training the CNN-LSTM models using baseline hyper-parameters and the second stage encompasses training CNN-LSTM models by optimizing and adjusting the hyper-parameters of the previous stage. Improvements include the use of a new activation function, regular parameter tuning, and an improved learning rate in the later stages of training. The experimental results on the flickr8k dataset showed a noticeable and satisfactory improvement in the second stage, where a clear increment was achieved in the evaluation metrics Bleu1-4, Meteor, and Rouge-L. This increment confirmed the effectiveness of the alterations and highlighted the importance of hyper-parameter tuning in improving the performance of CNN-LSTM models in image caption tasks.

Crossref
View Publication
Publication Date
Sat Sep 01 2018
Journal Name
Polyhedron
Novel dichloro (bis {2-[1-(4-methylphenyl)-1H-1, 2, 3-triazol-4-yl-κN3] pyridine-κN}) metal (II) coordination compounds of seven transition metals (Mn, Fe, Co, Ni, Cu, Zn and Cd)
...Show More Authors

Preview PDF
Publication Date
Sat Oct 01 2022
Journal Name
Environmental Advances
Stability and performance studies of emulsion liquid membrane on pesticides removal using mixture of Fe3O4Â nanoparticles and span80
...Show More Authors

View Publication Preview PDF
Scopus (11)
Crossref (9)
Scopus Crossref