Image captioning using neural networks

Image Captioning ( Use Python Jupyter Notebook )

—————–

Prepare one python notebook to build, train and evaluate model (TensorFlow or TensorFlow.Keras library recommended) on the datasets given below.

Image Captioning is the process of generating textual description of an image. It uses both Natural Language Processing and Computer Vision to generate the captions. The dataset will be in the form [image → captions]. The dataset consists of input images and their corresponding output captions.

Data Processing

—————

Read the pickle file (https://drive.google.com/file/d/1YX_ossqpLuYZxER4b91eFphhKRTf3U6H/view?usp=sharing) and convert the data into the correct format which could be used for ML model. 

Pickle file contains the image id and the text associated with the image.

Eg: ‘319847657_2c40e14113.jpg#0tA girl in a purple shirt hold a pillow .

Each image can have multiple captions.

319847657_2c40e14113.jpg -> image name

#0 -> Caption ID

t  -> separator between Image name and Image Caption

A girl in a purple shirt hold a pillow . -> Image Caption

Corresponding image wrt image name can be found in the image dataset folder.

Image dataset Folder : https://drive.google.com/file/d/1AZ213vTwLTzRLqbuh-zpv8Jkl_-N2_2m/view?usp=sharing

Plot at least two samples and their captions (use matplotlib/seaborn/any other library). 

Bring the train and test data in the required format. 

Model Building

—————

Use Pretrained Resnet-50 model trained on ImageNet dataset (available publicly on google) for image feature extraction.

Create 5 layered LSTM layer model and other relevant layers for image caption generation.

Add L1 regularization to all the LSTM layers. 

Add one layer of dropout at the appropriate position and give reasons. 

Choose the appropriate activation function for all the layers. 

Print the model summary. 

Model Compilation

——————

Compile the model with the appropriate loss function. 

Use an appropriate optimizer. Give reasons for the choice of learning rate and its value.

Model Training

————–

Train the model for an appropriate number of epochs. Print the train and validation loss for each epoch. Use the appropriate batch size. 

Plot the loss and accuracy history graphs for both train and validation set. Print the total time taken for training. 

Model Evaluation

—————

Take a random image from google and generate caption for that image.

Place your order
(550 words)

Approximate price: $22

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
$26
The price is based on these factors:
Academic level
Number of pages
Urgency
Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

Delivering a high-quality product at a reasonable price is not enough anymore.
That’s why we have developed 5 beneficial guarantees that will make your experience with our service enjoyable, easy, and safe.

Money-back guarantee

You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.

Read more

Zero-plagiarism guarantee

Each paper is composed from scratch, according to your instructions. It is then checked by our plagiarism-detection software. There is no gap where plagiarism could squeeze in.

Read more

Free-revision policy

Thanks to our free revisions, there is no way for you to be unsatisfied. We will work on your paper until you are completely happy with the result.

Read more

Privacy policy

Your email is safe, as we store it according to international data protection rules. Your bank details are secure, as we use only reliable payment systems.

Read more

Fair-cooperation guarantee

By sending us your money, you buy the service we provide. Check out our terms and conditions if you prefer business talks to be laid out in official language.

Read more