The invention discloses a parallel image description method based on a multi-layer encoder, and relates to the technical field of computer vision. The method comprises the steps of: inputting a to-be-described image; encoding the image to obtain multiple layers of features; performing dimension transformation on each layer of features to reduce the dimensions of the features; and inputting the multiple layers of features after dimension transformation into a decoder, and performing parallel decoding processing on the multiple layers of features to obtain corresponding image description. The multiple layers of features output by an encoder are input into the decoder in a sequential or reverse parallel mode, semantic description of all layers of targets in the image is generated, and the fine-grained description requirement is met.

Parallel image description method based on multi-layer encoder

The present application provides an image description method and apparatus, a computing device, and a storage medium. Said method comprises: performing feature extraction on a target image by means of a plurality of first feature extraction models, so as to obtain image features generated by each first feature extraction model; performing fusion processing on the image features generated by the plurality of first feature extraction models, so as to generate global image features corresponding to the target image; performing feature extraction on the target image by means of a second feature extraction model, so as to obtain target detection features corresponding to the target image; and inputting, into a translation model, the global image features and the target detection features which correspond to the target image, and taking the generated translation sentence as a description sentence of the target image. Thus, in a subsequent process of inputting, into the translation model, the global image features and the target detection features which correspond to the target image to generate a translation sentence, the global image features having richer image information are taken as references, such that the outputted translation sentence is more accurate.

Image description method and apparatus, computing device, and storage medium

The invention provides an image description method and device, and the method comprises the steps: carrying out the feature extraction of a target image through employing a plurality of first featureextraction models, and obtaining the image features generated by each first feature extraction model; performing fusion processing on the image features generated by the plurality of first feature extraction models to generate global image features corresponding to the target image; performing feature extraction on the target image by using a second feature extraction model to obtain a target detection feature corresponding to the target image; inputting the global image feature and the target detection feature corresponding to the target image into a translation model, and using the generatedtranslation statement as a description statement of the target image, so that in the subsequent process of inputting the global image characteristics corresponding to the target image and the targetdetection characteristics into the translation model to generate the translation statement, the global image characteristics of the image information are richer as a reference, and the output translation statement is more accurate.

Image description method and device

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Liao Minpeng

Author Tools

Chat about Author

Papers

Image description method and device

Image description method and apparatus, computing device, and storage medium