International Scientific Journal of Engineering and Management

An International Scholarly || Multidisciplinary || Open Access || Indexing in all major Database & Metadata
ISSN: 2583-6129

Impact Factor: 6.674

Maximizing video Data Retrieval Efficiency: Leveraging Lang Chain Integration of RAG with Cohere Reranker for Enhance Performance

  • Version
  • Download 41
  • File Size 435.27 KB
  • File Count 1
  • Create Date 12 June 2024
  • Last Updated 12 June 2024

Maximizing video Data Retrieval Efficiency: Leveraging Lang Chain Integration of RAG with Cohere Reranker for Enhance Performance

MUKKU SUMANTH

B-TECH CSE AMITY UNIVERSITY CHHATTISGARH, INDIA

Abstract - This paper addresses cutting-edge artificial intelligence and natural language processing algorithms for extracting and organizing material from videos.

Audio from videos is extracted, texts are transcribed, and PDFs are generated. The text is split using PyPDFLoader and Lang Chain’s Recursive Character Text Splitter. FAISS and embeddings provide fast similarity searches, while Cohere Reranker uses LLMs to boost search result relevancy. The "command-r" technique in Cohere simplifies the creation of question- and-answer apps. Markdown and qa.invoke are used in the last stage to generate acceptable responses. The results show how well these techniques improve query resolution and multimodal information retrieval.

Key Words: LLM, NLP, Cohere API, RAG


Download

Author's Blog

What is the difference between a Research Paper and a Review Paper?

A research paper and a review paper are both scholarly documents, but they serve different purposes and have different characteristics.research...
Read More
Author's Blog

What is DOI?

A Digital Object Identifier (DOI) is a unique alphanumeric string that is used to identify and provide a persistent link...
Read More
Author's Blog

What do you need to do during production of your Research Paper?

During the production of a research paper, the following steps need to be taken: conducting research, organizing and analyzing data,...
Read More
Author's Blog

What are the advantages of publishing a research paper?

Publishing a research paper can have many advantages for researchers, including: Career advancement, professional recognition, opportunities for collaboration, increased visibility,...
Read More
Author's Blog

Ways to Support your Academic Wellbeing which preparing the Research Paper/Article

To support your academic wellbeing while publishing a research paper, it's important to set realistic goals, manage your time effectively,...
Read More
Author's Blog

How to improve your Research Paper writing Skills?

Read extensively: One of the best ways to improve your research paper skills is to read extensively in your field...
Read More
Author's Blog

Is DOI compulsory to publish a research paper in a Journal?

DOI is not strictly required to publish a research paper, but it is highly recommended. Basically, the International Scientific Journal...
Read More
Author's Blog

In what ways does research paper give weight to career development?

Publishing a research paper can give weight to a researcher's career development in several ways, such as: establishing oneself as...
Read More
Author's Blog

How to develop a Research Paper from Scratch

Developing a research paper involves several steps including: choosing a topic, conducting background research, formulating a research question or hypothesis,...
Read More
Author's Blog

How Plagiarism report plays crucial role in Research Paper Publication?

Plagiarism is a major concern in the academic and research community, as it undermines the integrity of the research and...
Read More