Uncategorized

Understanding the world from a first-person perspective is essential in Augmented Reality (AR), as it introduces unique challenges and significant visual transformations compared to third-person views. While synthetic data has greatly benefited vision models in third-person views, its utilization in tasks involving embodied egocentric perception still needs to be explored. A major obstacle in this…

Text-to-image (T2I) generation is a rapidly evolving field within computer vision and artificial intelligence. It involves creating visual images from textual descriptions blending natural language processing and graphic visualization domains. This interdisciplinary approach has significant implications for various applications, including digital art, design, and virtual reality. Various methods have been proposed for controllable text-to-image generation,…

Foundational models are large deep-learning neural networks that are used as a starting point to develop effective ML models. They rely on large-scale training data and exhibit exceptional zero/few-shot performance in numerous tasks, making them invaluable in the field of natural language processing and computer vision. Foundational models are also used in Monocular Depth Estimation…

Natural Language Processing (NLP) is one area where Large transformer-based Language Models (LLMs) have achieved remarkable progress in recent years. Also, LLMs are branching out into other fields, like robotics, audio, and medicine. Modern approaches allow LLMs to produce visual data using specialized modules like VQ-VAE and VQ-GAN, which convert continuous visual pixels into discrete…

In advanced machine learning, Retrieval-Augmented Generation (RAG) systems have revolutionized how we approach large language models (LLMs). These systems extend the capabilities of LLMs by integrating an Information Retrieval (IR) phase, which allows them to access external data. This integration is crucial, as it enables the RAG systems to overcome the limitations faced by standard…

Optimizing code through abstraction in software development is not just a practice but a necessity. It leads to streamlined processes, where reusable components simplify tasks, increase code readability, and foster reuse. The development of generalizable abstractions, especially in automated program synthesis, stands at the forefront of current research endeavors. Traditionally, Large Language Models (LLMs) have…

Large Language Models (LLMs) have gathered a massive amount of attention and popularity among the Artificial Intelligence (AI) community in recent months. These models have demonstrated great capabilities in tasks including text summarization, question answering, code completion, content generation, etc.  LLMs are frequently trained on inadequate web-scraped data. Most of the time, this data is…

Creating effective pipelines, especially using RAG (Retrieval-Augmented Generation), can be quite challenging in information retrieval. These pipelines involve various components, and choosing the right models for retrieval is crucial. While dense embeddings like OpenAI’s text-ada-002 serve as a good starting point, recent research suggests that they might not always be the optimal choice for every…

Mobile device agents utilizing Multimodal Large Language Models (MLLM) have gained popularity due to the rapid advancements in MLLMs, showcasing notable visual comprehension capabilities. This progress has made MLLM-based agents viable for diverse applications. The emergence of mobile device agents represents a novel application, requiring these agents to operate devices based on screen content and…

Large language models (LLMs) have become a prominent force in the rapidly evolving landscape of artificial intelligence. These models, built primarily on Transformer architectures, have expanded AI’s capabilities in understanding and generating human language, leading to diverse applications. Yet, a notable challenge in this realm is enhancing LLMs for creative writing. While proficient in various…