Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.
Abstract
The study aims to identify the extent to which the applied colleges at the University of Technology and Applied Sciences meet the comprehensive quality standards in light of the national education strategy for the 2040 Vision in the Sultanate of Oman. To do this, the researchers used the descriptive approach. They used a questionnaire as a tool for data collection that was applied to (237) administrators, academics, and support functions. The study found that the extent to which the applied colleges at the University of Technology and Applied Sciences meet the comprehensive quality standards in the light of the National Education Strategy 2040 in the Sultanate of Oman recorded a high range. The study als
... Show MoreThe aim of the research is to evaluate the response of the researched leaders towards practicing the concept of the lens, which is its dimensions with (stakeholders, resource mobilization, knowledge development, culture management) and the nature of its relationship to tax pioneer performance represented in its dimensions (strategic direction, leadership indicators, growth, renewal and modernization, efficiency, Effectiveness) The questionnaire was approved as a main tool in collecting data and information from the sample members in the General Authority of Taxes, which number (91) Who are on (M. General Manager, Division Director, Deputy Director, Senior Division Director, Deputy Director, Second Division, Division Officer, M. D
... Show MoreThe follower to study the markets in the Islamic Mashreq (Iraq, Persia and the country of Ma
Behind the river for the period from the reign of the Prophet Muhammad until the end of the Islamic era) to find that there
A remarkable development in the pattern, shape, planning and privatization of markets
Islamic cities and places are the main conditions for their existence, which is the mosque of the mosque
And markets, and these markets have evolved from being a space in which there are no building and no ceilings to shade them in
The places of sale and purchase to specialized markets classified according to the materials and goods produced in them
This would facilitate the task of supervising it by the market factor and
The purpose of the current work was to evaluate the effect of Radiation of Gamma on the superconducting characteristics of the compound PbBr2Ca1.9Sb0.1Cu3O8+δ utilizing a 137Cs source at doses of 10, 15, and 20MRad. Solid state reaction technology was used to prepare the samples. Before and after irradiation, X-ray diffraction (XRD) and superconductor properties were examined. Results indicated that the tetragonal structure of our chemical corresponds to the Pb-1223 phase with an increase in the ratio c/a as a result of gamma irradiation. (Tc (onset) ) and on set temperature Tc (offset)) were also dropping from 113 to the 85.6 K and 129.5 to 97 K, respectively, for a transition temperatu
This research seeks to study the role of proactive leadership as an essential element that helps all federations that lead the wheel of sports, including the Iraqi Handball Federation, so that it builds a correct environment that helps manage the organizational errors that the Handball Federation may fall into, and this in turn helps in early detection of errors and obstacles that may occur. It is likely that the Federation will fall into the process of managing and organizing the Iraqi Handball League, in addition to increasing the clubs’ ability to assist the Iraqi Handball Federation by being proactive so as not to make mistakes. The research community included the administrative bodies of the clubs participating in the Iraqi E
... Show MoreLas diferencias entre el pretérito perfecto simple y el imperfecto son uno de los temas más complejos de la lengua española, no sólo para el estudiante, sino para el profesor, puesto que sistematizar los casos y hacerlos fácilmente comprensibles al alumno es tarea difícil. Los profesores de lengua, cuyas investigaciones han dado lugar a una serie de teorías y de corrientes metodológicas y didácticas que permiten enfocar la enseñanza de una lengua extranjera de manera muy distinta a como se hacía tradicionalmente. Vamos a repasar muy brevemente cuáles son estas teorías.
En primer lugar es necesario señalar en qué consiste el aprendizaje de una segunda lengua:
"El aprendizaje de una segunda lengua (L2) es el
... Show MoreThis study aims to examine the sources of organizational power prevailing among the academic leaders at the University of Tabuk from the faculty members’ viewpoint. The purposes behind such an aim are: to reveal the level of administrative and technical institutional creativity, the nature of the relationship between the reality of organizational power and the level of institutional creativity, and to disclose statistically the significant differences between the averages of faculty members’ responses attributed to the demographic variables (gender, years of experience, academic degree). The study used the descriptive approach, both survey and correlational. A questionnaire was used to collect data from a simple random sample o
... Show More