Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.
Abstract
In the present study, composites were prepared by Hand lay-up molding. The composites constituents were epoxy resin as a matrix, 6% volume fractions of glass fibers (G.F) as reinforcement and 3%, 6% volume fractions of preparation natural material (Rice Husk Ash, Carrot Powder, and Sawdust) as filler. Studied the erosion wear behavior and coating by natural wastes (Rice Husk Ash) with epoxy resin after erosion. The results showed the non – reinforced epoxy have lower resistance erosion than natural based material composites and the specimen (Epoxy+6%glass fiber+6%RHA) has higher resistance erosion than composites reinforced with carrot powder and sawdust at 30cm , angle 60
... Show MoreThe current study aims to develop a teaching design in accordance with cluster thinking strategies and explore the effect of this teaching design on students’ achievement in science. To this end, the null hypothesis was adopted: there is no statistically significant difference at the level of (0, 05) between experimental group who adopted the teaching design in learning science and control group who follow the traditional method in learning the same subject. To test the null hypothesis, total of (74) students from Al-Alaama Hussain Mahfooth intermediate school were selected intentionally for the academic year 2016-2017. The sample divided into two equal groups when all the variables (age, prior achievement of science,
... Show MoreRegular sampling for six months from January to July 2012 were taken in small, shallow, perennial, standing ponds near the Greater Zab River, Gwer district, Erbil. A variety of physicochemical parameters were determined. Air and water temperature were falling between 15.2 - 34.7 ? C and 15.5 and 26.5 ?C. The waters are neutral (pH 7.38-8.27), hard, alkaline, salty, high in TDS and EC (892-966?S/cm, and rich in nutrients (NO3: 2.1-4.1mg/l, PO4: 0.33-0.62 mg / l , SO4: 24.7-80.2 mg / l ). The attention fixed on a filamentous blue- green algae Glaucospira Lagerheim, 1982) which is new to Iraqi flora. It is a filament (trichome), solitary, pale or yellowish blue – green, without sheath, Screw like coiled, motile, some of them are activ
... Show MoreThis research aims to create lightweight concrete mixtures containing waste from local sources, such as expanded polystyrene (EPS) beads and waste plastic fibers (WPFs), all are cheap or free in the Republic of Iraq and without charge. The modern, rigid, and mechanical properties of LWC were investigated, and the results were evaluated. Three mixtures were made, each with different proportions of plastic fibers (0.4%, 0.8%, 1.2%), in addition to a lightweight concrete mixture containing steak fibers (0.4%, 0.8%, 1.2%), in addition to a lightweight concrete mixture. It contains 20% EPS. The study found that the LWC caused by the addition of WPFs reduced the density (lightweight) of the concrete mixtures because EPS tends
... Show MoreBirds of prey (Raptors) are top predator avian species that many migrate annually through Mesopotamian marshes in southern Iraq toward their wintering grounds in Arabia and Africa, while others are breeding residents; however, information on their current status is scarce. From January 2016 to April 2019, a total of 20 field expeditions were conducted in the geographical zone of the Mesopotamian marshes, wetlands of international importance. The survey covered the Central Marshes, Al-Hammar and Hawizeh Marsh. One of the objectives of the field surveys is to list the raptors species that wintering and/or migrating through the Mesopotamian marshes and to understand their current spatial and temporal distribution. In the present study, a to
... Show MoreThe study aims at investigating the quality of internal auditing and its impact on nature, timing, and procedures of external audit, based on international auditing standards, in particular ISA (610). The standard ISA (610) requires the external auditors to assess independence, the scope of internal audit unit, competence, and due professional care of internal auditors as indicators that reflect the quality of internal audit performance before deciding to rely on internal auditors.
The sample of this study consisted of external auditors in Iraqi Solidary Companies for Auditing. A questionnaire was distributed to them via e-mail
... Show MoreBackground: Polymethyl methacrylate (PMMA) is the most commonly used material in denture fabrication. The material is far from ideal in fulfilling the mechanical requirements, like low impact and transverse strength, poor thermal conductivity. The purpose of this study was to evaluate the effect of addition a composite of surface treated Nano Aluminum oxide (Al2O3) filler and plasma treated polypropylene fiber (PP) on some properties of denture base material. Materials and methods: One hundred fifty prepared specimens were divided into 5 groups according to the tests, each group consisted of 30 specimens and these were subdivided into 3 groups (unreinforced heat cured acrylic resin as control group),reinforced acrylic resin with( 0.5%wt Nan
... Show MoreThe current research aims to know the extent of the impact of performance evaluation in its dimensions as an explanatory variable in the behavioural and attitudinal work outputs with its dimensions as a response variable in order to reach appropriate solutions through which the University of Fallujah seeks to achieve its goal in the process of diagnosing the axes of strength and to benefit from them in the process of strengthening the status and sobriety of the academic position of the professor and the researcher relied on The descriptive and analytical approach in carrying out this study, and data was collected from university professors, including leaders, heads of departments and divisions, who numbered (97) teachers. And fie
... Show MoreThis study aims to identify the role of forensic accounting in the Iraqi environment, banking stability, and to achieve this goal, we used the field survey method, as it is the most appropriate for studying the phenomenon in question and achieving its objectives.
Where we selected a sample consisting of (50) male and female employees, distributed among five private banks in Baghdad governorate, namely (Ashur International Bank, Development Investment Bank, Iraqi Middle East Investment Bank, Hammurabi Commercial Bank, Khaleej Commercial Bank), and the questionnaire tool was applied to them Designed for this purpose, which consisted of
... Show More