Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.
Abstract
The aim of the research is to demonstrate the impact of long-term investment on profitability, and in order to achieve this goal, long-term investment was chosen, represented by (the ratio of long-term investments to total investments, the ratio of long-term investment to the total (deposits) as independent variables, and studying its impact on the dependent variable, which is profitability as measured by the rate of return on investments, the rate of return on equity. In order to reach the results, the inductive approach and the analytical descriptive approach were used, and the research found a significant impac
... Show MoreAbstract
The grey system model GM(1,1) is the model of the prediction of the time series and the basis of the grey theory. This research presents the methods for estimating parameters of the grey model GM(1,1) is the accumulative method (ACC), the exponential method (EXP), modified exponential method (Mod EXP) and the Particle Swarm Optimization method (PSO). These methods were compared based on the Mean square error (MSE) and the Mean Absolute percentage error (MAPE) as a basis comparator and the simulation method was adopted for the best of the four methods, The best method was obtained and then applied to real data. This data represents the consumption rate of two types of oils a he
... Show More
The properties of capturing of peristaltic flow to a chemically reacting couple stress fluid through an inclined asymmetric channel with variable viscosity and various boundaries are investigated. we have addressed the impacts of variable viscosity, different wave forms, porous medium, heat and mass transfer for peristaltic transport of hydro magnetic couple stress liquid in inclined asymmetric channel with different boundaries. Moreover, The Fluid viscosity assumed to vary as an exponential function of temperature. Effects of almost flow parameters are studied analytically and computed. An rising in the temperature and concentration profiles return to heat and mass transfer Biot numbers. Noteworthy, the Soret and Dufour number effect resul
... Show MoreBackground: This study aimed to examine the efficacy of methylene blue (MB) and toluidine blue O (TBO) photodynamic therapy (PDT) as adjuncts to root surface debridement (RSD). Methods: This split-mouth, randomized, controlled clinical trial included eighteen patients, and a total of 332 sites (control = 102, MB = 124 and TBO = 106) were examined. Two sessions of PDT were completed at baseline and two weeks after RSD. Clinical parameters of bleeding on probing (BOP), plaque index (PI), probing pocket depth (PPD), and clinical attachment level (CAL) were measured pre- and post-treatment. Results: PPD and BOP reductions in sites treated by RSD with adjunctive photosensitizers (MB and TBO) were significantly higher than in control site
... Show MoreIn this paper to isolate and study the properties of the cyclooxygenase-2 (EC: 1.14.99.1) enzyme in the blood of a patient suffering from rheumatoid arthritis and study the effect of natural products of the Soapwort on the activity of purified enzyme. The study involves taking 30 ml of blood from an adult woman 40 years old, who suffers from rheumatoid arthritis disease for 13 years. Serum is separated and subjected to a series of purification processes including: precipitation by ammonium sulfate, filtration by centrifugation radiator, dialysis in presence of ammonium bicarbonate, separation using the technology of ion exchange, lipholization and then estimating approximate molecular weight of the enzyme using gel filtration techni
... Show MoreThe research seeks to achieve its goal of demonstrating the impact of applying banking governance variables on the financial performance of Islamic banks, and the independent research variables are represented by (X) by (the number of independent members in the board (X1), the number of directors in the board (X2), the number of committees emanating from the board ( X3), the percentage of shares owned by major shareholders in the board (X4), the number of members of the Sharia supervisory board (X5)), and the dependent variable (Y) is represented by (rate of return on assets (Y1), rate of return on equity (Y2)).
The research sample included (4) Islamic banks, namely (Iraqi Islamic Bank, National Islamic Bank, Jihan Islamic Bank,
... Show MoreIn this work, varying compositions of SiO2 micro filler were added
with the Polyvinyl Chloride (PVC) and samples have been prepared
using film casting technique. The results have been analyzed and
compared for PVC samples with (1 wt%, 3 wt%, 5 wt% and 10 wt%)
SiO2 micro filler. Mechanical characteristics such as tensile strength,
elongation at break and Young`s modulus were measured for all the
samples, where the tensile strength was increased from 8.39 Mpa for
purified PVC to 16 Mpa for 3% SiO2/PVC composite. Also, thermal
conductivity measurement values illustrated that composite materials
have a good thermal insulation at 10 wt. %, thermal conductivity was
decreased from 0.1684 W/m.
The chemical bath deposition technique (CBD) is considered the cheapest and easiest compared with other deposition techniques. However, it is highly sensitive to effective parameter deposition values such as pH, temperature, and so on. The pH value of the reaction solution has a direct impact on both the nucleation and growth rate of the film. Consequently, this study presents a novel investigation into the effect of a precise change. in the pH reaction solution value on the structural, morphological, and photoresponse characteristics of tin monosulphide (SnS) films. The films were grown on a flexible polyester substrate with pH values of 7.1, 7.4, and 7.7. The X-ray diffraction patterns of the grown films at pH 7.1 and 7.4 confirmed
... Show MoreDetermining risk indicators for dental implants is an essential strategy for preventing peri-implant diseases and effective diagnosis of dental implant success. To investigate the impact of certain potential factors on the osseointegrated dental implant. Eighty-four individuals were included in our study, 50 cases as a patient’s group and 34 participants as a control group. All cases were diagnosed based on certain criteria, 30 (60%) of patients had peri-implantitis, 20 (40%) with severe periimplantitis, 36(72%) were generalized, and 15 (30%) as localized peri-implantitis cases. The study has indicated that 44.7% of dental implants were in the anterior maxilla, followed by (27.3%) posterior maxilla, (17.4%) posterior mandible, and (10.4%)
... Show More