Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.
Background: The purposes of this study were to determine the photogrammetric soft tissue facial profile measurements for Iraqi adults sample with class II div.1 and class III malocclusion using standardized photographic techniques and to verify the existence of possible gender differences. Materials & methods: Seventy five Iraqi adult subjects, 50 class II div.1 malocclusion (24 males and 26 females), 25 class III malocclusion (14 males and 11 females), with an age range from 18-25 years. Each individual was subjected to clinical examination and digital standardized right side photographic records were taken in the natural head position. The photographs were analyzed using AutoCAD program 2007 to measure the distances and angles used in t
... Show MoreDiversity of the aspects of analyzing a specific linguistic issue is considered to be a
familiar phenomenon in learning Arabic in which – at different levels- various linguistic
aspects and phases – sometimes – are involved in a linguistic issue . In this paper , the
problematic issues during linguistic analysis are taken into an account. The Holy Quran
interpretation books include many Quranic expressions which have a lot of meaning described
by different interpreters , from them this paper has selected only one expression ( = كفاتا
receptacle ) from the verse "Have we not made the earth a receptacle " ( Al- Mursalat verse 25
) , this paper believes that this expression is sufficient display the interpret
Core decompression is one of the commonest used techniques in the handling of osteonecrosis of the pre-collapsed head of the femur. Core decompression had succeeded in preserving the hip joint and delaying the requisite for total hip replacement, but it had failed in the induction of osteogenesis in the necrotic area, thus augmenting core decompression with biological agents to induce osteogenic activity. To assess the effects of platelet-rich plasma in non-traumatic avascular necrosis of the hip joint (early stage) after core decompression. Interventional comparative study for twenty-four patients (32 hip joints) with AVN of the head of the femur was involved in this prospective study, and they were separated into two groups of 16
... Show MoreBackground: The purpose of this study was to evaluate and compare centering ability and canal transportation of simulated S-shaped canals instrumented with four different types of rotary nickel-titanium systems. Materials and Methods: Forty simulated S-shaped canals in resin blocks were divided into four groups of ten each and were instrumented to an apical size 25 by different instrumentation technique using ProTaper Universal files (group A), ProTaperNext (group B), Reciproc (group C) and WaveOne (group D).Centering ability and canal transportation was measured at (11) measuring points from D0 to D10 bysuperimposion of the pre- and post-operative images obtained by using digital camera in standardized manner. An assessment of the canals
... Show MorePlantation of humic acid nanoparticles on the inert sand through simple impregnation to obtain the permeable reactive barrier (PRB) for treating of groundwater contaminated with copper and cadmium ions. The humic acid was extracted from sewage sludge which is byproduct of the wastewater treatment plant; so, this considers an application of sustainable development. Batch tests signified that the coated sand by humic acid (CSHA) had removal efficiencies exceeded 98 % at contact time, sorbent dosage, and initial pH of 1 h, 0.25 g/50 mL and 7, respectively for 10 mg/L initial concentration and 200 rpm agitation speed. Results proved that physicosorption was the predominant mechanism for metals-CSHA interaction because the sorption data followed
... Show MoreIt is often needed to have circuits that can display the decimal representation of a binary number and specifically in this paper on a 7-segment display. In this paper a circuit that can display the decimal equivalent of an n-bit binary number is designed and it’s behavior is described using Verilog Hardware Descriptive Language (HDL). This HDL program is then used to configure an FPGA to implement the designed circuit.
A free convective heat transfer from the inside surface of a uniformly heated vertical circular tube has been experimentally investigated under a constant wall heat flux boundary condition for laminar air flow in the ranges of RaL from 6.9108 to 5109. The effect of the different sections (restrictions) lengths placed at the exit of the heated tube on the surface temperature distribution, the local and average heat transfer coefficients were examined. The experimental apparatus consists of aluminum circular tube with 900 mm length and 30 mm inside diameter (L/D=30). The exit sections (restrictions) were included circular tubes having the same inside diameter as the heated tube but with different lengths of
... Show MoreA study of Zooplankton community has been carried out at four selected sites on Dukan Lake. Samples of water and zooplankton were collected monthly for the period from July 2015 to February 2016. Some physical and chemical properties of water were studied and the results showed that the air temperature were ranged from 0 to 36.16 °C, water temperature ranged from 2.83 to 34.66 °C, hydrogen ion concentration of studied sites were found to lie in alkaline side, it was ranged between 6.87 to 8.57, electrical conductivity ranged from 190.79 to 850.08 µs.cm¹, turbidity ranged from 0.9-7.7 NTU, and dissolved oxygen from 3.3 to 6.8 mg.l-¹ while BOD5 were ranged from 0.53 to 34.66 mg.l-¹. Concerning to the zooplankton, 37 species were ident
... Show MoreThe adopted method in the teaching of history is conservation and indoctrination in all grades, and this will lead to a lack of students interact with teachers in the course of the lesson, and poor use of teachers to questions that raise students' thinking during the lesson, which leads to a lack of interest in the topic of the lesson and wasting opportunities contribution making it the teacher at the center of the educational process, and to provide arrogating the researcher to contribute to teaching style with the belief that the use of this method of teaching could lead to overcome the difficulties and problems faced by the teaching material.
And there are educational complexes integrated approac
... Show More