Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.
The paper presents the results of precise of the calculations of the diffusion of slow electrons in ionospheric gases, such as, (Argon – Hydrogen mixture, pure Nitrogen and Argon – Helium – Nitrogen) in the presence of a uniform electric field and temperature 300 Kelvin. Such calculations lead to the value Townsend's energy coefficient (KT) as a function of E/P (electric field strength/gas pressure), electric field (E), electric drift velocity (Vd), momentum transfer collision frequency ( ), energy exchange collision frequency ( ) and characteristic energy (D/?). The following physical quantities are deduced as function s E/P: mean free path of the electrons at unit pressure, mean energy lost by an electron per collision, mean velocit
... Show MoreBackground: Diabetes mellitus (DM) could be regarded as a set of chronic metabolic disorders which have a common aspect of hyperglycemia. The resistance in the peripheral actions of insulin or impaired insulin secretion could be the reason hepcidin which is a peptide hormone derived from liver, in systemic iron homeostasis is an essential regulator, and its lopsided production participates in the pathogenesis of iron disorders in spectrum. Osteoporosis often accompanies many diseases like ß-thalassemia, hemochromatosis, sickle liver diseases, cell disease and hemosiderosis featured by iron overload, evidences suggest that Iron overload and iron deficiency are suggested by evidences that they affect bone in a negative way, acting
... Show MoreThe present work included study of the effects of weather conditions such as solar radiation and ambient temperature on solar panels (monocrystalline 30 Watts) via proposed mathematical model, MATLAB_Simulation was used by scripts file to create a special code to solve the mathematical model , The latter is single –diode model (Five parameter) ,Where the effect of ambient temperature and solar radiation on the output of the solar panel was studied, the Newton Raphson method was used to find the output current of the solar panel and plot P-V ,I-V curves, the performance of the PV was determined at Standard Test Condition (STC) (1000W/m2)and a comparison between theoretical and experimental results were done .The best efficiency
... Show MoreIn this study, the photodegradation of Congo red dye (CR) in aqueous solution was investigated using Au-Pd/TiO2 as photocatalyst. The concentration of dye, dosage of photocatalyst, amount of H2O2, pH of the medium and temperature were examined to find the optimum values of these parameters. It has been found that 28 ppm was the best dye concentration. The optimum amount of photocatalyst was 0.09 g/75 mL of dye solution when the degradation percent was ~ 96 % after irradiation time of 12 hours, while the best amount of hydrogen peroxide was 7μl/75 mL of dye solution at degradation percent ~97 % after irradiation time of 10 hours, whereas pH 5 was the best value to carry out the reaction at the highest deg
... Show MoreThe uptake of Cd(II) ions from simulated wastewater onto olive pips was modeled using artificial neural network (ANN) which consisted of three layers. Based on 112 batch experiments, the effect of contact time (10-240 min), initial pH (2-6), initial concentration (25-250 mg/l), biosorbent dosage (0.05-2 g/100 ml), agitation speed (0-250 rpm) and temperature (20-60ºC) were studied. The maximum uptake (=92 %) of Cd(II) was achieved at optimum parameters of 60 min, 6, 50 mg/l, 1 g/100 ml, 250 rpm and 25ºC respectively.
Tangent sigmoid and linear transfer functions of ANN for hidden and output layers respectively with 7 neurons were sufficient to present good predictions for cadmium removal efficiency with coefficient of correlatio
... Show MoreIn this study, the photodegradation of Congo red dye (CR) in aqueous solution was investigated using Au-Pd/TiO2 as photocatalyst. The concentration of dye, dosage of photocatalyst, amount of H2O2, pH of the medium and temperature were examined to find the optimum values of these parameters. It has been found that 28 ppm was the best dye concentration. The optimum amount of photocatalyst was 0.09 g/75 mL of dye solution when the degradation percent was ~ 96 % after irradiation time of 12 hours, while the best amount of hydrogen peroxide was 7μl/75 mL of dye solution at degradation percent ~97 % after irradiation time of 10 hours, whereas pH 5 was the best value to carry out the reaction at the highest degradation percent. In additio
... Show MoreIn this paper we prove the boundedness of the solutions and their derivatives of the second order ordinary differential equation x ?+f(x) x ?+g(x)=u(t), under certain conditions on f,g and u. Our results are generalization of those given in [1].
The investigation of determining solutions for the Diophantine equation over the Gaussian integer ring for the specific case of is discussed. The discussion includes various preliminary results later used to build the resolvent theory of the Diophantine equation studied. Our findings show the existence of infinitely many solutions. Since the analytical method used here is based on simple algebraic properties, it can be easily generalized to study the behavior and the conditions for the existence of solutions to other Diophantine equations, allowing a deeper understanding, even when no general solution is known.