Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.
A two time step stochastic multi-variables multi-sites hydrological data forecasting model was developed and verified using a case study. The philosophy of this model is to use the cross-variables correlations, cross-sites correlations and the two steps time lag correlations simultaneously, for estimating the parameters of the model which then are modified using the mutation process of the genetic algorithm optimization model. The objective function that to be minimized is the Akiake test value. The case study is of four variables and three sites. The variables are the monthly air temperature, humidity, precipitation, and evaporation; the sites are Sulaimania, Chwarta, and Penjwin, which are located north Iraq. The model performance was
... Show MoreAn analytical approach based on field data was used to determine the strength capacity of large diameter bored type piles. Also the deformations and settlements were evaluated for both vertical and lateral loadings. The analytical predictions are compared to field data obtained from a proto-type test pile used at Tharthar –Tigris canal Bridge. They were found to be with acceptable agreement of 12% deviation.
Following ASTM standards D1143M-07e1,2010, a test schedule of five loading cycles were proposed for vertical loads and series of cyclic loads to simulate horizontal loading .The load test results and analytical data of 1.95
... Show MoreSpatial data observed on a group of areal units is common in scientific applications. The usual hierarchical approach for modeling this kind of dataset is to introduce a spatial random effect with an autoregressive prior. However, the usual Markov chain Monte Carlo scheme for this hierarchical framework requires the spatial effects to be sampled from their full conditional posteriors one-by-one resulting in poor mixing. More importantly, it makes the model computationally inefficient for datasets with large number of units. In this article, we propose a Bayesian approach that uses the spectral structure of the adjacency to construct a low-rank expansion for modeling spatial dependence. We propose a pair of computationally efficient estimati
... Show MoreThe issue of penalized regression model has received considerable critical attention to variable selection. It plays an essential role in dealing with high dimensional data. Arctangent denoted by the Atan penalty has been used in both estimation and variable selection as an efficient method recently. However, the Atan penalty is very sensitive to outliers in response to variables or heavy-tailed error distribution. While the least absolute deviation is a good method to get robustness in regression estimation. The specific objective of this research is to propose a robust Atan estimator from combining these two ideas at once. Simulation experiments and real data applications show that the p
... Show MoreThe direct electron transfer behavior of hemoglobin that is immobilized onto screen-printed carbon electrode (SPCE) modified with silver nanoparticles (AgNPs) and chitosan (CS) was studied in this work. Cyclic voltametry and spectrophotometry were used to characterize the hemoglobin (Hb) bioconjunction with AgNPs and CS. Results of the modified electrode showed quasi-reversible redox peaks with a formal potential of (-0.245 V) versus Ag/AgCl in 0.1 M phosphate buffer solution (PBS), pH7, at a scan rate of 0.1 Vs-1. The charge transfer coefficient (α) was 0.48 and the apparent electron transfer rate constant (Ks) was 0.47 s-1. The electrode was used as a hydrogen peroxide biosensor with a linear response over 3 to 240 µM and a detection li
... Show MoreWheat is rich in sources of fiber, oligosaccharides, and resistant starch, simple carbohydrates which may have a protective role against carcinoma. Additionally, Whole wheat/bran as well includes contains phytochemicals such as flavonoids, lignans, folate, phytosterols, phenolic acids, and tocols. The above phytochemicals suitable forms antioxidant and cholesterol-reducing activities. Phytoestrogens are regarded as especially essential in the preventative measures of hormonally dependent malignancies such as breast cancer (BC). In this study lowered BC risk has been associated with whole grain/bran consumption with an odds ratio (OR=0.24 and 95 %CI=0.10-0.56). Wheat/bran appears to have a reliable protective impact against BC. While intake
... Show MorePatients with renal failure in the final stages undergo the treatment by hemodialysis. Hemodialysis is used to reinstate the intracellular and extracellular fluid environment, by propagation of molecules in solution through a semipermeable membrane along an electrochemical concentration gradient. Blood catching in the dialysis machine and the recurrent phlebotomy may lead to losing about 1-3 g of iron per year. Prohepcidin hormone is an acute phase protein (type II) that plays a major role in the systemic iron irregularities as it is a mediator of anemia in inflammation and regulator of iron metabolism. This study aims to evaluate the effect of hemodialysis on iron hemostasis and its relationship with prohepcidin as an inflammatory mark
... Show MoreThe cheif aim of the present investigation is to develop Leslie Gower type three species food chain model with prey refuge. The intra-specific competition among the predators is considered in the proposed model. Besides the logistic growth rate for the prey species, Sokol Howell functional response for predation is chosen for our model formulation. The behaviour of the model system thoroughly analyses near the biologically significant equilibria. The linear stability analysis of the equilibria is carried out in order to examine the response of the system. The present model system experiences Hopf bifurcation depending on the choice of suitable model parameters. Extensive numerical simulation reveals the validity of the proposed model.
Many researchers tried to prevent or reduce moisture damage and its sensitivity to temperature to improving the performance of hot mix asphalt because it is decreasing the functional and structural life of fixable pavement due to the moisture damage had exposed to it.
The main objective of this study is to inspect the effect of (fly ash “3%, 6%, 12%”, hydrated lime”5%, 10%, 20%” and silica fumes”1%, 2%, 4%) referring to previous research by the net weight asphalt cement as a modified material on the moisture and temperature sensitivity of hot mix asphalt. This was done using asphalt from AL-Nasiria refinery with penetration grade 40-50, nominal maximum size (12.5) mm (surface course) of aggregate and on
... Show MoreThe etiology of Crohn's disease (CD) is still unknown. However, many factors, including a dysregulated immune system, altered microbiota, inheritance, and environmental factors, have been implicated. This work was conducted to estimate the effect of fungal microbiota on two bone mineral density markers, RANKL and sclerostin, in addition to the correlation between these markers and vitamin B12, D3, and zinc in CD patients, along with their potential effect on fungal microbiota and vice versa. Peripheral blood and carry-Blair Stool samples were collected from 88 participants (60 newly diagnosed with CD without treatment and 28 healthy controls) to detect serum levels of RANKL and sclerostin, and culture media were used to grow, isolat
... Show More