COVID-19 has emerged as a global crisis with unprecedented socio-economic challenges, jeopardizing our lives and livelihoods for years to come. The unavailability of vaccines for COVID-19 has rendered rapid testing of the population instrumental in order to contain the exponential rise in cases of infection. Shortage of RT-PCR test kits and delay in obtaining test results calls for alternative methods of rapid and reliable diagnosis. In this article, we propose a novel Deep Learning based solution to rapidly classify COVID -19 patient using chest X-Ray. The proposed solution uses image enhancement, image segmentation and employs a modified stacked ensemble model consisting of four CNN base-learners along with Naive Bayes as meta-learner to classify Chest X-Ray into three classes viz. COVID-19, Pneumonia and Normal. An effective pruning strategy as introduced in the proposed framework results in increased model performance, generalisability, and decreased model complexity. We incorporate explainability in our article by using Grad-CAM visualisation in order to establish trust in the medical AI system. Furthermore, we evaluate multiple state of the art GAN architectures and their ability to generate realistic synthetic samples of COVID-19 chest X-Rays to deal with limited numbers of training samples. The proposed solution significantly outperforms existing methods, with 98.67\% accuracy, 0.98 Kappa score, and F-1 scores of 100, 98, and 98 for COVID-19, Normal, and Pneumonia classes respectively on standard datasets. The proposed solution can be used as one element of patient evaluation along with gold standard clinical and laboratory testing.