In my talk, I will present a number of case studies in astro and particle physics I am currently involved in. These include the identification of high-energy extra-galactic sources, the classification of variable stars and the search for a signal in accelerator-based experiments. The models and statistical methods we developed and employ range from classical statistics, such as likelihood-based small-sample inference, to Bayesian methods for machine learning in big data analysis.