Engineering materials are subjected to thermal, mechanical, and chemical loads during service. The design of sturdy materials that do not loose their beneficial properties in harsh environments, hence, requires an interdisciplinary, holistic approach that considers that degradation of properties is the result of combined thermo-chemo-mechanical loads. A prominent example for the complex interplay between chemical and mechanical loads is hydrogen embrittlement. Here, we present a continuum model framework to study chemo-mechanical interactions at the grain scale. It takes into account mechanics, i.e. the local variation of stress and strain, chemistry, i.e. the local solute concentration, and fracture, i.e. nucleation and propagation of cracks. In addition, interactions between these phenomena are modeled: Diffusion of solutes depends on the hydrostatic strain, fracture toughness is reduced in the presence of solutes such as hydrogen, and cracks lead to a severe redistribution of stress and strain. The physics-based formulations used in the model make it possible to parametrize it with the help of simulations at smaller length scales and experiments. Hence, it can be used for scale-bridging simulations in the context of integrated computational materials engineering (ICME). The proposed model is implemented into DAMASK, the Düsseldorf Advanced Material Simulation Kit and its capabilities are demonstrated on selected examples.