The increased awareness regarding the impact of energy consumption on the environment has led to an increased focus on reducing energy consumption. Feedback on the appliance level energy consumption can help in reducing the energy demands of the consumers. Energy disaggregation techniques are used to obtain the appliance level energy consumption from the aggregated energy consumption of a house. These techniques extract the energy consumption of an individual appliance as features and hence face the challenge of distinguishing two similar energy consuming devices. To address this challenge we develop methods that leverage the fact that some devices tend to operate concurrently at specific operation modes. The aggregated energy consumption patterns of a subgroup of devices allows us to identify the concurrent operating modes of devices in the subgroup. Thus, we design hierarchical methods to replace the task of overall energy disaggregation among the devices with a recursive disaggregation task involving device subgroups. Experiments on two real-world datasets show that our methods lead to improved performance as compared to baseline. One of our approaches, Greedy based Device Decomposition Method (GDDM) achieved up to 23.8%, 10% and 59.3% improvement in terms of micro-averaged f score, macro-averaged f score and Normalized Disaggregation Error (NDE), respectively.