This paper in brief describes our experiences with the design and implementation of a heterogeneous distributed continuous media management system (HDIMI) for the global infosphere, which has been sponsored by U.S. Air Force Research Laboratory. The salient features of our framework are explained. Next, the paper explores the challenges faced in integrating commercial off-the-shelf (COTS) object-oriented products into the framework, and how it affected the design and implementation. The HDIMI project has focused primarily on developing broadly-applicable information management technology as opposed to C4I applications, and evaluated in the context of application-oriented programs such as DARPA's JFACC and Adaptive Information Control Environment (AICE). HDIMI includes a component that performed admission control and adaptive multi-resource scheduling based on applications' Quality-of-Service (QoS) needs.