TY - GEN
T1 - Effective document clustering for large heterogeneous law firm collections
AU - Conrad, Jack G.
AU - Al-Kofahi, Khalid
AU - Zhao, Ying
AU - Karypis, George
PY - 2005
Y1 - 2005
N2 - Computational resources for research in legal environments have historically implied remote access to large databases of legal documents such as case law, statutes, law reviews and administrative materials. Today, by contrast, there exists enormous growth in lawyers' electronic work product within these environments, specifically within law firms. Along with this growth has come the need for accelerated knowledge management - -automated assistance in organizing, analyzing, retrieving and presenting this content in a useful and distributed manner.In cases where a relevant legal taxonomy is available, together with representative labeled data, automated text classification tools can be applied. In the absence of these resources, document clustering offers an alternative approach to organizing collections, and an adjunct to search.To explore this approach further, we have conducted sets of successively more complex clustering experiments using primary and secondary law documents as well as actual law firm data. Tests were run to determine the efficiency and effectiveness of a number of essential clustering functions. After examining the performance of traditional or hard clustering applications, we investigate soft clustering (multiple cluster assignments) as well as hierarchical clustering. We show how these latter clustering approaches are effective, in terms of both internal and external quality measures, and useful to legal researchers. Moreover, such techniques can ultimately assist in the automatic or semi-automatic generation of taxonomies for subsequent use by classification programs.
AB - Computational resources for research in legal environments have historically implied remote access to large databases of legal documents such as case law, statutes, law reviews and administrative materials. Today, by contrast, there exists enormous growth in lawyers' electronic work product within these environments, specifically within law firms. Along with this growth has come the need for accelerated knowledge management - -automated assistance in organizing, analyzing, retrieving and presenting this content in a useful and distributed manner.In cases where a relevant legal taxonomy is available, together with representative labeled data, automated text classification tools can be applied. In the absence of these resources, document clustering offers an alternative approach to organizing collections, and an adjunct to search.To explore this approach further, we have conducted sets of successively more complex clustering experiments using primary and secondary law documents as well as actual law firm data. Tests were run to determine the efficiency and effectiveness of a number of essential clustering functions. After examining the performance of traditional or hard clustering applications, we investigate soft clustering (multiple cluster assignments) as well as hierarchical clustering. We show how these latter clustering approaches are effective, in terms of both internal and external quality measures, and useful to legal researchers. Moreover, such techniques can ultimately assist in the automatic or semi-automatic generation of taxonomies for subsequent use by classification programs.
KW - Document clustering
KW - Knowledgement management
KW - Legal data
KW - Taxonomy development
UR - http://www.scopus.com/inward/record.url?scp=37749049420&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=37749049420&partnerID=8YFLogxK
U2 - 10.1145/1165485.1165513
DO - 10.1145/1165485.1165513
M3 - Conference contribution
AN - SCOPUS:37749049420
SN - 1595930817
SN - 9781595930811
T3 - Proceedings of the International Conference on Artificial Intelligence and Law
SP - 177
EP - 187
BT - 10th International Conference on Artificial Intelligence and Law, Proceedings of the Conference - ICAIL 2005
T2 - 10th International Conference on Artificial Intelligence and Law, ICAIL 2005
Y2 - 6 June 2005 through 11 June 2005
ER -