Conference Keynotes

17th Nordic Conference on Computational Linguistics (NODALIDA 2009), Developing Meeting Support Technologies: From Data to Demonstration (and Beyond). The written version was minimal, so you may prefer the slides (9 MB, zipped PDF).

Language Resources and Evaluation Conference (LREC 2006), Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus. See the journal paper of the same title.

Journal Papers

Carletta, J., Hill, R.L., Nicol, C., Taylor, T., De Ruiter, J.P., Bard, E.G. (2010) Eyetracking for two-person tasks with manipulation of a virtual world. Behavior Research Methods 42(1), 254-265.

Calhoun, S., Carletta, J., Brenier, J., Mayo, N., Jurafsky, D., Steedman, M. and Beaver, D. (in press) The NXT-format Switchboard Corpus: A Rich Resource for Investigating the Syntax, Semantics, Pragmatics and Prosody of Dialogue. Language Resources and Evaluation Journal.

Reidsma, D. and Carletta, J. (2008) Reliability Measurement without Limits. Computational Linguistics 34(3): 319-326. This paper has also been cited as "Reliability Measurement: There's no safe limit", which was the title under which it was initially submitted.

Carletta, J. (2007) Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus. Language Resources and Evaluation Journal 41(2): 181-190. This is an invited paper to accompany a keynote address at LREC 2006.

Ham, H. S., Corley, M., Rajendran, G., Carletta, J. and Swanson, S. (2007) Brief Report: Imitation of Meaningless Gestures in Individuals with Asperger Syndrome and High-functioning Autism. Journal of Autism and Developmental Disorders. DOI 10.1007/s10803-007-0417-x.

Anderson, A.H., McEwan, R., Bal, J., and Carletta, J. (2007) Virtual team meetings: An analysis of communication and context. Computers in Human Behaviour 23(5): 2558-2580. DOI 10.1016/j.chb.2007.01.001.

Carletta, J., Evert, S., Heid, U., and Kilgour, J. (2005) The NITE XML Toolkit: data model and query. Language Resources and Evaluation Journal 39(4): 313-334. DOI 10.1007/s10579-006-9001-9.

Carletta, J., Evert, S., Heid, U., Kilgour, J., Robertson, J., and Voormann, H. (2003) The NITE XML Toolkit: flexible annotation for multi-modal language data. Behavior Research Methods, Instruments, and Computers 35(3), 353-363.

Carletta, J., Anderson, A. H., and Garrod, S. (2002). Seeing eye to eye: an account of grounding and understanding in work groups. Cognitive Studies: Bulletin of the Japanese Cognitive Science Society , 9(1), 1-20, March. Invited paper for the special issue entitled "Towards Sciences of Linguistic Communication". ISSN 13417924.

Fay, N., Garrod, S., and Carletta, J. (2000) Group discussion as interactive dialogue or serial monologue: The influence of group size. Psychological Science, 11(6), 487-492. Link to BBC article.

Carletta, J., Anderson, A. H., and McEwan, R. (2000) The effects of multimedia communication technology on non-collocated teams: a case study. Ergonomics, 43(8), 1237-1251.

Carletta, J., Garrod, S., and Fraser-Krauss, H. (1998). Communication and Placement of Authority in Workplace Groups -- The Consequences for Innovation. Small Group Research, 29(5), 531-559. Please note that due to typesetting difficulties there are errors in two equations in the published version of this paper. The third equation of footnote four should read E|P|(|P|-1) and the last equation of footnote five, -n*log(1/(n-1)) where the log is to the base 2.

Carletta, J. C., Isard, A., Isard, S., Kowtko, J., Doherty-Sneddon, G., and Anderson, A. (1997). The Reliability of a Dialogue Structure Coding Scheme. Computational Linguistics, 23(1), 13-31.

Carletta, J. C. (1996). Assessing agreement on classification tasks: the kappa statistic. Computational Linguistics, 22(2), 249-254. This is a comment from Klaus Krippendorff about an inaccurate statement in the squib about the relationship between kappa and alpha, and an explanation of which reliability statistic (kappa, alpha, or pi) is best under which circumstances. Whereas I chose kappa partly for its accessibility (in statistics packages and textbooks) and because it has been adopted in some other fields, alpha and pi are better-founded and more interpretable. Some other research advocates the use of the intra-class correlation coefficient to replace kappa.

Carletta, J. C., and Mellish, C. (1996). Risk-taking and recovery in task-oriented dialogue. Journal of Pragmatics, 26, 71-107.

Taylor, J., Carletta, J. C., and Mellish, C. (1996). Requirements for Belief Models in Cooperative Dialogue. User Modelling and User-Adapted Interaction, 6, 23-68.

Carletta, J. C., Caley, R., and Isard, S. (1995). Simulating Time-Constrained Language Production. Language and Cognitive Processes, 10(3/4), 357-361.

Conference Papers

Bard, E. G., Hill, R., Nicol, C., and Carletta, J. (2007) Look here: Does dialogue align gaze in dynamic joint action? Paper presented at Architectures and Mechanisms for Language Processing(AMLaP2007), Turku, Finland.

Murray, G., Renals, S., Carletta, J., and Moore J. (2006) Incorporating Speaker and Discourse Features into Speech Summarization. Proceedings of the Human Language Technology conference / North American chapter of the Association for Computational Linguistics annual meeting, New York City, USA, June.

Murray, G., Renals, S., and Carletta, J. (2005). Extractive Summarization of Meeting Recordings. In Proceedings of the 9th European Conference on Speech Communication and Technology (INTERSPEECH), Lisbon, Portugal, September. Presented as a poster.

Carletta, J., Dingare, S., Nissim, M., and Nikitina, T. (2004). Using the NITE XML Toolkit on the Switchboard Corpus to study syntactic choice: a case study. Fourth Language Resources and Evaluation Conference, Lisbon, Portugal, May.

Nissim, M., Dingare, S., Carletta, J., and Steedman, M. (2004). An Annotation Scheme for Information Status in Dialogue. Fourth Language Resources and Evaluation Conference, Lisbon, Portugal, May.

Cathcart, N., Carletta, J., and Klein, E. (2003) A Shallow Model of Backchannel Continuers in Spoken Dialogue. Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL-2003), Budapest.

Soria, C., Bernsen, N. O., Cadee, N., Carletta, J., Dybkjaer, L., Evert, S., Heid, U., Isard, A., Kolodnytsky, M., Lauer, C., Lezius, W., Noldus, L., Pirrelli, V., Reithinger, N., and Vogele, A. (2002). Advanced tools for the study of natural interactivity. Third International Conference on Language Resources and Evaluation (LREC 2002), Las Palmas, Spain, May.

Teufel, S., Carletta, J. C., and Moens, M. (1999). An annotation scheme for discourse-level argumentation in research articles. Proceedings of the Ninth Conference of the European Chapter of the Association for Computational Linguistics (EACL-99), Bergen.

Taylor, J., Carletta, J. C., and Mellish, C. (1994). Limiting nested beliefs in cooperative dialogues. In A. Ram (Ed.), Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society. Hillsdale, NJ, USA: Lawrence Erlbaum Associates.

Carletta, J. C. (1992). Planning to Fail, not Failing to Plan: Risk-taking and Recovery in Task-Oriented Dialogue, Proceedings of the Fourteenth International Conference on Computational Linguistics (COLING-92). Nantes, France.

Carletta, J. C. (1990). Modelling Variations in Goal-Directed Dialogue, Proceedings of the Thirteenth International Conference on Computational Linguistics (COLING-90). Helsinki.

Book Chapters

Popescu-Belis, A., Carletta, J., Kilgour, J., and Poller, P. (forthcoming) Accessing a Large Multimodal Corpus using an Automatic Content Linking Device. In M. Kipp, J.C. Martin, P. Paggio, and D. Heylen, eds., Multimodal Corpora, Springer Lecture Notes in Artificial Intelligence, Berlin/Heidelberg, 18p.

Popescu-Belis, A., Boertjes, E., Kilgour, J., Poller, P., Castronovo, S., Wilson, T., Jaimes, A., and Carletta, J. (2008) The AMIDA Automatic Content Linking Device: Just-in-Time Document Retrieval in Meetings. Pages 272-283 of Machine Learning for Multimodal Interaction: 5th International Workshop, MLMI 2008, Utrecht, The Netherlands, September 8-10, 2008. Proceedings. A. Popescu-Belis and R. Stiefelhagen, eds. Springer-Verlag Lecture Notes in Computer Science Volume 5237/2008. ISBN 978-3-540-85852-2. This is an updated version of a workshop paper.

Xu, W., Carletta, J., and Moore, J. (2006) Syntactic Chunking Across Different Corpora. Pages 166-177 of Machine Learning for Multimodal Interaction: Third International Workshop, MLMI 2006, Bethesda, MD, USA, May 1-4, 2006, Revised Selected Papers. Renals, S., Bengio, S., and Fiscus, J., eds. Lecture Notes in Computer Science, Volume 4299/2006.

Carletta, J.C., Ashby, S., Bourban, S., Flynn, M., Guillemot, M., Hain, T., Kadlec, J., Karaiskos, V., Kraiij, W., Kronenthal, M., Lathoud, G., Lincoln, M., Lisowska, A., McCowan, M., Post, W., Reidsma, D., and Wellner, P. (2006) The AMI Meeting Corpus: A Pre-Announcement. Machine Learning for Multimodal Interaction: Second International Workshop, MlMI 2005. Steve Renals and Samy Bengio, eds. Springer-Verlag Lecture Notes in Computer Science Volume 3869. ISBN 3-540-32549-2. This is an updated version of a workshop paper.

Carletta, J.C. and Kilgour, J. (2005) The NITE XML Toolkit Meets the ICSI Meeting Corpus: Import, Annotation, and Browsing. Machine Learning for Multimodal Interaction - First International Workshop, MLMI 2004.Samy Bengio and Herve Bourlard, eds. Springer-Verlag Lecture Notes in Computer Science Volume 3361. ISBN: 3-540-24509-X. This is an updated version of a workshop paper.

Anderson, A. H., Mullin, J., Mcewan, R., Bal, J., Carletta, J., Grattan, E., and Brundell, P. (2005) Exploring Why Virtual Teamworking is Effective in the Lab but More Difficult in the Workplace In R. Bromme, F. W. Hesse, and H. Spada (eds.), Barriers and Biases in Computer-Mediated Knowledge Communication. Springer Netherlands, pgs. 119-142. DOI 10.1007/0-387-24319-4_6.

Carletta, J., McKelvie, D., Isard, A., Mengel, A., Klein, M., and Møller, M. B. (2005). A generic approach to software support for linguistic annotation using XML. In G. Sampson and D. McCarthy (eds.), Readings in Corpus Linguistics. London and NY: Continuum International. ISBN: 082648803X. [Strictly speaking, this is a book of reprints. This particular paper is based on a previous draft from 2000 that had not been published but was kicking around the web. Briefly, when I thought the editors wanted updates, there was a more up-to-date but somewhat more technical version of the same title.]

Carletta, J., McEwan, R., and Anderson, A.H. (1998). Communication in virtual supply chain teams. In G. Jacucci, G. J. Olling, K. Preiss and M. Wozny (eds.), Globalization of manufacturing in the digital communications era of the 21st century: innovation, agility, and the virtual enterprise (pp. 55-67). Boston: Kluwer Academic Publishers. Text only abstract. Paper was presented at PROLAMAT-98, Trento, Italy.

West, M., Garrod, S., and Carletta, J. C. (1997). Group decision-making and effectiveness: Unexplored Boundaries. In C. L. Cooper and S. Jackson (Eds.), Creating Tomorrow's Organizations: A Handbook for Future Research in Organizational Behavior (pp. 293-317). Chichester, England: John Wiley.

Carletta, J., Fraser-Krauss, H., and Garrod, S. (1996). An Empirical Study of Innovation in Manufacturing Teams: a preliminary report. In J. L. G. Dietz (Ed.), Proceedings of the International Workshop on Communication Modelling (LAP-96) : Springer-Verlag. (see eWiC home page.)

Book Reviews

Roger Bakeman and John M. Gottman, "Observing Interaction: An Introduction to Sequential Analysis", second edition (1997) --- review, Language and Speech 42(1), p. 122-5, 1999.

Roger Bakeman and John M. Gottman, "Observing Interaction: An Introduction to Sequential Analysis", second edition (1997) --- "briefly noted" review, Computational Linguistics 24(4), p. 659-660, 1998.

David Chapman, "Vision, Instruction, and Action". Computational Linguistics 18(3), 1992 ("briefly noted" section).

Workshop Papers

Jaimes, A., Bourlard, H., Renals, S. and Carletta, J. (2007) Recording, indexing, summarizing, and accessing meeting videos: An overview of the AMI project. In Proceedings of the Workshops from the 14th International Conference of Image Analysis and Processing (ICIAP), pages 59-64.

Murray, G., Renals, S., Carletta, J., and Moore, J. (2005) Evaluating Automatic Summaries of Meeting Recordings. Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization at the 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, MI, USA, June.

Mayo, N., Kilgour, J., and Carletta, J. (2006) Towards an alternative implementation of NXT's query language via XQuery. EACL Workshop on Multi-dimensional Markup in Natural Language Processing, Trento, Italy, April 4th.

McCowan, I., Carletta, J., Kraaij, W., Ashby, S., Bourban, S., Flynn, M., Guillemot, M., Hain, T., Kadlec, J., Karaiskos, V., Kronenthal, M., Lathoud, G., Lincoln, M., Lisowska, A., Post, W., Reidsma, D. and Wellner, P. (2005) The AMI Meeting Corpus. Proceedings of the Measuring Behavior 2005 symposium on Annotating and Measuring Meeting Behavior, 1 September, Wageningen, NL.

Carletta, J.C., Ashby, S., Bourban, S., Flynn, M., Guillemot, M., Hain, T., Kadlec, J., Karaiskos, V., Kraiij, W., Kronenthal, M., Lathoud, G., Lincoln, M., Lisowska, A., McCowan, M., Post, W., Reidsma, D., and Wellner, P. (2005) The AMI Meeting Corpus: A Pre-Announcement. 2nd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms, 11-13 July, Edinburgh, Scotland. There is also a book chapter version of this paper which is better and should be used in preference to this one.

Carletta, J.C. and Kilgour, J. (2004) The NITE XML Toolkit meets the ICSI Meeting Corpus: import, annotation, and browsing. Joint AMI/PASCAL/IM2/M4 Workshop on Multimodal Interaction and Related Machine Learning Algorithms, 21-23 June, Martigny, Switzerland. There is also a book chapter version of this paper which is better and should be used in preference to this one. Slides here.

Annie Zaenen, Jean Carletta, Gregory Garretson, Joan Bresnan, Andrew Koontz-Garboden, Tatiana Nikitina, M. Catherine O'Connor and Tom Wasow (2004). Animacy Encoding in English: Why and How. ACL 2004 Workshop on Discourse Annotation, Bonnie Webber and Donna Byron, ed., pp. 118-125.

Padilha, E. G. and Carletta, J.C. (2003) Nonverbal behaviours improving a simulation of small group discussion. Proceedings of the First International Nordic Symposium of Multi-modal Communication, Copenhagen, Denmark, 25-26 September.

Carletta, J., Kilgour, J., O'Donnell, T., Evert, S., and Voormann, H. (2003). The NITE Object Model Library for Handling Structured Linguistic Annotation on Multimodal Data Sets. Proceedings of the EACL Workshop on Language Technology and the Semantic Web (3rd Workshop on NLP and XML, NLPXML-2003).

Carletta, J., and Isard A. (2002). Dialogue Structure Annotation Using a Pipeline of Simple Grammars. ISLE Workshop on Dialogue Tagging for Multi-modal Human Computer Interaction, Edinburgh, December 15-17.

Padilha, E. and Carletta, J. C. (2002). A Simulation of Small Group Discussion. EDILOG, Edinburgh, Sept. 4-6.

Carletta, J. C. (2001). Communication and Effectiveness in Primary Health Care Teams. Workshop on Dependability in Healthcare Informatics, Edinburgh, March 22-23. Powerpoint slides here.

Anderson, A. H., Carletta, J. C., and McEwan, R. (2000). "Virtual Teams and Effective Innovation: Studying Virtual Team Processes in Action", Proceedings of "Managing Across Boundaries", (The British Academy of Management Annual Conference), workshop entitled "Team Composition and Processes for Effective Innovation", Edinburgh, September 14.

Procter, R., Williams, R., Carletta, J. C., and McKinlay, A. (2000). "Factors in the Success of Virtual Team Working", Proceedings of "Virtually Collocated Teams in the Workplace", CHI-2000 Workshop, The Hague, April 2.

Carletta, J. C., Isard, A., Klein, M., Mengel, A., and Møller, M. B. (1999). The MATE Annotation Workbench: User Requirements. Proceedings of "Towards Standards and Tools for Discourse", ACL-99 Workshop, University of Maryland, June 20-26.

Carletta, J. C., Isard, A., Isard, S., Kowtko, J., Doherty-Sneddon, G., and Anderson, A. (1995). The Coding of dialogue structure in a Corpus. In J. A. Andernach, S. P. van de Burgt, and G. F. van der Hoeven (Eds.), Proceedings of the Twente Workshop on Language Technology: Corpus-based approaches to dialogue modelling . Universiteit Twente, Enschede, The Netherlands.

Isard, A., and Carletta, J. C. (1995). Replicability of Transaction and Action Coding in the Map Task Corpus, Proceedings of the AAAI 1995 Spring Symposium on Empirical Methods in Discourse Interpretation and Generation . Palo Alto, CA, USA.

Caley, R., Carletta, J. C., and Isard, S. (1992). Generating Natural Language under Time Constraints: A Preliminary Report, Proceedings of the IEEE Workshop on imprecise and approximate computation . Phoenix, AZ, USA.

Carletta, J. C. (1992). Risk-taking and recovery in task-oriented dialogue: An overview, Proceedings of the AAAI Fall Symposium on Discourse Structure in Natural Language Understanding and Generation . Asilomar, CA.

Carletta, J. C. (1991). Recovering from Plan Failure Using a Layered Architecture, Proceedings of the Tenth Workshop of the UK Planning Special Interest Group . Cambridge.

Carletta, J. C. (1991). A State-based Representation for Belief Modelling in Dialogue, Proceedings of the Workshop on Discourse Coherence . Edinburgh.

Carletta, J. C. (1992). Using ``Anytime Algorithms'' to Generate Natural Language Under Time Constraints, Proceedings of the Eleventh Workshop of the UK Planning Special Interest Group . Brighton.

Miscellaneous

Borrill, C., Carletta, J. C., Carter, A., Dawson, J.F., Garrod, S., Rees, A., Richards, A., Shapiro, D. and West, M. (2001). The Effectiveness of Health Care Teams in the National Health Service. Final Report to Department of Health. ISBN 185449 4252. [Or try a short glossy brochure produced by Aston about the project: Team Working and Effectiveness in Health Care: Findings from the Health Care Team Effectiveness Project.]

Reports available from the University of Edinburgh

Carletta, J. C., Isard, A., Isard, S., Kowtko, J., Doherty-Sneddon, G., and Anderson, A. (1996). HCRC Dialogue Structure Coding Manual (HCRC/TR-82). Edinburgh, Scotland: Human Communication Research Centre, University of Edinburgh.

Taylor, J., Carletta, J. C., and Mellish, C. (1996). Combining power with tractability in belief models. (HCRC/RP-76). Edinburgh, Scotland: Human Communication Research Centre, University of Edinburgh.

Isard, A., and Carletta, J. C. (1995). Transaction and Action Coding in the Map Task Corpus (HCRC/RP-65). Edinburgh, Scotland: Human Communication Research Centre, University of Edinburgh.

Taylor, J., Carletta, J. C., and Mellish, C. (1995). Requirements for Belief Models in Cooperative Dialogue (HCRC/RP-66). Edinburgh, Scotland: Human Communication Research Centre, University of Edinburgh. This is the submitted version of a journal paper with the same title.

Carletta, J. C., Caley, R., and Isard, S. (1993). A system architecture for simulating time-constrained language production (HCRC/RP-43). Edinburgh, Scotland: Human Communication Research Centre.

Carletta, J. C., Caley, R., and Isard, S. (1993). A Collection of Self-Repairs from the Map Task Corpus (HCRC/TR-47). Edinburgh, Scotland: Human Communication Research Centre.

Carletta, J. C. (1992). Risk-taking and Recovery in Task-Oriented Dialogue. Unpublished PhD, Edinburgh University. PS without figures here, Scanned PDF here. If you're interested in the analysis rather than the computational modelling, the Pragmatics paper of the same title is a better option.

Carletta, J. C. (1990). An Incremental Dialogue planner that Monitors Execution Research Paper 480, University of Edinburgh Department of Artificial Intelligence.

This list may be incomplete, and some papers may be available electronically but not have pointers here. See HCRC research papers .