Share this page:

Enhancing Unsupervised Semantic Parsing with Distributed Contextual Representations

Zixuan Ling, Xiaoqing Zheng, Jianhan Xu, Jinshu Lin, Kai-Wei Chang, Cho-Jui Hsieh, and Xuanjing Huang, in ACL-Finding, 2023.

Abstract

We extend a non-parametric Bayesian model of (Titov and Klementiev, 2011) to deal with homonymy and polysemy by leveraging distributed contextual word and phrase representations pre-trained on a large collection of unlabelled texts. Then, unsupervised semantic parsing is performed by decomposing sentences into fragments, clustering the fragments to abstract away syntactic variations of the same meaning, and predicting predicate-argument relations between the fragments. To better model the statistical dependencies between predicates and their arguments, we further conduct a hierarchical Pitman-Yor process. An improved Metropolis-Hastings merge-split sampler is proposed to speed up the mixing and convergence of Markov chains by leveraging pre-trained distributed representations. The experimental results show that the models achieve better accuracy on both question-answering and relation extraction tasks.

Bib Entry

@inproceedings{ling2023enhancing,
  author = {Ling, Zixuan and Zheng, Xiaoqing and Xu, Jianhan and Lin, Jinshu and Chang, Kai-Wei and Hsieh, Cho-Jui and Huang, Xuanjing},
  title = {Enhancing Unsupervised Semantic Parsing with Distributed Contextual Representations},
  booktitle = {ACL-Finding},
  presentation_id = {https://underline.io/events/395/posters/15279/poster/77281-enhancing-unsupervised-semantic-parsing-with-distributed-contextual-representations?tab=video},
  year = {2023}
}

Related Publications

  1. DiCoRe: Enhancing Zero-shot Event Detection via Divergent-Convergent LLM Reasoning, EMNLP, 2025
  2. SNaRe: Domain-aware Data Generation for Low-Resource Event Detection, EMNLP, 2025
  3. LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory, ICLR, 2025
  4. SPEED++: A Multilingual Event Extraction Framework for Epidemic Prediction and Preparedness, EMNLP, 2024
  5. TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extraction, ACL-Findings, 2024
  6. Event Detection from Social Media for Epidemic Prediction, NAACL, 2024
  7. GENEVA: Pushing the Limit of Generalizability for Event Argument Extraction with 100+ Event Types, ACL, 2023
  8. TAGPRIME: A Unified Framework for Relational Structure Extraction, ACL, 2023
  9. DEGREE: A Data-Efficient Generative Event Extraction Model, NAACL, 2022
  10. Intent Classification and Slot Filling for Privacy Policies, ACL, 2021