Domain-adaptive Question Answering
Domain-Adaptive Question Answering (DA-QA) · Also known as: DA-QA, domain-adapted QA, domain-specific question answering, cross-domain question answering
Domain-adaptive Question Answering (DA-QA) adapts a pre-trained language model — typically BERT or RoBERTa — first trained on general QA benchmarks such as SQuAD to answer questions accurately in a new target domain (e.g., biomedical, legal, financial) where labelled data is scarce. Combining domain-adaptive pre-training with task fine-tuning yields substantially stronger performance than direct fine-tuning alone.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use DA-QA when you need accurate question answering in a specialised domain (biomedical, legal, scientific, customer-support) where general-purpose QA models underperform due to vocabulary mismatch or domain-specific reasoning. It excels when unlabelled domain text is plentiful but labelled QA pairs are scarce. Do not use it when the target domain is already well-covered by the base pre-training corpus; direct fine-tuning on SQuAD-style data may then suffice. Avoid DA-QA when interpretability of predictions is mandatory and black-box neural models are not accepted by your stakeholders.
Strengths & limitations
- Closes the vocabulary and distributional gap between general and specialised domains without requiring large labelled datasets.
- Compatible with any transformer backbone — benefits compound when using already domain-aware models such as BioBERT or LegalBERT.
- Retrieval-augmented variants scale to large knowledge bases and avoid the closed-book limitations of pure parametric models.
- Consistently outperforms direct fine-tuning on specialised benchmarks (e.g., BioASQ, TechQA) even with modest labelled data.
- Modular pipeline — DAPT and fine-tuning steps can be updated independently when new domain text or labels become available.
- Domain-adaptive pre-training on large corpora is computationally expensive and requires access to substantial unlabelled domain text.
- Answer quality depends heavily on the quality and coverage of retrieved passages; poor retrieval cascades into poor answers.
- Extractive models cannot synthesise answers that require aggregating information across multiple passages.
- Model confidence scores are often poorly calibrated, making it difficult to identify when the system does not know the answer.
Frequently asked
How much unlabelled domain text is needed for DAPT to help?
Benefits appear with as few as a few million tokens, but gains continue with larger corpora. PubMedBERT, for example, was trained on roughly 3.1 billion tokens of PubMed text. In practice, even a focused corpus of tens of thousands of domain documents provides measurable improvement.
Should I use an extractive or generative QA model?
Extractive models (predicting answer spans) are more reliable when answers always appear verbatim in a passage, and are easier to audit. Generative models (e.g., T5, GPT-based) handle free-form and aggregative answers but are harder to verify and more prone to hallucination.
What evaluation metrics should I report?
Report both Exact Match (EM) and token-level F1 on a held-out test set. For retrieval-augmented systems also report retrieval recall (passage-level). Where labelled test data is unavailable, human evaluation of a random sample of answers is the fallback.
Can DA-QA work without any labelled target-domain QA pairs?
Yes, via zero-shot transfer: DAPT is applied and the model is evaluated directly without fine-tuning on target labels. Performance is lower than supervised fine-tuning but often acceptable for pilot applications. Alternatively, questions can be automatically generated from domain passages to create synthetic training data.
Is domain-adaptive QA the same as fine-tuned QA?
No. Fine-tuned QA only updates the model on labelled QA pairs from the target domain. Domain-adaptive QA adds a DAPT step on unlabelled domain text before fine-tuning, which consistently yields better results when labelled data is scarce.
Sources
- Garg, S., Vu, T., & Moschitti, A. (2020). TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection. Proceedings of the AAAI Conference on Artificial Intelligence, 34(5), 7780–7788. DOI: 10.1609/aaai.v34i05.6282 ↗
- Yue, X., Zeng, Z., Shi, Y., Zhang, C., & Song, Y. (2022). Domain-adaptive Pre-training Methods for Natural Language Understanding. arXiv preprint. link ↗
How to cite this page
ScholarGate. (2026, June 3). Domain-Adaptive Question Answering (DA-QA). ScholarGate. https://scholargate.app/en/deep-learning/domain-adaptive-question-answering
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- BERT-based ClassificationDeep learning↔ compare
- Domain-adaptive BERT-based ClassificationDeep learning↔ compare
- Fine-Tuned Question AnsweringDeep learning↔ compare
- Multilingual question answeringDeep learning↔ compare
- RoBERTa-based ClassificationDeep learning↔ compare
- Transfer Learning with BERT-based ClassificationDeep learning↔ compare