- Overview
- Model building
- Model validation
- Model deployment
- Consuming models
- API
- Frequently asked questions
Are there any design-time limits for the capability?
Design-time limits include:
- Number of fields per field group: up to 32 fields.
- Number of characters per field name: up to 128 characters.
- Number of characters per prompt instruction: up to 2048 characters. This is applicable to all prompts, including overall instructions, field group instructions, field instructions, and field type instructions.
Can I create generic fields in the documents capability?
No, there is no concept of generic fields in IXP. All fields need to belong to a field group. Each field group represents a separate table, where fields mean table columns. However, it is possible to define a parent-level field group representing a document type, and add more general fields as a table under this field group.
Do IXP Unstructured and complex documents models improve performance with labelling or annotations?
No, the model does not yet learn directly from user annotations. The way to improve the performance of your model is to modify your prompt instructions or model configuration. A fine-tunable model that learns from annotations will be available in a future release.
Why do I need to annotate documents if it does not improve the performance of the model?
It is still important to validate and annotate documents to establish ground truth for the performance evaluation of the model, which is captured in the built-in performance metrics in the Measure page.
How many documents do I need to upload to test my prompt instructions?
You should upload a representative sample of your documents to cover all possible variations. This should be at least 20-30 different documents. You are recommended to review the initial predictions on 2 to 3 documents and decide whether you need to modify your prompt instructions before gradually increasing the test sample to 10, 20, 30, X documents, where this will be an iterative process.
How many documents do I need to annotate to get reliable performance metrics?
You are recommended to validate at least 10 documents or 10 examples, or both, for each field, so that the model can provide you with meaningful validation statistics. This is the minimum number of annotations and will depend on the specific use case requirements.
- Are there any design-time limits for the capability?
- Can I create generic fields in the documents capability?
- Do IXP Unstructured and complex documents models improve performance with labelling or annotations?
- Why do I need to annotate documents if it does not improve the performance of the model?
- How many documents do I need to upload to test my prompt instructions?
- How many documents do I need to annotate to get reliable performance metrics?