This
page
is
part
of
the
FHIR
Specification
(v1.0.2:
DSTU
(v3.0.2:
STU
2).
3).
The
current
version
which
supercedes
this
version
is
5.0.0
.
For
a
full
list
of
available
versions,
see
the
Directory
of
published
versions
.
Page
versions:
R5
R4B
R4
R3
R2
R3
R2
FHIR
Infrastructure
Work
Group
| Maturity Level : 2 | Trial Use | Compartments : Not linked to any defined compartments |
Detailed Descriptions for the elements in the TestScript resource.
| TestScript | |
| Definition |
|
| Control | 1..1 |
| TestScript.url | |
| Definition |
An
absolute
|
| Control | 1..1 |
| Type | uri |
| Requirements | Allows the test script to be referenced by a single globally unique identifier. |
| Alternate Names | url; authoritative-url; destination; identity |
| Summary | true |
| Comments | Can be a urn:uuid: or a urn:oid:, but real http: addresses are preferred. Multiple instances may share the same url if they have a distinct version. |
| TestScript.identifier | |
| Definition | A formal identifier that is used to identify this test script when it is represented in other formats, or referenced in a specification, model, design or an instance. |
| Note | This is a business identifer, not a resource identifier (see discussion ) |
| Control | 0..1 |
| Type | Identifier |
| Requirements | Allows externally provided and/or usable business identifiers to be easily associated with the module. |
| Summary | true |
| Comments | Typically, this is used for identifiers that can go in an HL7 V3 II (instance identifier) data type, e.g., to identify this test script outside of FHIR, where it is not possible to use the logical URI. |
| TestScript.version | |
| Definition |
The
identifier
that
is
used
to
identify
this
version
of
the
|
| Note |
This
is
a
business
versionId,
not
a
resource
|
| Control | 0..1 |
| Type | string |
|
| true |
| Comments |
There
may
be
|
| TestScript.name | |
| Definition |
A
natural
language
name
identifying
the
test
script.
This
name
should
be
|
| Control | 1..1 |
| Type | string |
| Requirements | Support human navigation and code generation. |
| Summary | true |
| Comments | The name is not expected to be globally unique. The name should be a simple alpha-numeric type name to ensure that it is computable friendly. |
|
|
|
| Definition |
A
|
| Control |
|
| Type | string |
| Summary | true |
| Comments |
|
| TestScript.status | |
| Definition |
The
status
of
this
test
script.
Enables
tracking
the
|
| Control | 1..1 |
| Terminology Binding |
|
| Type | code |
| Is Modifier | true |
|
| true |
| Comments |
Allows
filtering
of
|
|
|
|
| Definition |
|
|
|
|
|
|
|
|
|
true |
| Requirements | Enables experimental content to be developed following the same lifecycle that would be used for a production-level test script. |
| Summary | true |
| Comments | Allows filtering of test script that are appropriate for use vs. not. This is labeled as "Is Modifier" because applications should not use an experimental test script in production. |
|
|
|
| Definition |
|
| Control | 0..1 |
| Type |
|
| Alternate Names |
|
| Summary | true |
| Comments | Note that this is not the same as the resource last-modified-date, since the resource may be a secondary representation of the test script. Additional specific dates may be added as extensions or be found by consulting Provenances associated with past versions of the resource. |
| TestScript.publisher | |
| Definition |
The
name
of
the
individual
or
organization
that
published
the
|
| Control | 0..1 |
| Type | string |
| Requirements |
Helps
establish
the
"authority/credibility"
of
the
|
| Summary | true |
| Comments |
Usually an organization, but may be an individual. The publisher (or steward) of the test script is the organization or individual primarily responsible for the maintenance and upkeep of the test script. This is not necessarily the same individual or organization that developed and initially authored the content. The publisher is the primary point of contact for questions or issues with the test script. This item SHOULD be populated unless the information is available from context. |
| TestScript.contact | |
| Definition |
|
| Control | 0..* |
| Type | ContactDetail |
| Summary | true |
| Comments |
May
be
a
web
site,
an
email
address,
a
telephone
|
|
|
|
| Definition |
|
| Control | 0..1 |
| Type |
|
| Comments | This description can be used to capture details such as why the test script was built, comments about misuse, instructions for clinical use and interpretation, literature references, examples from the paper world, etc. It is not a rendering of the test script as conveyed in the 'text' field of the resource itself. This item SHOULD be populated unless the information is available from context (e.g. the language of the profile is presumed to be the predominant language in the place the profile was created). |
| TestScript.useContext | |
| Definition | The content was developed with a focus and intent of supporting the contexts that are listed. These terms may be used to assist with indexing and searching for appropriate test script instances. |
| Control | 0..* |
| Type | UsageContext |
| Requirements | Assist in searching for appropriate content. |
| Summary | true |
| Comments |
|
|
|
|
| Definition |
|
| Control | 0..* |
| Terminology Binding | Jurisdiction ValueSet ( Extensible ) |
| Type |
|
| Summary | true |
| Comments | It may be possible for the test script to be used in jurisdictions other than those for which it was originally designed or intended. |
|
|
|
| Definition |
|
| Control | 0..1 |
| Type |
|
| Comments |
This element does not describe the usage of the test script Instead it provides traceability of ''why'' the resource is either needed or ''why'' it is defined as it is. This may be used to point to source materials or specifications that drove the structure of this test script. |
| TestScript.copyright | |
| Definition |
A copyright statement relating to the test script and/or its contents. Copyright statements are generally legal restrictions on the use and publishing of the test script. |
|
| 0..1 |
| Type | markdown |
| Requirements |
|
| Alternate Names | License; Restrictions |
|
|
|
| Definition |
|
| Control |
|
| Comments |
The purpose of this element is to define the profile of an origin element used elsewhere in the script. Test engines could then use the origin-profile mapping to offer a filtered list of test systems that can serve as the sender for the interaction. |
| TestScript.origin.index | |
| Definition |
Abstract name given to an origin server in this test script. The name is provided as a number starting at 1. |
| Control | 1..1 |
|
|
|
| Comments |
Different
origin
indices
could
play
the
The
origin
indices
provided
elsewhere
in
|
|
|
|
| Definition |
The
|
| Control |
|
| Terminology Binding |
|
| Type |
|
|
| FHIR-Client |
| Comments |
|
| TestScript.destination | |
| Definition |
An
abstract
server
used
in
|
|
|
|
| Comments | The purpose of this element is to define the profile of a destination element used elsewhere in the script. Test engines could then use the destination-profile mapping to offer a filtered list of test systems that can serve as the receiver for the interaction. |
|
|
|
| Definition |
|
| Control |
|
| Type |
|
| Comments |
Different
destination
indices
could
play
the
The
destination
indices
provided
elsewhere
in
the
test
script
must
be
one
of
|
|
|
|
| Definition |
|
| Control |
|
| Terminology Binding | TestScriptProfileDestinationType ( Extensible ) |
| Type |
|
| Meaning if Missing |
|
| Comments | Must be a "receiver"/"server" profile. |
| TestScript.metadata | |
| Definition |
The required capability must exist and are assumed to function correctly on the FHIR server being tested. |
| Control | 0..1 |
| Invariants |
Defined
on
this
element
:
capability.required.exists()
or
capability.validated.exists(),
xpath:
f:capability/f:required
or
f:capability/f:validated
or
(f:capability/f:required
and
f:capability/f:validated))
|
| TestScript.metadata.link | |
| Definition |
A link to the FHIR specification that this test is covering. |
| Control | 0..* |
| TestScript.metadata.link.url | |
| Definition |
URL to a particular requirement or feature within the FHIR specification. |
| Control | 1..1 |
| Type | uri |
| TestScript.metadata.link.description | |
| Definition |
Short description of the link. |
| Control | 0..1 |
| Type | string |
| TestScript.metadata.capability | |
| Definition |
Capabilities that must exist and are assumed to function correctly on the FHIR server being tested. |
| Control | 1..* |
| Comments |
When
the
metadata
capabilities
section
is
defined
at
TestScript.metadata
or
at
TestScript.setup.metadata,
and
the
server's
conformance
statement
does
not
contain
the
elements
defined
in
the
minimal
conformance
statement,
then
all
the
tests
in
the
TestScript
are
skipped.
When
the
metadata
capabilities
section
is
defined
at
TestScript.test.metadata
and
the
server's
conformance
statement
does
not
contain
the
elements
defined
in
the
minimal
conformance
statement,
then
only
that
test
is
skipped.
The
"metadata.capabilities.required"
and
"metadata.capabilities.validated"
elements
only
indicate
whether
the
capabilities
are
the
primary
focus
of
the
test
script
or
not.
|
| TestScript.metadata.capability.required | |
| Definition |
Whether or not the test execution will require the given capabilities of the server in order for this test script to execute. |
| Control | 0..1 |
| Type | boolean |
| Default Value | false |
| TestScript.metadata.capability.validated | |
| Definition |
Whether or not the test execution will validate the given capabilities of the server in order for this test script to execute. |
| Control | 0..1 |
| Type | boolean |
| Default Value | false |
| TestScript.metadata.capability.description | |
| Definition |
Description of the capabilities that this test script is requiring the server to support. |
| Control | 0..1 |
| Type | string |
| TestScript.metadata.capability.origin | |
| Definition | Which origin server these requirements apply to. |
| Control | 0..* |
| Type | integer |
| TestScript.metadata.capability.destination | |
| Definition |
Which server these requirements apply to. |
| Control | 0..1 |
| Type | integer |
| TestScript.metadata.capability.link | |
| Definition |
Links to the FHIR specification that describes this interaction and the resources involved in more detail. |
| Control | 0..* |
| Type | uri |
|
|
|
| Definition |
Minimum
|
| Control | 1..1 |
| Type |
Reference
(
|
| Comments |
The conformance statement of the server has to contain at a minimum the contents of the reference pointed to by this element. |
|
|
|
| Definition |
Fixture in the test script - by reference (uri). All fixtures are required for the test script to execute. |
| Control | 0..* |
| TestScript.fixture.autocreate | |
| Definition |
Whether or not to implicitly create the fixture during setup. If true, the fixture is automatically created on each server being tested during setup, therefore no create operation is required for this fixture in the TestScript.setup section. |
| Control | 0..1 |
| Type | boolean |
|
|
|
| TestScript.fixture.autodelete | |
| Definition |
Whether
or
not
to
implicitly
delete
the
fixture
during
|
| Control | 0..1 |
| Type | boolean |
|
|
|
| TestScript.fixture.resource | |
| Definition |
Reference to the resource (containing the contents of the resource needed for operations). |
| Control | 0..1 |
| Type | Reference ( Any ) |
| Comments |
See
|
| TestScript.profile | |
| Definition |
Reference to the profile to be used for validation. |
| Control | 0..* |
| Type | Reference ( Any ) |
| Comments |
See
|
| TestScript.variable | |
| Definition |
Variable is set based either on element value in response body or on header field value in the response headers. |
| Control | 0..* |
| Comments |
Variables
would
be
set
based
either
on
|
| Invariants |
Defined
on
this
element
:
expression.empty()
or
headerField.empty()
or
path.empty(),
xpath:
not(f:expression
and
f:headerField
and
f:path))
|
| TestScript.variable.name | |
| Definition |
Descriptive name for this variable. |
| Control | 1..1 |
| Type | string |
| Comments |
Placeholders would contain the variable name wrapped in ${} in "operation.params", "operation.requestHeader.value", and "operation.url" elements. These placeholders would need to be replaced by the variable value before the operation is executed. |
| TestScript.variable.defaultValue | |
| Definition | A default, hard-coded, or user-defined value for this variable. |
| Control | 0..1 |
| Type | string |
| Comments | The purpose of this element is to allow for a pre-defined value that can be used as a default or as an override value. Test engines can optionally use this as a placeholder for user-defined execution time values. |
| TestScript.variable.description | |
| Definition | A free text natural language description of the variable and its purpose. |
| Control | 0..1 |
| Type | string |
| TestScript.variable.expression | |
| Definition | The fluentpath expression to evaluate against the fixture body. When variables are defined, only one of either expression, headerField or path must be specified. |
| Control | 0..1 |
| Type | string |
| Comments | If headerField is defined, then the variable will be evaluated against the headers that sourceId is pointing to. If expression or path is defined, then the variable will be evaluated against the fixture body that sourceId is pointing to. It is an error to define any combination of expression, headerField and path. |
| TestScript.variable.headerField | |
| Definition |
Will be used to grab the HTTP header field value from the headers that sourceId is pointing to. |
| Control | 0..1 |
| Type | string |
| Comments |
If headerField is defined, then the variable will be evaluated against the headers that sourceId is pointing to. If path is defined, then the variable will be evaluated against the fixture body that sourceId is pointing to. It is an error to define both headerField and path. |
| TestScript.variable.hint | |
| Definition | Displayable text string with hint help information to the user when entering a default value. |
| Control | 0..1 |
| Type | string |
| TestScript.variable.path | |
| Definition |
XPath
or
JSONPath
to
evaluate
against
the
fixture
body.
When
variables
are
defined,
only
one
of
either
expression,
headerField
or
path
must
be
|
| Control | 0..1 |
| Type | string |
| Comments |
If
headerField
is
defined,
then
the
variable
will
be
evaluated
against
the
headers
that
sourceId
is
pointing
to.
If
expression
or
path
is
defined,
then
the
variable
will
be
evaluated
against
the
fixture
body
that
sourceId
is
pointing
to.
It
is
an
error
to
define
|
| TestScript.variable.sourceId | |
| Definition |
Fixture to evaluate the XPath/JSONPath expression or the headerField against within this variable. |
| Control | 0..1 |
| Type | id |
| Comments |
This
can
be
a
statically
defined
fixture
(at
the
top
of
the
|
|
|
|
| Definition |
|
| Control | 0..* |
| Comments |
Each
rule
should
be
treated
by
test
engines
as
one
assertion
regardless
of
|
| TestScript.rule.resource | |
| Definition | Reference to the resource (containing the contents of the rule needed for assertions). |
| Control |
|
| Type | Reference ( Any ) |
|
|
|
| Definition |
|
| Control | 0..* |
| Comments | The parameter value can be dynamic at runtime. |
| TestScript.rule.param.name | |
| Definition |
Descriptive
name
for
this
parameter
that
|
| Control |
|
| Type |
|
|
|
The external rule template would be looking for the parameter by this name. |
|
| |
| Definition | The explicit or dynamic value for the parameter that will be passed on to the external rule template. |
| Control | 0..1 |
| Type | string |
| Comments |
This
value
can
be
overwritten
by
the
assert.rule.param.value
i.e.
TestScript.rule.param.value
will
be
used
if
assert.rule.param.value
is
not
specified.
The
param
value
can
be
a
string-representation
of
a
number,
string,
or
boolean
that
is
expected.
Test
engines
do
have
to
look
for
placeholders
(${})
and
replace
the
variable
placeholders
with
the
variable
values
at
runtime
before
supplying
this
|
|
TestScript.ruleset
|
|
| Definition |
Contains
one
or
|
| Control | 0..* |
| Comments | Each rule within a ruleset should be treated by test engines as one assertion regardless of how many assertions are contained within the external rule template. The impact of negative rule evaluation on test script execution is the same as an assertion failure which is described elsewhere in the TestScript resource. |
| TestScript.ruleset.resource | |
| Definition | Reference to the resource (containing the contents of the ruleset needed for assertions). |
| Control | 1..1 |
| Type | Reference ( Any ) |
| TestScript.ruleset.rule | |
| Definition | The referenced rule within the external ruleset template. |
| Control | 1..* |
| Comments | This qualifies each param name so that a parameter with the same name can be used differently by the different rules with the ruleset. |
| TestScript.ruleset.rule.ruleId | |
| Definition | Id of the referenced rule within the external ruleset template. |
| Control | 1..1 |
| Type | id |
| TestScript.ruleset.rule.param | |
| Definition |
Each
rule
template
can
take
one
or
|
| Control | 0..* |
| Comments | The parameter value can be dynamic at runtime. |
| TestScript.ruleset.rule.param.name | |
| Definition | Descriptive name for this parameter that matches the external assert ruleset rule parameter name. |
| Control | 1..1 |
| Type | string |
| Comments | The external rule template would be looking for the parameter by this name. |
| TestScript.ruleset.rule.param.value | |
| Definition | The value for the parameter that will be passed on to the external ruleset rule template. |
| Control | 0..1 |
| Type | string |
| Comments |
This
value
can
be
overwritten
by
the
assert.ruleset.rule.param.value
i.e.
TestScript.ruleset.rule.param.value
will
be
used
if
assert.ruleset.rule.param.value
is
not
specified.
The
param
value
can
be
a
string-representation
of
a
number,
string,
or
|
| TestScript.setup | |
| Definition | A series of required setup operations before tests are executed. |
| Control | 0..1 |
| TestScript.setup.action | |
| Definition |
Action would contain either an operation or an assertion. |
| Control | 1..* |
| Comments |
An action should contain either an operation or an assertion but not both. It can contain any number of variables. |
| Invariants |
Defined
on
this
element
inv-1 : Setup action SHALL contain either an operation or assert but not both. :
operation.exists()
xor
assert.exists(),
xpath:
(f:operation
or
f:assert)
and
not(f:operation
and
f:assert))
|
| TestScript.setup.action.operation | |
| Definition |
The operation to perform. |
| Control | 0..1 |
| Invariants |
Defined
on
this
element
:
sourceId.exists()
or
(targetId.count()
+
url.count()
+
params.count()
=
1)
or
(type.code
in
('capabilities'
|'search'
|
'transaction'
|
'history')),
xpath:
f:sourceId
or
((f:targetId
or
f:url
or
f:params)
and
(count(f:targetId)
+
count(f:url)
+
count(f:params)
=1))
or
|
| TestScript.setup.action.operation.type | |
| Definition |
Server interaction or operation type. |
| Control | 0..1 |
| Terminology Binding |
|
| Type | Coding |
| Comments |
See
|
| TestScript.setup.action.operation.resource | |
| Definition |
The
type
of
the
resource.
See
|
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Comments |
If "url" element is specified, then "targetId", "params", and "resource" elements will be ignored as "url" element will have everything needed for constructing the request url. If "params" element is specified, then "targetId" element is ignored. For FHIR operations that require a resource (e.g. "read" and "vread" operations), the "resource" element must be specified when "params" element is specified. If "url" and "params" elements are absent, then the request url will be constructed from "targetId" fixture if present. For "read" operation, the resource and id values will be extracted from "targetId" fixture and used to construct the url. For "vread" and "history" operations, the versionId value will also be used. |
| TestScript.setup.action.operation.label | |
| Definition |
The label would be used for tracking/logging purposes by test engines. |
| Control | 0..1 |
| Type | string |
| Comments |
This has no impact on the verification itself. |
| TestScript.setup.action.operation.description | |
| Definition |
The description would be used by test engines for tracking and reporting purposes. |
| Control | 0..1 |
| Type | string |
| Comments |
This has no impact on the verification itself. |
| TestScript.setup.action.operation.accept | |
| Definition |
The content-type or mime-type to use for RESTful operation in the 'Accept' header. |
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Meaning if Missing | xml |
| Comments |
If
this
is
specified,
then
test
engine
shall
set
the
'Accept'
header
to
the
corresponding
value.
If
'xml'
is
specified,
then
'Accept'
header
of
|
| TestScript.setup.action.operation.contentType | |
| Definition |
The content-type or mime-type to use for RESTful operation in the 'Content-Type' header. |
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Meaning if Missing | xml |
| Comments |
If
this
is
specified,
then
test
engine
shall
set
the
'Content-Type'
header
to
the
corresponding
value.
If
'xml'
is
specified,
then
'Content-Type'
header
of
|
| TestScript.setup.action.operation.destination | |
| Definition |
|
| Control | 0..1 |
| Type | integer |
|
|
If multiple TestScript.destination elements are defined and operation.destination is undefined, test engine will report an error as it cannot determine what destination to use for the exchange. |
| TestScript.setup.action.operation.encodeRequestUrl | |
| Definition |
Whether or not to implicitly send the request url in encoded format. The default is true to match the standard RESTful client behavior. Set to false when communicating with a server that does not support encoded url paths. |
| Control | 0..1 |
| Type | boolean |
| Default Value | true |
| TestScript.setup.action.operation.origin | |
| Definition | The server where the request message originates from. Must be one of the server numbers listed in TestScript.origin section. |
| Control | 0..1 |
| Type | integer |
| Comments | If absent, test engine will send the message. When present, test engine will not send the request message but will wait for the request message to be sent from this origin server. |
| TestScript.setup.action.operation.params | |
| Definition |
Path plus parameters after [type]. Used to set parts of the request URL explicitly. |
| Control | 0..1 |
| Type | string |
| Comments |
If "url" element is specified, then "targetId", "params", and "resource" elements will be ignored as "url" element will have everything needed for constructing the request url. If "params" element is specified, then "targetId" element is ignored. For FHIR operations that require a resource (e.g. "read" and "vread" operations), the "resource" element must be specified when "params" element is specified. If "url" and "params" elements are absent, then the request url will be constructed from "targetId" fixture if present. For "read" operation, the resource and id values will be extracted from "targetId" fixture and used to construct the url. For "vread" and "history" operations, the versionId value will also be used. Test engines would append whatever is specified for "params" to the URL after the resource type without tampering with the string (beyond encoding the URL for HTTP). The "params" element does not correspond exactly to "search parameters". Nor is it the "path". It corresponds to the part of the URL that comes after the [type] (when "resource" element is specified); e.g. It corresponds to "/[id]/ history/[vid] {? format=[mime-type]}" in the following operation: GET [base]/[type]/[id]/ history/[vid] {? format=[mime-type]} Test engines do have to look for placeholders (${}) and replace the variable placeholders with the variable values at runtime before sending the request. |
| TestScript.setup.action.operation.requestHeader | |
| Definition |
Header elements would be used to set HTTP headers. |
| Control | 0..* |
| Comments |
This
gives
control
to
test-script
writers
to
set
headers
explicitly
based
on
test
requirements.
It
will
allow
for
testing
using:
-
"If-Modified-Since"
and
"If-None-Match"
headers.
See
|
| TestScript.setup.action.operation.requestHeader.field | |
| Definition |
The HTTP header field e.g. "Accept". |
| Control | 1..1 |
| Type | string |
| Comments |
If header element is specified, then field is required. |
| TestScript.setup.action.operation.requestHeader.value | |
| Definition |
The
value
of
the
header
e.g.
|
| Control | 1..1 |
| Type | string |
| Comments |
If
header
element
is
specified,
then
value
is
required.
No
conversions
will
be
done
by
|
| TestScript.setup.action.operation.requestId | |
| Definition | The fixture id (maybe new) to map to the request. |
| Control | 0..1 |
| Type | id |
| Comments | If a requestId is supplied, then the resulting request (both headers and body) is mapped to the fixture ID (which may be entirely new and previously undeclared) designated by "requestId". If requestId is not specified, it is the test engine's responsibility to store the request and use it as the requestId in subsequent assertions when assertion path and/or headerField is specified, direction is equal to request, and the requestId in not specified. |
| TestScript.setup.action.operation.responseId | |
| Definition |
The fixture id (maybe new) to map to the response. |
| Control | 0..1 |
| Type | id |
| Comments |
If
a
responseId
is
supplied,
and
the
server
responds,
then
the
resulting
response
(both
headers
and
body)
is
mapped
to
the
fixture
ID
(which
may
be
entirely
new
and
previously
undeclared)
designated
by
"responseId".
If
responseId
is
not
specified,
it
is
the
|
| TestScript.setup.action.operation.sourceId | |
| Definition |
The id of the fixture used as the body of a PUT or POST request. |
| Control | 0..1 |
| Type | id |
| TestScript.setup.action.operation.targetId | |
| Definition |
Id of fixture used for extracting the [id], [type], and [vid] for GET requests. |
| Control | 0..1 |
| Type | id |
| Comments |
If "url" element is specified, then "targetId", "params", and "resource" elements will be ignored as "url" element will have everything needed for constructing the request url. If "params" element is specified, then "targetId" element is ignored. For FHIR operations that require a resource (e.g. "read" and "vread" operations), the "resource" element must be specified when "params" element is specified. If "url" and "params" elements are absent, then the request url will be constructed from "targetId" fixture if present. For "read" operation, the resource and id values will be extracted from "targetId" fixture and used to construct the url. For "vread" and "history" operations, the versionId value will also be used. |
| TestScript.setup.action.operation.url | |
| Definition |
Complete request URL. |
| Control | 0..1 |
| Type | string |
| Comments |
Used to set the request URL explicitly. If "url" element is defined, then "targetId", "resource", and "params" elements will be ignored. Test engines would use whatever is specified in "url" without tampering with the string (beyond encoding the URL for HTTP). Test engines do have to look for placeholders (${}) and replace the variable placeholders with the variable values at runtime before sending the request. |
| TestScript.setup.action.assert | |
| Definition |
Evaluates the results of previous operations to determine if the server under test behaves appropriately. |
| Control | 0..1 |
| Comments |
In order to evaluate an assertion, the request, response, and results of the most recently executed operation must always be maintained by the test engine. |
| Invariants |
Defined
on
this
element
:
compareToSourceId.empty()
xor
(compareToSourceExpression.exists()
or
compareToSourcePath.exists()),
xpath:
(f:compareToSourceId
and
f:compareToSourceExpression)
or
(f:compareToSourceId
and
f:compareToSourcePath)
or
not(f:compareToSourceId
or
f:compareToSourceExpression
or
f:compareToSourcePath))
:
(response.empty()
and
responseCode.empty()
and
direction
=
'request')
or
direction.empty()
or
direction
=
'response',
xpath:
((count(f:response)
+
count(f:responseCode))
=
0
and
(f:direction/@value='request'))
or
(count(f:direction)
=
0)
or
(f:direction/@value='response'))
inv-5 : Only a single assertion SHALL be present within setup action assert element. :
contentType.count()
+
expression.count()
+
headerField.count()
+
minimumId.count()
+
navigationLinks.count()
+
path.count()
+
requestMethod.count()
+
resource.count()
+
responseCode.count()
+
response.count()
+
rule.count()
+
ruleset.count()
+
validateProfileId.count()
<=1,
xpath:
count(f:contentType)
+
count(f:expression)
+
count(f:headerField)
+
count(f:minimumId)
+
count(f:navigationLinks)
+
count(f:path)
+
count(f:requestMethod)
+
count(f:resource)
+
count(f:responseCode)
+
count(f:response)
+
count(f:rule)
+
count(f:ruleset)
+
count(f:validateProfileId)
<=1)
|
| TestScript.setup.action.assert.label | |
| Definition |
The label would be used for tracking/logging purposes by test engines. |
| Control | 0..1 |
| Type | string |
| Comments |
This has no impact on the verification itself. |
| TestScript.setup.action.assert.description | |
| Definition |
The description would be used by test engines for tracking and reporting purposes. |
| Control | 0..1 |
| Type | string |
| Comments |
This has no impact on the verification itself. |
| TestScript.setup.action.assert.direction | |
| Definition |
The direction to use for the assertion. |
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Comments | If the direction is specified as "response" (the default), then the processing of this assert is against the received response message. If the direction is specified as "request", then the processing of this assert is against the sent request message. |
| TestScript.setup.action.assert.compareToSourceId | |
| Definition |
Id
of
the
source
fixture
used
as
the
contents
to
|
| Control | 0..1 |
| Type | string |
| TestScript.setup.action.assert.compareToSourceExpression | |
|
|
The
|
| Control | 0..1 |
| Type | string |
| Comments |
Thefhirpath
expression
to
be
evaluated
against
the
expected
fixture
|
| TestScript.setup.action.assert.compareToSourcePath | |
| Definition |
XPath
or
JSONPath
expression
|
| Control | 0..1 |
| Type | string |
| Comments |
The XPath or JSONPath expression to be evaluated against the expected fixture to compare to. Ignored if "assert.value" is used. The evaluation will be done before the assertion is evaluated. |
| TestScript.setup.action.assert.contentType | |
| Definition |
The content-type or mime-type to use for RESTful operation in the 'Content-Type' header. |
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Meaning if Missing | xml |
| Comments |
If
this
is
specified,
then
test
engine
shall
confirm
that
the
content-type
of
the
last
operation's
headers
is
set
to
this
value.
If
"assert.sourceId"
element
is
specified,
then
the
evaluation
will
be
done
against
the
headers
mapped
to
that
sourceId
(and
not
the
last
operation's
headers).
If
'xml'
is
specified,
then
'Content-Type'
header
of
|
| TestScript.setup.action.assert.expression | |
| Definition | The fluentpath expression to be evaluated against the request or response message contents - HTTP headers and payload. |
| Control | 0..1 |
| Type | string |
| Comments | If both "expression" and a "fixtureId" are specified, then the expression will be evaluated against the request or response body mapped to the fixtureId. If "expression" is specified and a "fixtureId" is not, then the expression will be evaluated against the response body of the last operation. Test engines are to store the request and response body and headers of the last operation at all times for subsequent assertions. |
| TestScript.setup.action.assert.headerField | |
| Definition |
The HTTP header field name e.g. 'Location'. |
| Control | 0..1 |
| Type | string |
| Comments |
If "headerField" is specified then "value" must be specified. If "sourceId" is not specified, then "headerField" will be evaluated against the last operation's response headers. Test engines are to keep track of the last operation's response body and response headers. |
| TestScript.setup.action.assert.minimumId | |
| Definition |
The
ID
of
a
fixture.
Asserts
that
the
response
contains
at
a
|
| Control | 0..1 |
| Type | string |
| Comments |
Asserts that the response contains all the element/content in another fixture pointed to by minimumId. This can be a statically defined fixture or one that is dynamically set via responseId. |
| TestScript.setup.action.assert.navigationLinks | |
| Definition |
Whether or not the test execution performs validation on the bundle navigation links. |
| Control | 0..1 |
| Type | boolean |
| Comments |
Asserts that the Bundle contains first, last, and next links. |
| TestScript.setup.action.assert.operator | |
| Definition |
The
operator
|
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Comments |
Operators
|
| TestScript.setup.action.assert.path | |
| Definition |
The XPath or JSONPath expression to be evaluated against the fixture representing the response received from server. |
| Control | 0..1 |
| Type | string |
| Comments |
If
both
"path"
and
a
"fixtureId"
are
specified,
then
the
path
will
be
evaluated
against
the
|
| TestScript.setup.action.assert.requestMethod | |
| Definition | The request method or HTTP operation code to compare against that used by the client system under test. |
| Control | 0..1 |
| Terminology Binding | TestScriptRequestMethodCode ( Required ) |
| Type | code |
| Comments | If "requestMethod" is specified then it will be used in place of "value". The "requestMethod" will evaluate against the last operation's request HTTP operation. |
| TestScript.setup.action.assert.requestURL | |
| Definition | The value to use in a comparison against the request URL path string. |
| Control | 0..1 |
| Type | string |
| Comments | If "requestURL" is specified then it will be used in place of "value". The "requestURL" will evaluate against the last operation's full request URL path string. |
| TestScript.setup.action.assert.resource | |
| Definition |
The
type
of
the
resource.
See
|
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Comments |
This
will
be
expected
resource
type
in
response
body
e.g.
in
read,
vread,
search,
etc.
See
|
| TestScript.setup.action.assert.response | |
| Definition |
okay | created | noContent | notModified | bad | forbidden | notFound | methodNotAllowed | conflict | gone | preconditionFailed | unprocessable. |
| Control | 0..1 |
| Terminology Binding |
|
| Type | code |
| Comments |
This is a shorter way of achieving similar verifications via "assert.responseCode". If you need more control, then use "assert.responseCode" e.g. <assert> <contentType value="json" /> <response value="okay"/> </assert>. |
| TestScript.setup.action.assert.responseCode | |
| Definition |
The value of the HTTP response code to be tested. |
| Control | 0..1 |
| Type | string |
| Comments |
To be used with "operator" attribute value. Asserts that the response code equals this value if "operator" is not specified. If the operator is "in" or "notIn" then the responseCode would be a comma-separated list of values e.g. "200,201". Otherwise, it's expected to be a numeric value. If "fixture" is not specified, then the "responseBodyId" value of the last operation is assumed. |
| TestScript.setup.action.assert.rule | |
| Definition | The TestScript.rule this assert will evaluate. |
| Control | 0..1 |
| Comments | Each rule should get evaluated by test engines as one assertion regardless of how many assertions are contained within the external rule template. The impact of negative rule evaluation on test script execution is the same as an assertion failure which is descibed elsewhere in the TestScript resource. |
| TestScript.setup.action.assert.rule.ruleId | |
| Definition | The TestScript.rule id value this assert will evaluate. |
| Control | 1..1 |
| Type | id |
| TestScript.setup.action.assert.rule.param | |
| Definition | Each rule template can take one or more parameters for rule evaluation. |
| Control | 0..* |
| Comments | The parameter value can be dynamic at runtime. |
| TestScript.setup.action.assert.rule.param.name | |
| Definition | Descriptive name for this parameter that matches the external assert rule parameter name. |
| Control | 1..1 |
| Type | string |
| Comments | The external rule template would be looking for the parameter by this name. |
| TestScript.setup.action.assert.rule.param.value | |
| Definition | The value for the parameter that will be passed on to the external rule template. |
| Control | 1..1 |
| Type | string |
| Comments | This value overwrites the value (if any) specified in TestScript.rule.param.value. The param value can be a string-representation of a number, string, or boolean that is expected. Test engines do have to look for placeholders (${}) and replace the variable placeholders with the variable values at runtime before supplying this value to the external rule template. |
| TestScript.setup.action.assert.ruleset | |
| Definition | The TestScript.ruleset this assert will evaluate. |
| Control | 0..1 |
| Comments | Each rule within a ruleset should get evaluated by test engines as a separate assertion. The impact of negative rule evaluation on test script execution is the same as an assertion failure which is descibed elsewhere in the TestScript resource. If the first rule within the ruleset results in a failed assertion, then test engines do not have to evaluate the rest of the rules within the ruleset. |
| TestScript.setup.action.assert.ruleset.rulesetId | |
| Definition | The TestScript.ruleset id value this assert will evaluate. |
| Control | 1..1 |
| Type | id |
| TestScript.setup.action.assert.ruleset.rule | |
| Definition | The referenced rule within the external ruleset template. |
| Control | 0..* |
| Comments | This qualifies each param name so that a parameter with the same name can be used differently by the different rules with the ruleset. |
| TestScript.setup.action.assert.ruleset.rule.ruleId | |
| Definition | Id of the referenced rule within the external ruleset template. |
| Control | 1..1 |
| Type | id |
| TestScript.setup.action.assert.ruleset.rule.param | |
| Definition | Each rule template can take one or more parameters for rule evaluation. |
| Control | 0..* |
| Comments | The parameter value can be dynamic at runtime. |
| TestScript.setup.action.assert.ruleset.rule.param.name | |
| Definition | Descriptive name for this parameter that matches the external assert ruleset rule parameter name. |
| Control | 1..1 |
| Type | string |
| Comments | The external rule template would be looking for the parameter by this name. |
| TestScript.setup.action.assert.ruleset.rule.param.value | |
| Definition | The value for the parameter that will be passed on to the external ruleset rule template. |
| Control | 1..1 |
| Type | string |
| Comments | This value overwrites the value (if any) specified in TestScript.ruleset.rule.param.value. The param value can be a string-representation of a number, string, or boolean that is expected. Test engines do have to look for placeholders (${}) and replace the variable placeholders with the variable values at runtime before supplying this value to the external rule template. |
| TestScript.setup.action.assert.sourceId | |
| Definition |
Fixture to evaluate the XPath/JSONPath expression or the headerField against. |
| Control | 0..1 |
| Type | id |
| Comments |
This can be a statically defined fixture (at the top of the testscript) or a dynamically set fixture created by responseId of the action.operation element. |
| TestScript.setup.action.assert.validateProfileId | |
| Definition |
The ID of the Profile to validate against. |
| Control | 0..1 |
| Type | id |
| Comments |
The ID of a Profile fixture. Asserts that the response is valid according to the Profile specified by validateProfileId. |
| TestScript.setup.action.assert.value | |
| Definition |
The value to compare to. |
| Control | 0..1 |
| Type | string |
| Comments |
The string-representation of a number, string, or boolean that is expected. Test engines do have to look for placeholders (${}) and replace the variable placeholders with the variable values at runtime before comparing this value to the actual value. |
| TestScript.setup.action.assert.warningOnly | |
| Definition |
Whether or not the test execution will produce a warning only on error for this assert. |
| Control | 0..1 |
| Type | boolean |
| Default Value | false |
| Comments |
If this element is specified and it is true, then assertion failures can be logged by test engine but should not stop the test script execution from proceeding. There are likely cases where the spec is not clear on what should happen. If the spec says something is optional (maybe a response header for example), but a server doesn’t do it, we could choose to issue a warning. |
| TestScript.test | |
| Definition |
A test in this script. |
| Control | 0..* |
| TestScript.test.name | |
| Definition |
The name of this test used for tracking/logging purposes by test engines. |
| Control | 0..1 |
| Type | string |
| TestScript.test.description | |
| Definition |
A short description of the test used by test engines for tracking and reporting purposes. |
| Control | 0..1 |
| Type | string |
|
|
|
| Definition |
Action would contain either an operation or an assertion. |
| Control | 1..* |
| Comments |
An action should contain either an operation or an assertion but not both. It can contain any number of variables. |
| Invariants |
Defined
on
this
element
inv-2 : Test action SHALL contain either an operation or assert but not both. :
operation.exists()
xor
assert.exists(),
xpath:
(f:operation
or
f:assert)
and
not(f:operation
and
f:assert))
|
| TestScript.test.action.operation | |
| Definition |
An operation would involve a REST request to a server. |
| Control | 0..1 |
| Type | See TestScript.setup.action.operation |
| Invariants |
Defined
on
this
element
:
sourceId.exists()
or
(targetId.count()
+
url.count()
+
params.count()
=
1)
or
(type.code
in
('capabilities'
|
'search'
|
'transaction'
|
'history')),
xpath:
f:sourceId
or
(f:targetId
or
f:url
or
f:params)
and
(count(f:targetId)
+
count(f:url)
+
count(f:params)
=1)
or
|
| TestScript.test.action.assert | |
| Definition |
Evaluates the results of previous operations to determine if the server under test behaves appropriately. |
| Control | 0..1 |
| Type | See TestScript.setup.action.assert |
| Comments |
In order to evaluate an assertion, the request, response, and results of the most recently executed operation must always be maintained by the test engine. |
| Invariants |
Defined
on
this
element
:
compareToSourceId.empty()
xor
(compareToSourceExpression.exists()
or
compareToSourcePath.exists()),
xpath:
(f:compareToSourceId
and
f:compareToSourceExpression)
or
(f:compareToSourceId
and
f:compareToSourcePath)
or
not(f:compareToSourceId
or
f:compareToSourceExpression
or
f:compareToSourcePath))
:
(response.empty()
and
responseCode.empty()
and
direction
=
'request')
or
direction.empty()
or
direction
=
'response',
xpath:
((count(f:response)
+
count(f:responseCode))
=
0
and
(f:direction/@value='request'))
or
(count(f:direction)
=
0)
or
(f:direction/@value='response'))
inv-6 : Only a single assertion SHALL be present within test action assert element. :
contentType.count()
+
expression.count()
+
headerField.count()
+
minimumId.count()
+
navigationLinks.count()
+
path.count()
+
requestMethod.count()
+
resource.count()
+
responseCode.count()
+
response.count()
+
rule.count()
+
ruleset.count()
+
validateProfileId.count()
<=1,
xpath:
count(f:contentType)
+
count(f:expression)
+
count(f:headerField)
+
count(f:minimumId)
+
count(f:navigationLinks)
+
count(f:path)
+
count(f:requestMethod)
+
count(f:resource)
+
count(f:responseCode)
+
count(f:response)
+
count(f:rule)
+
count(f:ruleset)
+
count(f:validateProfileId)
<=1)
|
| TestScript.teardown | |
| Definition |
A series of operations required to clean up after the all the tests are executed (successfully or otherwise). |
| Control | 0..1 |
| TestScript.teardown.action | |
| Definition |
The teardown action will only contain an operation. |
| Control | 1..* |
| Comments |
An action should contain either an operation or an assertion but not both. It can contain any number of variables. |
| TestScript.teardown.action.operation | |
| Definition |
An operation would involve a REST request to a server. |
| Control |
|
| Type | See TestScript.setup.action.operation |
| Invariants |
Defined
on
this
element
:
sourceId.exists()
or
(targetId.count()
+
url.count()
+
params.count()
=
1)
or
(type.code
in
('capabilities'
|
'search'
|
'transaction'
|
'history')),
xpath:
f:sourceId
or
(f:targetId
or
f:url
or
(f:params
and
f:resource))
and
(count(f:targetId)
+
count(f:url)
+
count(f:params)
=1)
or
|