Comments (3)
In order to support the new requirement, it is proposed to:
structure message changes:
Reference Metadata against Structure Metadata
- The Provision Agreement now only links to a Dataflow, and a new Object called Metadata Provision is introduced which enables linking to Metadataflows.
- Restrict the MSD to a single Report structure, by removing the Report structure container. The Metadata Attributes are now a direct child of the MSD and not children of Report Structure containers.
- The Metadata Target is moved it to the Metadataflow/Metadata Provision and is no longer a part of the MSD.
- The Metadata Target is simplified, only allowing a references to identifiable structure(s), which may include wildcarded references. The Metadata Provision can also include zero to many Metadata Targets in order to further restrict the targets of the Metadataflow.
- The reported MetadataSet includes an absolute reference to the Metadataflow and/or Metadata Provision which it is reported against, and one or more target structures, which must comply with the restrictions imposed by the Metadataflow and/or the Metadata Provision.
- The role of the content constraint for a metadata collection is not to restrict targets, but restrict content for each Metadata Attribute.
Reference Metadata against Datasets
- The ability for the DSD to optionally describe the relationship between the MSD Metadata Attribute and the Dimensions against which metadata can be reported. Where the absence of this relationship definition is interpreted as the Metadata Attribute being able to be reported against any combination of Dimensions.
- The AttributeRelationship provides the ability to make Dimension references optional:
<str:AttributeRelationship>
<str:Dimension optional="true">
<Ref id="REF_AREA"/>
</str:Dimension>
<str:Dimension>
<Ref id="INDICATOR"/>
</str:Dimension>
</str:AttributeRelationship>
- XHTML is introduced as an allowable data type. The already used XHTMLType allows for mixed content of text and XHTML tags.
- Non-enumerated text Attributes (HTML/String) also support multilingual text.
--> Implemented in structure schemas by J
data message changes:
Reference Metadata against Structure Metadata
- Removing the Report structure reference and the AttributeSet container from the MetadataSet. The Metadata Attributes are now a direct MetadataSet
- The reported MetadataSet includes an absolute reference to the Metadataflow and/or Metadata Provision which it is reported against (a simple structure reference!), and one or more target structures (now also simple structure references!), which must comply with the restrictions imposed by the Metadataflow and/or the Metadata Provision.
<MetadataSet id="ALB" providerID="ALB" version="1.0.0">
<Metadataflow agencyID="OECD" id="ALB_DQAF" version="1.0.0"/>
<Target type="Dataflow" aganecyID="OECD" id="GDP" version="1.0.0"/>
<Attr id="ATTRIBUTE_1">
Lorem Ipsum
<Attr id="ATTRIBUTE_1_1">Lorem Ipsum<Attr/>
<Attr id="ATTRIBUTE_1_2">
<StructuredText xml:lang="en">
<div xmlns="http://www.w3.org/1999/xhtml">
<p>Lorem Ipsum</p>
</div>
</StructuredText>
</Attr>
</Attr>
</Attr>
</MetadataSet>
<MetadataSet id="ALB" providerID="ALB" version="1.0.0">
<MetadataProvision agencyID="OECD" id="ALB_DQAF" version="1.0.0"/>
<Target type="Dataflow" aganecyID="OECD" id="GDP" version="1.0.0"/>
<Attr id="ATTRIBUTE_1">
Lorem Ipsum
<Attr id="ATTRIBUTE_1_1">Lorem Ipsum<Attr/>
<Attr id="ATTRIBUTE_1_2">
<StructuredText xml:lang="en">
<div xmlns="http://www.w3.org/1999/xhtml">
<p>Lorem Ipsum</p>
</div>
</StructuredText>
</Attr>
</Attr>
</Attr>
</MetadataSet>
- Only the GenericMetadata message is updated for SDMX3.0 because it allows a direct XML database storage with a single schema and it is in general not more verbose than the StructureSpecificMetadata message. The StructureSpecificMetadata message is deprecated and not updated to SDMX 3.0.
Reference Metadata against Datasets
- Values of MSD Metadata Attributes referenced by DSD are allowed to be transmitted with or without the data (and so allow including only relevant dimensions)
- For data messages we extend this possibility to transmit any attribute values with or without the data (thus separately).
° current syntax
<Series FREQ="A" INDICATOR="A" REF_AREA="DZA">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="111" OBS_STATUS="A"/>
</Series>
<Series FREQ="A" INDICATOR="A" REF_AREA="CZE">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="222" OBS_STATUS="A"/>
</Series>
<Series FREQ="A" INDICATOR="A" REF_AREA="ROM">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="333" OBS_STATUS="A"/>
</Series>
<Obs FREQ="A" INDICATOR="A" REF_AREA="DZA" TIME_PERIOD="2010-08" OBS_VALUE="111" OBS_STATUS="A"/>
<Obs FREQ="A" INDICATOR="A" REF_AREA="CZE" TIME_PERIOD="2010-08" OBS_VALUE="222" OBS_STATUS="A"/>
<Obs FREQ="A" INDICATOR="A" REF_AREA="ROM" TIME_PERIOD="2010-08" OBS_VALUE="333" OBS_STATUS="A"/>
° New syntax for attributes (e.g. metadata attributes): a subset of dimensions is sufficient for the new Attr
object containing partial-key or dataset-level attributes
<Series FREQ="A" INDICATOR="A" REF_AREA="DZA">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="111" OBS_STATUS="A"/>
</Series>
<Series FREQ="A" INDICATOR="A" REF_AREA="CZE">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="222" OBS_STATUS="A"/>
</Series>
<Series FREQ="A" INDICATOR="A" REF_AREA="ROM">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="333" OBS_STATUS="A"/>
</Series>
<Attr INDICATOR="A" UNIT_MEASURE="CPW" UNIT_MULT="0"/>
<Obs FREQ="A" INDICATOR="A" REF_AREA="DZA" TIME_PERIOD="2010-08" OBS_VALUE="111" OBS_STATUS="A"/>
<Obs FREQ="A" INDICATOR="A" REF_AREA="CZE" TIME_PERIOD="2010-08" OBS_VALUE="222" OBS_STATUS="A"/>
<Obs FREQ="A" INDICATOR="A" REF_AREA="ROM" TIME_PERIOD="2010-08" OBS_VALUE="333" OBS_STATUS="A"/>
<Attr INDICATOR="A" UNIT_MEASURE="CPW" UNIT_MULT="0"/>
° New syntax for attributes without data: a subset of dimensions is sufficient for the new Attr
object containing partial-key or dataset-level attributes
<Attr INDICATOR="A" UNIT_MEASURE="CPW" UNIT_MULT="0"/>
- XHTML is introduced as an allowable data type.
<Series FREQ="A" INDICATOR="A" REF_AREA="DZA">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="111" OBS_STATUS="A"/>
<HTML_ATTR>
<StructuredText xml:lang="en">
<div xmlns="http://www.w3.org/1999/xhtml">
<p>Lorem Ipsum</p>
</div>
</StructuredText>
</HTML_ATTR>
</Obs>
</Series>
<Attr INDICATOR="A" UNIT_MEASURE="CPW" UNIT_MULT="0"/>
<HTML_ATTR>
<StructuredText xml:lang="en">
<div xmlns="http://www.w3.org/1999/xhtml">
<p>Lorem Ipsum</p>
</div>
</StructuredText>
</HTML_ATTR>
</Attr>
- Non-enumerated text Attributes (HTML/String) also support multilingual text.
<Series FREQ="A" INDICATOR="A" REF_AREA="DZA">
<Obs TIME_PERIOD="2010-08" OBS_VALUE="111" OBS_STATUS="A"/>
<LOCAL_ATTR>
<Text xml:lang="en">Lorem Ipsum</Text>
<Text xml:lang="fr">Lorem Ipsum</Text>
</LOCAL_ATTR>
</Obs>
</Series>
<Attr INDICATOR="A" UNIT_MEASURE="CPW" UNIT_MULT="0"/>
<LOCAL_ATTR>
<Text xml:lang="en">Lorem Ipsum</Text>
<Text xml:lang="fr">Lorem Ipsum</Text>
</LOCAL_ATTR>
</Attr>
- Attributes also support multiple values (from "feature 003 Microdata exchange").
<Attr INDICATOR="A" UNIT_MEASURE="CPW" UNIT_MULT="0"/>
<MULTI_ATTR>
<Value>AAA</Value>
<Value>BBB</Value>
</MULTI_ATTR>
</Attr>
from sdmx-ml.
@jgager @agent96 I see the following differences between the new file "SDMX_3-0-0_SECTION_3A_PART_IV_DATA.doc" and the above specs:
- providerID has been renamed to agencyID: I thought that the metadataset's providerID is different from a normal agency. Could you please confirm?
- MetadataProvision has been renamed to MetadataProvisionAgreement: OK
- MetadataStructure is still in the IM but should be removed, because the MSD doesn't contain any target definitions. Only either Metadataflow or MetadataProvisionAgreement must be referenced.
- Attr has been renamed to Att: Why?
- The MetadataSet is allowed to have several targets. Is this really allowed?
from sdmx-ml.
Released
from sdmx-ml.
Related Issues (20)
- SDMX 3.0: implement "feature 006 Discriminated union of codelists" for SDMX-ML messages HOT 1
- SDMX 3.0: implement "feature 008 Enhance the constraints artefacts" for SDMX-ML messages HOT 1
- SDMX 3.0: implement "feature 010 Improve mapping by enhancing the Structure Set artefact" for SDMX-ML messages HOT 2
- SDMX 3.0: implement "feature 012 Referencing of hierarchical codelists" for SDMX-ML messages HOT 1
- SDMX 3.0: implement "feature 014 Schema attribute attachment at series and group level" for SDMX-ML messages HOT 2
- SDMX 3.0: implement "feature 013 Reorganising constraints" for SDMX-ML messages HOT 5
- SDMX 3.0: implement "feature 002 Support reference metadata in the Restful APIs" for SDMX-ML messages HOT 12
- SDMX 3.0: implement "feature 029 Improving API data queries" for SDMX-ML messages HOT 2
- Geo component and concept role name HOT 4
- GeospatialInformation and WKT question HOT 2
- Metadata in Dataset question HOT 2
- Possibly bug/breaking change in parent items regular expression HOT 5
- Data message to fully replace data
- Handling of missing values
- Review isMultiLingual default in Data attributes/measures HOT 2
- Schema Typo HOT 3
- Reference Metadata attributes may only have one single value HOT 1
- Possible error in SDMX to VTL date/time conversion specifications
- Unclear representation of geospatial artefacts
- Typo in SemanticVersionReferenceType Pattern
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sdmx-ml.