2024-03-29T14:33:52Zhttps://kuscholarworks.ku.edu/oai/requestoai:kuscholarworks.ku.edu:1808/110472019-04-12T14:13:30Zcom_1808_11004com_1808_54col_1808_11005
REDCap and DDI Exporting Data and Metadata with the API
Hoyle, Larry
Van Roekel, Ada
DDI
NADDI
Metadata
Data documentation
REDCap
Presentation at the North American Data Documentation Conference (NADDI) 2013
The REDCap (Research Electronic Data Capture) consortium is a group of over 450 institutions that supports a web application which supports data capture for research studies (see http://project-redcap.org/). The application allows interactive survey instrument development and data collection. Data and scripts for SPSS, SAS and R can be exported from REDCap. Survey metadata including question text and flow control can be also exported as a csv file. This paper describes code in the R language to convert the REDCap survey metadata from csv to DDI 3.1. It includes a discussion of which REDCap instrument attributes can be represented by DDI 3.1 elements other than Note. This presentation includes information on the REDCap API and metadata about mapping data entry forms to events in a longitudinal study.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T16:06:27Z
2013-04-20T16:06:27Z
2013-04-03
Presentation
Hoyle, Larry, & Roekel, Ada Van. (2013). REDCap and DDI Exporting Data and Metadata with the API. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas April 3, 2013. http://hdl.handle.net/1808/11047
http://hdl.handle.net/1808/11047
en_US
openAccess
application/octet-stream
application/octet-stream
application/octet-stream
application/pdf
oai:kuscholarworks.ku.edu:1808/110452019-04-12T14:36:43Zcom_1808_11004com_1808_54col_1808_11005
Generic Statistical Information Model (GSIM)
Lalor, Thérèse
Vale, Steven
Gregory, Arofan
DDI
NADDI
Metadata
Data documentation
GSIM
Presentation at the North American Data Documentation Conference (NADDI) 2013
Across the world statistical organizations undertake similar activities. Each of these activities use and produce similar information (for example all agencies use classifications, create data sets and publish products). Although the information is at its core the same, organizations tend to describe this information slightly differently (and often in different ways within each organization). There is no common means to describe the information. GSIM is a conceptual model that provides a set of standardized, consistently described information objects, which are the inputs and outputs in the design and production of statistics. DDI is a key standard in both the development of GSIM itself, and as an implementation tool for organizations using GSIM. Beyond that, it also will influence the future directions of DDI development, attracting a larger number of data producers into the DDI community. This presentation introduces GSIM and looks at the interaction between GSIM and DDI (and other related standards), and provides an update on a rapidly-evolving vision around the use of DDI within the statistical institutes in Europe and elsewhere. It will cover both the direct interaction between DDI and GSIM, and also provide a broader context for understanding what that dynamic may mean in the future.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T15:31:53Z
2013-04-20T15:31:53Z
2013-04-03
Presentation
Lalor, Thérèse, Steven Vale, Arofan Gregory. (2013). Generic Statistical Information Model (GSIM). Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 3, 2013. http://hdl.handle.net/1808/11045
http://hdl.handle.net/1808/11045
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
application/pdf
oai:kuscholarworks.ku.edu:1808/110932019-04-12T14:37:56Zcom_1808_11004com_1808_54col_1808_11005
Improving User Access to Metadata for Public and Restricted Use US Federal Statistical Files
Block, William C.
Williams, Jeremy
Vilhuber, Lars
Lagoze, Carl
Brown, Warren
Abowd, John
DDI
NADDI
Metadata
Data documentation
Presentation at the North American Data Documentation Conference (NADDI) 2013
The US federal statistical system produces prodigious amounts of public and restricted use data. The restricted use data can be difficult to interact with due to poor documentation. Documentation across agencies and the public use/restricted use divide that has been produced does not adhere to a single standard, making the metadata useful, but insular. The Data Documentation Initiative (DDI) is an emerging metadata standard that is used internationally to describe data in the social sciences. It has the potential to unify the metadata managed by separate organizations into a comprehensive searchable set. Researchers from the Labor Dynamics Institute, in collaboration with the Cornell Institute for Social and Economic Research (CISER) received funding from the National Science Foundation to improve the documentation of federal statistical system data with the goal of making it more discoverable, accessible and understandable for scientific research. The scope of this paper is a subset of the overall project, and reports on development of the web interface for user searches and the search API. The primary data model being utilized in this application is DDI 2.5 (Codebook), which contains elements and attributes to describe the contents of a data set.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-05-06T15:48:10Z
2013-05-06T15:48:10Z
2013-04-03
Presentation
http://hdl.handle.net/1808/11093
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110552019-04-12T14:37:50Zcom_1808_11004com_1808_54col_1808_11005
DDI Specification: Current Status and Outlook
Thomas, Wendy
Gregory, Arofan
DDI
NADDI
Metadata
Data documentation
TIC
Presentation at the North American Data Documentation Conference (NADDI) 2013
An update on current activities and plans from DDI Technical Implementation Committee (TIC) members.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T19:59:33Z
2013-04-20T19:59:33Z
2013-04-03
Presentation
Thomas, Wendy, Arofan Gregory. (2013). DDI Specification: Current Status and Outlook. Presentation at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 3, 2013. http://hdl.handle.net/1808/11055
http://hdl.handle.net/1808/11055
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110522019-04-12T14:13:39Zcom_1808_1069com_1808_8717com_1808_11004com_1808_54col_1808_7465col_1808_8718col_1808_11005
PANEL: DDI and Metadata from the Researcher's Perspective
Thomas, Wendy
Brown, J. Christopher
Nakao, Ron
DDI
NADDI
Metadata
Data documentation
Researcher
Drupal
Stanford University Libraries
Presentation at the North American Data Documentation Conference (NADDI) 2013
This was a panel discussion on lifecycle metadata issues from the researcher's perspective.
A lot of focus has been placed on how to integrate DDI into large data collection processes in the world of official statistics, research centers, and long term projects. It makes sense in these areas to talk about the payoff for metadata reuse, developing processes and tools to harvest metadata along a production process, and the value of a software neutral means of capturing and transporting metadata. The question facing academic based data libraries and archives is how to integrate DDI into the smaller, limited time frame, research project. What are the payoffs for the individual researcher? What tools can be provided to support researchers? This panel is designed to gather input from attendees to help answer the following questions:
How can the use of DDI throughout the research process help researchers during the process?
What needs to be there (tools, processes, informational materials, etc.)?
What can data libraries/archives/services do to promote and support DDI use?
What is needed from others (Funding agencies, academic departments, computing services, etc.)?
What can DDI do to increase the use of DDI within the academic environment?
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T19:08:40Z
2013-04-20T19:08:40Z
2013-04-02
Presentation
Thomas, Wendy,J. Christopher Brown, Ron Nakao. (2013). PANEL: DDI and Metadata from the Researcher's Perspective. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11052
http://hdl.handle.net/1808/11052
en_US
openAccess
application/vnd.ms-powerpoint
application/vnd.ms-powerpoint
application/pdf
application/pdf
oai:kuscholarworks.ku.edu:1808/110532019-04-12T14:12:55Zcom_1808_11004com_1808_54col_1808_11005
Applying DDI to a Longitudinal Study of Aging
Radler, Barry
Iverson, Jeremy
Smith, Dan
DDI
NADDI
Metadata
Data documentation
MIDUS
Presentation at the North American Data Documentation Conference (NADDI) 2013
Midlife in the United States (MIDUS) is a large, multi-disciplinary longitudinal study of aging conducted by the University of Wisconsin. MIDUS researchers want to provide a comprehensive, canonical source of documentation for the research project. To accomplish this, the team took the diverse set of sources that previously documented the MIDUS study and created a standardized, DDI 3-based set of documentation that better enables researchers to discover and use the MIDUS data. This talk will outline the process used to create the DDI 3 documentation, and will demonstrate the resulting documentation and dissemination tools provided by Colectica. The project is a joint effort between MIDUS and Colectica.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T19:34:49Z
2013-04-20T19:34:49Z
2013-04-02
Presentation
Radler, Barry, Jeremy Iverson, Dan Smith. (2013). Applying DDI to a Longitudinal Study of Aging. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11053
http://hdl.handle.net/1808/11053
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110582019-04-12T14:37:52Zcom_1808_11004com_1808_54col_1808_11005
Using SAS to generate DDI-Codebook XML from Information Managed in Excel Spreadsheets
Wright, Philip A.
DDI
NADDI
Metadata
Data documentation
SAS
Presentation at the North American Data Documentation Conference (NADDI) 2013
DDI-C compliant files are used for two distinct rolls by ICPSR to generate variable documentation from information managed in Excel spreadsheets by the data producer. For completed studies, DDI-C compliant files are used to generate codebooks which include unweighted frequencies. For data in production, DDI-C is used to bulk load questions and variable attributes into a browser-based variable editor. This presentation will describe in moderate detail how SAS is used to generate the major DDI-C XML elements.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T20:21:21Z
2013-04-20T20:21:21Z
2013-04-02
Presentation
Wright, Philip A.. (2013). Using SAS to generate DDI-Codebook XML from Information Managed in Excel Spreadsheets. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11058
http://hdl.handle.net/1808/11058
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110632019-04-12T14:31:17Zcom_1808_11004com_1808_54col_1808_11005
Rogatus – a planned open source toolset to cover the whole lifecycle
Barkow, Ingo
Schiller, David
DDI
NADDI
Data documentation
GLBPM
Framework
Toolchain
Presentation at the North American Data Documentation Conference (NADDI) 2013
During the last years several different tools for DDI Lifecycle have been published. Nevertheless none of the current tools is able to cover the full lifecycle from beginning to end. This presentation wants to show a first outlook into Rogatus - an open source toolset currently in development at DIPF with support of GESIS, TBA21, OPIT, Colectica, Alerk Amin and IAB. Rogatus consists of different DDI compliant applications (e.g. Qbee - Questionnaire Builder, Cbee – Case Builder, Tbee – Translation Builder, Mbee – Metadata Builder and Rogatus Portal). Furthermore some components are re-used in other software products (e.g. IAB Metadata Management Portal). This presentation will also show how a final version of Rogatus could be combined with other well-known tools like Colectica or Questasy using DDI as standard for data exchange to show how a survey process from creating a study from the scratch, designing the instruments, performing the data collection, handling the administrative processes, curating the data, disseminating the data, publication and at last data archiving for secondary usage could be handled with individual tools.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-23T15:22:10Z
2013-04-23T15:22:10Z
2013-04-02
Presentation
Barkow, Ingo, David Schiller. (2013). Rogatus – a planned open source toolset to cover the whole lifecycle. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11063
http://hdl.handle.net/1808/11063
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110402019-04-12T14:37:57Zcom_1808_11004com_1808_54col_1808_11005
Data and Metadata Harmonization for the RAND Survey Meta Data Repository
Amin, Alerk
DDI
NADDI
Metadata
Data documentation
RAND
HRS
Health and Retirement Study
Presentation at the North American Data Documentation Conference (NADDI) 2013
The RAND Survey Meta Data Repository aims to help researchers use data and metadata from the HRS-family of surveys on aging, including studies from the US, UK/Europe and Asia. The project consists of 3 major parts: 1) Importing the metadata for each wave of each survey (in various formats such as DDI, Excel, Word/PDF) and linking the various modules/items with a single hierarchy of concepts 2) Creating the RAND Harmonized datasets by combining data across different waves of different studies, to facilitate easier comparison across years and countries 3) The Repository website, which provides researchers a single point of access to browse/search the metadata across all of the different surveys Currently, only one of the studies provides metadata in DDI format to simplify the import process; for the other studies, custom scripts and a great deal of manual effort are required. This presentation will discuss how DDI could be used to improve the process of importing the metadata and creating the RAND Harmonized datasets, as well as benefits for the researchers that access the Repository.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance, RAND Corporation
2013-04-17T19:33:39Z
2013-04-17T19:33:39Z
2013-04-17
Presentation
http://hdl.handle.net/1808/11040
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/277792020-10-13T21:34:51Zcom_1808_11004com_1808_54col_1808_11005
Mapping DDI2 to DDI4
Hoyle, Larry
Wackerow, Joachim
DDI
DDI4
DDI2
Poster presented at the North American Data Description Conference (NADDI2019) in Ottawa, Canada April 2019.
This poster describes the effort to add a DDI-Codebook (DDI-C) import function into the DDI4R R package.
The DDI4 Codebook Group did a lot of the modeling of one section of DDI4 using a spreadsheet mapping DDI-C elements into DDI4 properties. This started with a list of elements used by CESSDA and was refined at the May 2016 Knutholmen Sprint. Unfortunately, these mappings were not always at the leaf node level.
An R program also imported DDI-C XML from the European Social Survey and generated a list of unique XPaths of leaf elements used in that set of metadata. These elements, along with corresponding DDI4 leaf paths, were used to update the spreadsheet.
This spreadsheet has been further refined to create an actionable table mapping DDI-C leaf values to leaf properties in DDI4. Writing code to import the DDI-C required additional information:
• mapping from DDI-C sub-paths to DDI4 Identifiable classes (e.g. all the information for one DDI-C “var” maps to one DDI4 IdentifiableVariable),
• mapping abstract target classes to specific extensions,
• additional semantic property values like “typeOfMethodology”.
Importing DDI-C into a lifecycle level version of DDI like DDI4 also involves identifying repeated metadata like reused value domains (e.g. reused Likert style codelists) that are repeated for multiple variables. An R function served to do this sort of matching using the R “all.equal” function excluding differences in agency, id, and version.
2019-05-06T14:25:18Z
2019-05-06T14:25:18Z
2019-05-06
Presentation
http://hdl.handle.net/1808/27779
https://orcid.org/0000-0002-8262-2393
https://orcid.org/0000-0003-2525-3912
This work is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0).
https://creativecommons.org/licenses/by/4.0/
openAccess
application/vnd.openxmlformats-officedocument.presentationml.presentation
image/jpeg
application/pdf
oai:kuscholarworks.ku.edu:1808/110542019-04-12T14:37:50Zcom_1808_11004com_1808_54col_1808_11005
Colectica for Excel: Using DDI Lifecycle with Spreadsheets
Smith, Dan
DDI
NADDI
Metadata
Data documentation
Excel
Colectica
Presentation at the North American Data Documentation Conference (NADDI) 2013
Colectica is a suite of modern metadata management software that is used to document statistical datasets, public opinion and survey research methodologies, and data collection. This demonstration will introduce the new Colectica for Microsoft Excel software, a free tool to document statistical data using open standards. The software implements leading open standards including the Data Documentation Initiative (DDI) Lifecycle version 3 and ISO 11179. Using this software allows organizations to both better educate sponsors and the public on their methodology and increases the organization’s reputation for performing credible scientific research. The free Colectica for Excel tool allows researchers to document their data directly in Microsoft Excel. Variables, Code Lists, and the datasets can be globally identified and described in a standard format. Data can also be directly imported and documented from SPSS and Stata files. The standardized metadata is stored within the Excel files so it will be available to anyone receiving the documented dataset. Code books can also be customized and generated by the tool, and output in PDF, Word, Html, and XSL-FO formats.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T19:49:27Z
2013-04-20T19:49:27Z
2013-04-02
Presentation
Smith, Dan. (2013). Colectica for Excel: Using DDI Lifecycle with Spreadsheets. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11054
http://hdl.handle.net/1808/11054
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110592019-04-12T14:39:04Zcom_1808_11004com_1808_54col_1808_11005
DDI: Capturing metadata throughout the research process for preservation and discovery
Thomas, Wendy
DDI
NADDI
Metadata
Data documentation
DDI-C
DDI-L
Codebook
Lifecycle
Workshop at the North American Data Documentation Conference (NADDI) 2013
DDI supports two development lines, DDI-Codebook (DDI-C) and DDI-Lifecycle (DDI-L). This workshop provides an overview of the uses of both DDI-C and DDI-L in capturing metadata during the research process and how it is used for preservation and discovery purposes. The focus is on the types of metadata covered by DDI, how they are structured, and how they are used across the data lifecycle. Differences between the two development lines will be highlighted including structural and coverage differences.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T20:31:06Z
2013-04-20T20:31:06Z
2013-04-04
Learning Object
Presentation
Thomas, Wendy. (2013). DDI: Capturing metadata throughout the research process for preservation and discovery. Workshop delivered at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April DAY, 2013. http://hdl.handle.net/1808/11059
http://hdl.handle.net/1808/11059
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110642019-04-12T14:31:17Zcom_1808_11004com_1808_54col_1808_11005
Administrative Data in the IAB Metadata Management System
Schiller, David
Barkow, Ingo
DDI
NADDI
Data documentation
Metadata
IAB
Administrative
Presentation at the North American Data Documentation Conference (NADDI) 2013
The Research Data Centre (FDZ) of the German Federal Employment Agency (BA) at the Institute for Employment Research (IAB) prepares and gives access to research data. Beside survey data the IAB provides data deriving from the administrative processes of the BA. This data is very complex and not easy to understand and use. Good data documentation is crucial for the users. DDI provides a data documentation standard that makes documentation and data sharing easier. The latter is especially important for providers of administrative data because more and more other data types are merged with administrative data. Nevertheless there are also some drawbacks when using the DDI standard. Data collection for administrative data differs from data collection for survey data but DDI was established for survey data. At the same time the description of complex administrative data should be simple as possible. IAB and TBA21 are currently carrying out a project to build a Metadata Management System for IAB. The presentation will highlight the documentation needs for administrative data and show how they are covered in the Management System. In addition the need for DDI profiles, comprehensive software tools and future proofed data documentation for multiple data sources will be depicted.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-23T15:41:25Z
2013-04-23T15:41:25Z
2013-04-02
Presentation
Schiller, David, Ingo Barkow. (2013). Administrative Data in the IAB Metadata Management System. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11064
http://hdl.handle.net/1808/11064
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110432019-04-12T14:12:46Zcom_1808_11004com_1808_54col_1808_11005
Michigan Questionnaire Documentation System (MQDS)
Cheung, Gina-Qian
DDI
NADDI
Metadata
Data documentation
Michigan Questionnaire Documentation
MQDS
Questionnaire documentation
Blaise
DDI schema
Presentation at the North American Data Documentation Conference (NADDI) 2013
The Michigan Questionnaire Documentation System (MQDS) is a powerful tool used to help create questionnaire documentation, with or without summary statistics, and other documentation based on the Blaise data model for a study. MQDS works by:
1. Analyzing the data model and its associated files, and then importing the Blaise metadata and data to the MQDS database; 2. Exporting that information to an eXtensible Markup Language (.xml) file; and 3. Rendering the needed elements via eXtensible Stylesheet Language (.xsl), and then generating HyperText Markup Language (HTML), Rich Text Format (.rtf) and Portable Document File (.pdf) formatted output.
MQDS output is used for testing instruments, reviewing questionnaires, preparing documentation, and comparing questionnaires across data models or across studies. MQDS is also capable of providing summary statistics by reading in a Blaise database file and a corresponding Blaise data model and outputting the questionnaire with data file contents into an HTML, RTF, or PDF file format.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T14:43:34Z
2013-04-20T14:43:34Z
2013-04-03
Presentation
Cheung, Gina-Qian. (2013). Michigan Questionnaire Documentation System (MQDS). Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 3, 2013 http://hdl.handle.net/1808/11043
http://hdl.handle.net/1808/11043
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110462019-04-12T14:36:31Zcom_1808_11004com_1808_54col_1808_11005
DDI Extensions for Qualitative Data
Gregory, Arofan
Hoyle, Larry
DDI
NADDI
Metadata
Data documentation
Qualitative
Presentation at the North American Data Documentation Conference (NADDI) 2013
DDI's origins lie in structuring metadata for quantitative data, data represented by numbers or by a set of values that can be tabulated. Many researchers though, generate or analyze unstructured data, text documents, images, video, sound recordings and more. In 2010 the DDI Alliance formed a DDI working group (http://www.ddialliance.org/alliance/working-groups#qdewg) charged with "developing a robust XML-based schema for qualitative data exchange (compliant with DDI) and encourage tools development based upon these needs". This presentation will report on the progress of that group and describe the state of the DDI Qualitative Data Model as of the working group meeting in Bergen, Norway in November 2012. A discussion period for feedback on the model will follow the presentation.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T15:48:02Z
2013-04-20T15:48:02Z
2013-04-02
Presentation
Gregory, Arofan, Larry Hoyle. (2013). DDI Extensions for Qualitative Data. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11046
http://hdl.handle.net/1808/11046
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/237422018-05-23T16:33:02Zcom_1808_11004com_1808_54col_1808_11005
Sample Use Cases for the DataDictionary View in DDI Views (DDI4)
Gillman, Dan
Gregory, Arofan
Hoyle, Larry
Wenzig, Knut
UML
DDI
metadata
data dictionary
DDI4
Dagstuhl
This presentation is based on work done at Schloss Dagstuhl event 16433, October 23 through 28 2016. http://www.dagstuhl.de/de/programm/kalender/evhp/?semnr=16433
The DDI Moving Forward project (DDI-4) is the effort to modernize the way DDI is managed. Through the use of UML (Unified Modeling Language), a software independent representation of DDI is being developed and maintained. Compatibility with the older versions of DDI, DDI 2.x (Codebook) and DDI 3.x (Lifecycle), is a requirement. So, XML and RDF bindings to the UML model are being developed.
In order to be sure the new model is effective, various test cases are being applied to be sure the resulting XML is efficient. DDI Views (DDI4) has a DataDictionary View which can be used to describe the physical layout of a variety of data files. This presentation presents the use of this view to describe examples of CSV, fixed column, segmented fixed column, aggregate, and hierarchical files. Example datasets are drawn from the Australian Election Study, 2013 and the U.S. Census 2000 Public Use Microdata Sample.
The presentation will include a brief tour of the DDI Views model, descriptions of the classes and attributes useful for describing a physical file, and examples of the XML used to describe each type of file.
We will also discuss the description of event data, data where an event is the unit of observation.
DDI Views will need some new features to be able to deal with this flexible type of data. We will describe the additions needed to DDI Views necessary for describing event data .This presentation is based on work done at Schloss Dagstuhl event 16433, October 23 through 28 2016. http://www.dagstuhl.de/de/programm/kalender/evhp/?semnr=16433
2017-04-19T19:32:37Z
2017-04-19T19:32:37Z
2017-04-06
Presentation
http://hdl.handle.net/1808/23742
https://orcid.org/0000-0002-8262-2393
openAccess
application/vnd.openxmlformats-officedocument.presentationml.presentation
oai:kuscholarworks.ku.edu:1808/110612019-04-12T14:39:03Zcom_1808_11004com_1808_54col_1808_11005
DDI and Relational Databases
Amin, Alerk
Barkow, Ingo
DDI
NADDI
Metadata
Data documentation
Relational
database
Workshop at the North American Data Documentation Conference (NADDI) 2013
Although the DDI standard is expressed in XML, many institutions have a requirement or preference to use relational databases (eg. Access, MySQL, Oracle, Postgres) in their applications. This may be because of integration with existing applications, expertise at the institute, or other reasons. This workshop will discuss how to model DDI in a relational database, and the pros/cons of using this approach for application development. Interoperability with other applications, including those based on XML databases, and long term management of applications (including support for multiple versions of DDI) will also be discussed. Prior knowledge of relational databases and SQL is recommended but not required.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-22T13:06:18Z
2013-04-22T13:06:18Z
2013-04-04
Learning Object
Presentation
Amin, Alerk, Ingo Barkow. (2013). DDI and Relational Databases. Workshop delivered at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 4, 2013. http://hdl.handle.net/1808/11061
http://hdl.handle.net/1808/11061
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110442019-04-12T14:12:49Zcom_1808_11004com_1808_54col_1808_11005
DataForge: A DDI-Enabled Toolkit for Researchers and Data Managers
Gregory, Arofan
Heus, Pascal
Gager, J
DDI
NADDI
Metadata
Data documentation
DataForge
Presentation at the North American Data Documentation Conference (NADDI) 2013
Statistical data exist in many different shapes and forms such as proprietary software files (SAS, Stata, SPSS), ASCII text (fixed, CSV, delimited), databases (Microsoft, Oracle, MySql), or spreadsheets (Excel). Such wide variety of formats present producers, archivists, analysts, and other users with significant challenges in terms of data usability, preservation, or dissemination. These files also commonly contain essential information, like the data dictionary, that can be extracted and leveraged for documentation purposes, task automation, or further processing. Metadata Technology will be launching mid-2013 a new software utility suite, "DataForge", for facilitating reading/writing data across packages, producing various flavors of DDI metadata, and performing other useful operations around statistical datasets, to support data management, dissemination, or analysis activities. DataForge will initially be made available as desktop based products under both freeware and commercial licenses, with web based version to follow later on. IASSIST 2013 will mark the initial launch of the product. This presentation will provide an overview of DataForge capabilities and describe how to get access to the software.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T15:12:22Z
2013-04-20T15:12:22Z
2013-04-02
Presentation
Gregory, Arofan, Pascal Heus, J Gager. (2013). DataForge: A DDI-Enabled Toolkit for Researchers and Data Managers. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013 http://hdl.handle.net/1808/11044
http://hdl.handle.net/1808/11044
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/277782020-10-13T21:34:18Zcom_1808_11004com_1808_54col_1808_11005
DDI4 in R – New Possibilities Operations on Metadata
Hoyle, Larry
Wackerow, Joachim
DDI
DDI4
Metadata
Functions
Presented at the North American Data Description Conference (NADDI2019) in Ottawa, Canada April 2019.
We have been working on a representation of the DDI4 model in R, realized as a package. We now have an R object oriented class for each DDI4 class with associated functions to validate and print objects, manage a registry of DDI4 objects, manage DDI4 URNs, and import & export DDI4 XML.
Our original goal was to enhance the ability of researchers to capture and report on metadata at the source, with the ability to embed references to metadata.
In this presentation we’ll discuss the intriguing prospect of computing directly on the metadata. What could be done with these metadata objects to facilitate comparison and harmonization? In what ways could the metadata be visualized?
DDI4 has powerful new capabilities in the Collections pattern. For classes realizing a collection, operators could be defined to return their intersection, union, and difference. Inner and outer joins could also be defined. Relationships within the collection could be visualized via network diagrams. These operators might provide efficient tools for harmonization.
Operators could also be defined on pairs of objects of the same class. Similarity measures could be computed via corresponding attributes. These could be used to create visualizations of, say, similarities among variables.
2019-05-06T14:00:04Z
2019-05-06T14:00:04Z
2019-05-06
Presentation
http://hdl.handle.net/1808/27778
https://orcid.org/0000-0002-8262-2393
https://orcid.org/0000-0003-2525-3912
This work is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0).
https://creativecommons.org/licenses/by/4.0/
openAccess
application/vnd.openxmlformats-officedocument.presentationml.presentation
application/vnd.openxmlformats-officedocument.presentationml.presentation
text/csv
text/csv
oai:kuscholarworks.ku.edu:1808/110562019-04-12T14:37:50Zcom_1808_11004com_1808_54col_1808_11005
DDI - A Metadata Standard for the Community
Vardigan, Mary
Wackerow, Joachim
DDI
NADDI
Metadata
Data documentation
Presentation at the North American Data Documentation Conference (NADDI) 2013
This presentation gives an overview of the primary benefits of DDI like rich content, metadata reuse across the life cycle, and machine-actionability in a global network. Examples of successful adoption are described, along with barriers and challenges to using DDI. The presentation concludes with a summary of future directions for the standard.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T20:06:39Z
2013-04-20T20:06:39Z
2013-04-02
Presentation
Vardigan, Mary, Joachim Wackerow. (2013). DDI - A Metadata Standard for the Community. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11056
http://hdl.handle.net/1808/11056
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110652019-04-12T14:31:15Zcom_1808_11004com_1808_54col_1808_11005
The Paradata Information Model
Greenfield, Jay
Carpenter, Danielle
DDI
NADDI
Metadata
Data documentation
Paradata
Presentation at the North American Data Documentation Conference (NADDI) 2013
Paradata is data on study processes and the collection of study data. Here we describe the development of a Paradata Information Model
(PIM) in support of the National Children¹s Study (NCS) of the Eunice Kennedy Shriver National Institute of Child Health and Development. We propose that paradata can be recorded with accompanying metadata informed by the General Longitudinal Business Process Model (GLBPM) developed by the Data Documentation Initiative
(DDI) and the General Statistical Business Process Model (GSBPM). The PIM is be constructed in a joint top-down and bottom-up approach, appropriating broad verbs from DDI, HL7, LS-DAM, and CDISC, while incorporating study-specific processes involved in collecting NCS operational data elements (ODEs).
The hope of paradata in longitudinal studies is that the collection of paradata will ensure that future researchers can integrate disparate data sets collected by a variety of technologies, especially in rapidly-evolving fields like genomics. Additionally, by giving PIM elements preconditions and postconditions, we can develop software agents which use paradata metadata as well as other information to assist humans in conducting biomedical research, ultimately facilitating more rapid collection and analysis of information and enabling a broader subset of researchers to discover and extract relevant information from study data sets.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance, Booz Allen Hamilton
2013-04-23T16:14:35Z
2013-04-23T16:14:35Z
2013-04-02
Presentation
Greenfield, Jay, Danielle Carpenter. (2013). The Paradata Information Model. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11065
http://hdl.handle.net/1808/11065
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110482019-04-16T16:58:09Zcom_1808_11004com_1808_54col_1808_11005
Welcome to NADDI2013
Hoyle, Larry
NADDI
Welcome
DDI
Metadata
Data documentation
University of Kansas
IPSR
#NADDIconf
Introductory remarks at the North American Data Documentation Conference (NADDI) 2013
Welcoming remarks for NADDI 2013
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T16:26:24Z
2013-04-20T16:26:24Z
2013-04-20
Presentation
http://hdl.handle.net/1808/11048
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110492019-04-12T14:36:43Zcom_1808_11004com_1808_54col_1808_11005
DDI-Lifecycle and Colectica at the UCLA Social Science Data Archive
Iverson, Jeremy
Stephenson, Elizabeth
DDI
NADDI
Metadata
Data documentation
UCLA
Archive
Presentation at the North American Data Documentation Conference (NADDI) 2013
The UCLA Social Science Data Archive’s mission is to provide a foundation for social science research involving original data collection or the reuse of publicly available studies. Archive staff and researchers work as partners throughout all stages of the research process, beginning when a hypothesis or area of study is being developed, during grant and funding activities, while data collection and/or analysis is ongoing, and finally in long term preservation of research results. Three years ago SSDA began to search for a better repository solution to manage its data, make it more visible, and to support the organization’s disaster plan. SSDA wanted to make it easier for researchers to look for data, to document their data, and use data online. Since the goal is to document the entire lifecycle of a data product, the DDI-Lifecycle standard plays a key role in the solution. This paper explores how DDI-Lifecycle and Colectica can help a data archive with limited staff and resources deliver a rich data documentation system that integrates with other tools to allow researchers to discover and understand the data relevant to their work. The paper will discuss how SSDA and Colectica staff worked together to implement the solution.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T16:36:42Z
2013-04-20T16:36:42Z
2013-04-02
Presentation
Iverson, Jeremy, Elizabeth Stephenson. (2013). DDI-Lifecycle and Colectica at the UCLA Social Science Data Archive. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11049
http://hdl.handle.net/1808/11049
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110512019-04-12T14:13:26Zcom_1808_11004com_1808_54col_1808_11005
Panel - Generic Longitudinal Business Process Model
Barkow, Ingo
Block, William C.
Greenfield, Jay
Hebing, Marcel
Hoyle, Larry
Thomas, Wendy
DDI
NADDI
Metadata
Data documentation
GLBPM
GSBPM
Presentation at the North American Data Documentation Conference (NADDI) 2013
This presentation described a model for the processes involved in a longitudinal study. The model was developed at a symposium-style workshop held at Dagstuhl in September of 2011 (http://www.dagstuhl.de/11382). The Generic Longitudinal Business Process Model (GLBPM) emulates the Generic Statistical Business Process Model (GSBPM) (http://www1.unece.org/stat/platform/download/attachments/8683538/GSBPM+Final.pdf?version=1) which, in turn, was developed with DDI Lifecycle in mind. The GLBPM is intended as a generic model that can serve as the basis for informing discussions across organizations conducting longitudinal data collections, and other data collections repeated across time. The model is not intended to drive implementation directly, but may prove useful for those planning a study. An introductory presentation on the model will be followed by a panel discussion.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T18:41:29Z
2013-04-20T18:41:29Z
2013-04-03
Presentation
Barkow, Ingo, William Block, Jay Greenfield, Marcel Hebing, Larry Hoyle, Wendy Thomas. (2013). Panel - Generic Longitudinal Business Process Model. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 3, 2013. http://hdl.handle.net/1808/11051
http://hdl.handle.net/1808/11051
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110502019-04-12T14:12:54Zcom_1808_11004com_1808_54col_1808_11005
Collaborative Markup of Library and Research Data: Examples from OCUL
Leahey, Amber
DDI
NADDI
Metadata
Data documentation
OCUL
Presentation at the North American Data Documentation Conference (NADDI) 2013
This presentation will focus on collaborative efforts to capture, store, and disseminate social science survey data & researcher data across all of Ontario's University Libraries. Together through shared platforms and practices, collaborative markup of data using the Data Documentation Initiative (DDI) standard is possible in order to effectively deliver rich discovery services to users of library and researcher data. An overview of Scholars Portal's data services including the Ontario Data Documentation, Extraction Service and Infrastructure (ODESI), and Dataverse will highlight effective collaborative markup strategies for data.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T16:48:05Z
2013-04-20T16:48:05Z
2013-04-02
Presentation
Leahey, Amber. (2013). Collaborative Markup of Library and Research Data: Examples from OCUL. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 2, 2013. http://hdl.handle.net/1808/11050
http://hdl.handle.net/1808/11050
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110602019-04-12T14:39:04Zcom_1808_11004com_1808_54col_1808_11005
DDI: Metadata to support collection processes, discovery, and comparability
Thomas, Wendy
DDI
NADDI
Metadata
Data documentation
DDI-L, Lifecycle
Research
Discovery
Comparability
Workshop at the North American Data Documentation Conference (NADDI) 2013
DDI-Lifecycle (DDI-L) was designed to support processes and comparability all through the lifecycle of the data. The result is a standard based on planned reuse of metadata that describes the methodologies used, the processes of capturing, cleaning, and modifying data, and the various storage formats of the data itself. These structures enhance its value to the research process in terms of quality control and by supporting a "metadata driven research process". Discovery tools can leverage "reusable" metadata which supports comparability within and between data sets, capturing intended points of comparability within series and collections of data. This workshop will focus on the DDI content that support collection, discovery, and comparability: Questions, data collection instruments, variables, concepts, geography, grouping and comparison.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T20:38:22Z
2013-04-20T20:38:22Z
2013-04-04
Learning Object
Presentation
Thomas, Wendy. (2013). DDI: Metadata to support collection processes, discovery, and comparability. Workshop delivered at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 4, 2013. http://hdl.handle.net/1808/11060
http://hdl.handle.net/1808/11060
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf
oai:kuscholarworks.ku.edu:1808/110572019-04-12T14:37:50Zcom_1808_11004com_1808_54col_1808_11005
Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination
Vardigan, Mary
Presentation at the North American Data Documentation Conference (NADDI) 2013
The Inter-university Consortium for Political and Social Research (ICPSR), NORC at the University of Chicago, and the American National Election Studies program in the Center for Political Studies at the University of Michigan’s Institute for Social Research are currently engaged in a new collaborative effort to create a common metadata portal for two of the most important data collections in the U.S. – the American National Election Studies (ANES) and the General Social Survey (GSS). Technical support is provided by Metadata Technology and Integrated Data Management Services. This pilot project, funded by the National Science Foundation, will produce a combined library of machine-actionable DDI metadata for these collections, and demonstrate DDI-based tools for advanced searching, dynamic metadata presentation, and other functions intended to facilitate discovery and analysis of these data. The project will also lay a foundation for developing new metadata-driven workflows for both ANES and GSS. This presentation describes the major phases and deliverables of the project and presents a plan of action, with an emphasis on how the project will benefit the wider community.
Institute for Policy & Social Research, University of Kansas; University of Kansas Libraries; Alfred P. Sloan Foundation; Data Documentation Initiative Alliance
2013-04-20T20:13:24Z
2013-04-20T20:13:24Z
2013-04-03
Presentation
Vardigan, Mary. (2013). Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination. Paper presented at the North American Data Documentation Initiative Conference (NADDI 2013), University of Kansas, Lawrence, Kansas, April 3, 2013. http://hdl.handle.net/1808/11057
http://hdl.handle.net/1808/11057
en_US
openAccess
application/vnd.ms-powerpoint
application/pdf