Data Management
- Table of contents
AMHOCN Database
A database capable of accurately, robustly and securely storing specified AMHOCN Data in a manner that facilitates the flexible querying and extraction of that data for subsequent analysis.
It is important to note that Logicly has undertaken that these processes:
-
Be open to ongoing development.
-
Include a sign off process for the data to be submitted by each state - but not assume that the sign off on submission was the end of the data checking process.
-
Provide useful and meaningful reporting back to each constituency on the quality of their data and pointers / advice for correction of problems.
-
Include a final sign off process by each constituency that was supported by meaningful reports to assist them in understanding of the data being signed off.
Data Management
Logicly receives data files from the States and Territories, this data then will be made available to the Commonwealth. Any entity outside of the AMHOCN project requiring access will need to request permission which is granted only by the Commonwealth. The Analysis and Reporting component of the consortium will from time to time request extractions of the data in order to run statistical comparisons and make recommendations based on the findings.
Data Transfer
Logicly will only transmit data to entities that have been identified as authorised to receive data within the scope of the AMHOCN project.
To Logicly from States and Territories
Data files from the States and Territories are transferred to Logicly through the online Validator, which validates the data files according to the rules prescribed by the AMHOCN consortium. The data should be consistently de-identified prior to transmission. Logicly no longer handles physical media containing data.
To Queensland University from Logicly
Logicly will supply an encrypted extraction of the data, in electronic form, to the Queensland University team responsible for Parts 2 and 3 of the AMHOCN project. Logicly will then separately send the decryption key to the Queensland University team via SMS allowing access. The request for this extraction will be via the Logicly Request Tracker. The Commonwealth Department of Health are carbon copied on the requests and subsequent reply advising receipt.
To Other Entities
Logicly will make de-identified data available to other entities authorised by the Commonwealth only after the AMHOCN Network agrees that the data is sufficiently reliable for this purpose.
Technical Issues
Effective Utilisation of Skills
The skills involved in effectively and efficiently providing data management services to research and analysis professionals are highly specialised. There is a requirement that the personnel involved are highly competent with the technical requirements demanded by the storage and management of a complex database while also having a high level of understanding of the research and analysis goals of the analysis team.
There are significant differences between this process and the traditional “application development” model because it is often necessary to respond quickly to the changing requirements of the analysis process as various analytical techniques are applied. While it is possible to provide a fixed data set to the analysis team and allow them to manipulate it into the appropriate format, this is usually neither efficient or an appropriate use of each teams respective skills.
For this process to work most effectively, regular communication between the data management and analysis personnel is required. It is often the case that the data management team provides impromptu support and training to the analysis team as the capacity of their familiar tools (Excel, Access, SPSS etc) is exceeded. This is particularly for the AMHOCN project as it involves large data sets and the common tools and techniques used by researchers do not always scale well.