Differences

This shows you the differences between two versions of the page.

--- emis_user_manual [2023/02/28 04:45] – [Test Analysis] ghachey
+++ emis_user_manual [2024/12/19 07:25] (current) – [School Accreditation Loaded Data] ghachey
@@ Line 270: / Line 270: @@
   * Total Expenditure: $400,000
   * Current Expenditure: $0
+==== Dashboard Analysis ====
+Under ''Budget -> Dashboard'' a number of built-in budget analysis components are included. They are discussed briefly in following sub-sections.
+=== GNI (aka. GNP) and Government Spending ===
+This will provide some high level budget expenditure including the
+  * GNI (aka. GNP)
+  * Total education expenditure (Ed Expenditure)
+  * Total government expenditure (Govt Expenditure)
+  * Public Expenditure on Education as % of Total Government Expenditure (Ed/Govt %)
+  * Public Expenditure on Education as % of GNI (Ed/GNI %)
+{{ :user-manual:budget-dashboard-1.png?nolink |}}
+=== Spending By Sector (table format) ===
+This one breaks down the total expenditure (Actual vs Budgeted) by education sectors (which translates to education levels).
+{{ :user-manual:budget-dashboard-2.png?nolink |}}
+=== Spending By Sector (chart format) ===
+This chart also breaks down the total expenditure (Actual vs Budgeted) by education sectors (which translates to education levels).
+{{ :user-manual:budget-dashboard-3.png?nolink |}}
+However, with this chart you can interactively change the content to display other figures such as the per-pupil education expenditure as shown below.
+{{ :user-manual:budget-dashboard-4.png?nolink |}}
+{{ :user-manual:budget-dashboard-5.png?nolink |}}
+=== Spending By District ===
+Finally, the education expenditure can be display by districts. District could be will be a localized terms such as State, Province, Atolls, etc.
+{{ :user-manual:budget-dashboard-6.png?nolink |}}
 ===== Exams =====
@@ Line 774: / Line 816: @@
 {{ :user-manual:school-accreditation-loading-10.png |}}
+==== School Accreditation Approval Auditing ====
+The School Accreditation module includes auditing support. When you open an official school accreditation record, navigate to the Summary tab to view key details. This section displays all critical dates, from the creation of the survey on a tablet to its final approval, highlighted in red. While there are some edge cases where the End Date does not appear (the cause is unclear), the most important dates are consistently displayed.
+{{ :user-manual:fedemis-school-accreditation-approval.jpg?nolink |}}
+Schools should be trained to log in to their own school profiles, where they can access their yearly submitted data, exam performance, and school accreditation records in real time once the data is uploaded and approved. For example, schools can view their historical accreditation records, including a summary of final results. For more detailed information, they can click on the ID number to view the complete accreditation details, such as approval dates, photos, and more.
+{{ :user-manual:fedemis-school-accreditation.jpg?nolink |}}
 ==== School Accreditation Dashboard ====
-This is where you can get some live data analytics just like every other module in the EMIS. You access just like other dashboard, Click on ''School Accreditation -> Dashboard''
+This is where you can get some live data analytics just like every other module in the EMIS. You access just like other dashboard, Click on ''School Accreditation -> Dashboard''.
+<note important>In order for the dashboard to contain data from the most recently approved and uploaded cloudfiles, the EMIS warehouse has to be regenerated.</note>
 {{ :user-manual:school-accreditation-dashboard-1.png |}}
@@ Line 1181: / Line 1237: @@
 ===== Data Operations =====
-==== Upload Workbook ====
+==== Annual Census Data Transfer ====
+The Pacific EMIS supports a number of ways to transfer data from schools to a centralized database. They have varying degrees of maturity and complexity of user adoption. They are summarized in the below table.
+^ Method      ^ Description       ^ Maturity          ^ User Adoption Complexity ^
+| PDF Survey    | A comprehensive survey of data with the majority of it in aggregate format containing enough for the main key performance indicators     | Very mature       | Easy       |
+| Excel Workbook    | A comprehensive survey of data with support for individual rosters and richer data containing enough for the main key performance indicators and more. Built on widely used spreadsheet (Excel)     | Very mature       | Moderate       |
+| Student Information System (SIS)    | The highest form of data management within the schools then pushed to the centralized system. An online web-based student information system meant for daily use by schools.     | On-going development       | Difficult       |
+==== Upload PDF Survey ====
+<note important>This documentation below is strictly how to load an Annual School Census PDF Survey into the EMIS. Information on how to use the PDF Survey itself is documented in [[annual_school_census_pdf_survey_user_manual|Annual School Census PDF Survey User Manual]]</note>
+<note important>Not every country uses the PDF Survey. Some use the full roster workbook. This section is only relevant if you use the PDF Survey, typically containing yearly aggregate data as oppose to full student/staff rosters.</note>
+Your Annual School Census PDF Survey must be completed first. Then if you have appropriate permissions you simply go to ''Data Operation -> Upload PDF Survey'' sub-menu item. Simply drag the PDF Survey as shown below.
+<note important>Occasionally The PDF Survey upload would result in an error "Empty Name Token" which would prevent the survey from loading. This came from the open-source dependency called PdfFileAnalyzer used to extract the data from the PDF file. A custom branch of this open-source dependency PdfFileAnalyzer  was developed to eliminate that error, so more surveys will now load without problem.</note>
+<note tip>To speed up the uploading of the file, you can now zip the survey and upload that. You can do this with the default zipping tool on your operating system. We recommend installing [[https://www.7-zip.org/|7-zip]] a free open source tool that can easily zip files also. Compressing the file (i.e. zipping) can speed up to 3-4 times faster the uploading.</note>
+{{ :user-manual:pdf-survey-upload.png?nolink |}}
+==== Upload Excel Workbook ====
 <note important>This documentation below is strictly how to load a Annual School Census Workbook into the EMIS. Information on how to use the workbook itself is documented in [[annual_school_census_workbook_user_manual|Annual School Census Workbook User Manual]]</note>
-Your Annual School Census Workbook must be completed first. Then if you have appropriate permissions then you you simply go to ''Data Operation -> Upload Workbook'' sub-menu item. Simply drag the workbook as shown below.
+Your Annual School Census Workbook must be completed first. Then if you have appropriate permissions you simply go to ''Data Operation -> Upload Workbook'' sub-menu item. Simply drag the workbook as shown below.
 {{ :user-manual:workbook-upload-1.png |}}
@@ Line 1223: / Line 1304: @@
 ==== Rollover Workbook ====
-<note important>Currently there is no link in the menu to access the rollover workbook feature. It canonly be accessed through the browser by entering the URL by hand. So when logged in visit the link [[https://youremis.domain.name/#!/censusworkbook/create|https://youremis.domain.name/#!/censusworkbook/create]]</note>
+=== Initialize the new survey year ===
-<note important>Currently a new survey year needs to be produced manually before doing the rollover. This can be done by executing the stored procedure
+A new survey year needs to be produced manually before doing the rollover. There is no menu items at the moment but you can easily access the page directly from the browser as shown below and saving the new survey year. Usually it pre-populates the new census year data automatically.
-<code sql>
-exec pSurveyWriteX.CreateSurveyYear 2023, '2022-12-31','2022-11-30',6, 'your-user@email.com'
+{{ :user-manual:emis-user-guide-census-init-1.png?nolink |}}
-</code>
-</note>
+After the new census year has been initialized you can do the rollover page as shown below.
+{{ :user-manual:emis-user-guide-census-rollover-1.png?nolink |}}
 The workbook census rollover can work for all schools at the national level, at the district (e.g state, province, etc.) level or individual schools. It is the recommended way to get started on a new school year data as it contains cleaned up data and reduces chances of introducing duplicates or other messy data.
@@ Line 1240: / Line 1323: @@
   * Final verification that all the teacher/students for each schools are all as expected
   * Final verification of School and WASH data
-{{ :user-manual:workbook-rollover.png?nolink |}}
 ==== Upload Exams ====
@@ Line 1392: / Line 1473: @@
 ==== Rebuild Warehouse ====
-===== Professional Data Publications =====
+===== Professional Data Analysis, Reports and Publications =====
-We have a combination of tools (e.g. [[data_publishers_toolkit|Data Publishing Toolkit]], [[multi-part_word_documents|Multi-part Word Document]]) and practices for publishing data into Excel tables and pivot tables. This forms the basis for the construction of documents such as Annual Statistics Digest, etc. These connection are direct connections to SQL Server using Excel’s OLEDB capacity. It is possible to establish SQL connections across the WAN, but this entails some careful security setup to allows users through a firewall to reach the SQL Server. In particular, a "read only" user. In order to support users who do not have access to SQL (i.e. either across their LAN, or across the WAN) to access data in Excel we are building support for new options. This would allow more options for remote hosting, and also for a broader set of users to have access to Excel.
+The Pacific EMIS offers a variety of means for data analysis, reports and publications. They range from very simple to use to highly advanced requiring advanced data analysis skills. The methods are summarized below.
-The three available planned options are available in various levels of maturity
+^ Type 	^ Easy of Use 	^ Flexibility 	^
+|Pre-built Reports 	| Easy 	| More rigid. Users use reports as they are provided directly in the Pacific EMIS web UI. JasperReport and Microsoft SQL Reporting Services are supported with mostly JasperReports provided and tested. |
+|Pre-built Dashboards 	| Easy 	| More rigid. Users make use of the data analysis dashboards as they are provided directly in the Pacific EMIS web UI. |
+|Custom Reports 	| Moderate 	| More flexible. User with SQL and JasperReports (or MS SQL Reporting Services) skills can build new or modify existing reports with possibility to access them either from the JasperReports Server or integrate them directly in the Pacific EMIS Web UI following some simple convention. |
+|Flexible Excel/Word Reports 	| Moderate 	| More flexible, user with data analysis, excel and a bit of SQL skills can build any types of report or presentation imaginable. Pull data in excel and link it to MS Word or Power Point presentation. |
+|Custom Dashboards 	| Advanced 	| Users with advanced SQL, C#, TypeScript, Angular and Data Analysis skills could expand on the existing dashboards provided in the Pacific EMIS out-of-the-box. Since this project is open source the custom dashboartds are required to be released as open source.|
+|External Tools 	| Advanced 	| Users with advanced SQL and/or data analysis skills could connect to the RESTful API or use excel data exports to use with their favourite tools (e.g. Python/Pandas/Dash, R, Tableau, Power BI, SPSS, SAS) |
+Further notes on the Flexible Excel/Word Reports type of reporting. We have a combination of tools (e.g. [[data_publishers_toolkit|Data Publishing Toolkit]], [[multi-part_word_documents|Multi-part Word Document]]) and practices for publishing data into Excel tables and pivot tables. This forms the basis for the construction of documents such as Annual Statistics Digest, etc. These connection are direct connections to SQL Server using Excel’s OLEDB capacity. It is possible to establish SQL connections across the WAN, but this entails some careful security setup to allows users through a firewall to reach the SQL Server. In particular, a "read only" user. In order to support users who do not have access to SQL (i.e. either across their LAN, or across the WAN) to access data in Excel we are building support for new options. This would allow more options for remote hosting, and also for a broader set of users to have access to Excel.
+The three planned options are available in various levels of maturity and the table below shows the comparative strength and weaknesses of the 3 approaches:
 ^ Mode 	^ Connection 	^ Refreshable? 	^ Flexibility 	^ Distribution ^ Maturity ^
@@ Line 1404: / Line 1495: @@
 All three options will be documented in the following sections.
-‌
 ==== Direct SQL / DPT ====
@@ Line 1417: / Line 1508: @@
 Power query extends Excel’s ability to access data from relational sources with the ability to extract, transform and load data from a wide variety of sources including http rest end points.
 ‌
-=== Dynamic Workbooks ===
+==== Dynamic Workbooks ====
 Currently this design is prototyped:
@@ Line 1443: / Line 1534: @@
 </code>‌
-This table shows the comparative strength and weaknesses of the 3 approaches:
+====== Public Data Dissemination ======
+Aside from data about individuals, just about all other data benefits from being public for a number of reasons:
+  * **Transparency and Accountability**: Open data fosters transparency, holding organizations and governments accountable.
+  * **Innovation and Collaboration**: Public data fuels innovation, enabling collaboration among researchers, entrepreneurs, and developers.
+  * **Informed Decision-Making**: Accessible data empowers individuals and organizations for better decision-making.
+  * **Citizen Engagement**: Open data encourages citizen participation and engagement in public affairs.
+  * **Economic Growth**: Data availability stimulates economic growth, fostering entrepreneurship and creating jobs.
+  * **Research Advancement**: Open data accelerates research and scientific discoveries across various fields.
+  * **Public Services Improvement**: Governments utilize open data to enhance public services and address societal challenges.
+  * **Cross-Sector Collaboration**: Open data facilitates collaboration between sectors to address complex issues.
+  * **Community Empowerment**: Open data enables communities to address local challenges and actively participate in development.
+  * **Accountable Governance**: Open data supports accountable governance, allowing citizens to monitor government activities and foster trust.
+The Pacific EMIS supports a number of ways to disseminate data in a timely manner that KEMIS does not yet fully adopt. They are summarized in the table below:
+^ Method ^ Description ^ Time to Access ^ Access Difficulty ^
+| Publications | Often the most official and slowly curated sources of data. | Longest time. Requires more efforts in collecting, validating, preparing and publishing and can come sometime years after. | Easy. Typically through downloadable PDF documents. |
+| Mobile App | Download all data and view analysis on your phone. | Fast. New data immediately available. | Easy. Download the Pacific Open Education Data app on your Android or iPhone |
+| Public Login | The web application supports a public login to view all dashboards and download excel data exports. | Fast. New data immediately available. | Easy. Login the country EMIS public profile from login page. |
+| REST API | Access the raw data through special web requests in formats such as JSON and XML. | Fast. New data immediately available. | Difficult. Typically used by developers or researching with programming skills |
+A word of caution. The pacific island countries faces unique challenges making it hard to continuously improve the quality of data. Accessing the data any of the fast methods has the caveat that it has had less time for scrutiny and possible remediation. So it should always be used with care and we always appreciate any apparent issue brought to our attention so we can work to fix them.
+Each of these methods will have a sub-sections here with additional documentation.
-==== References ====
+===== References =====
 [BhandariStd2023] Bhandari, P. (2023, January 20). How to Calculate Standard Deviation (Guide) | Calculator & Examples. Scribbr. Retrieved February 27, 2023, from https://www.scribbr.com/statistics/standard-deviation/