how big data drive greater msbr · 2018. 3. 15. · msbr 1 2 3 the function of msbr is further...
TRANSCRIPT
-
HOW BIG DATA DRIVE GREATER MSBR
SITI HASLINDA MOHD DIN, NUR AZIHA MANSOR
2016 WIESBADEN GROUP MEETING IN TOKYO: SESSION 2
DEPARTMENT OF STATISTICS MALAYSIA
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
OUTLINES
INTRODUCTION 1
2
4
5
MODENIZE MSBR IN BIG DATA PLATFORM OUTCOME:
BUSINESS INTELLIGENCE & ANALYTICS
CONCLUSION
MSBR QUALITY IMPROVEMENT WITH BIG DATA
3
https://slidemodel.com/http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
INTRODUCTION
SBR provides a comprehensive businesses’ and companies’ frame with a set of stratification variables
MSBR is an important DOSM's asset, thus the data quality is a highly significant consideration
With emerging trends of big data, data quality
management offered by big data helps DOSM to
enhance the quality of MSBR
1
2
3
The function of MSBR is further expanded by
integrating it with trade database by using big
data platform.
4
The paper is to highlight how big data drives greater MSBR in the
production of Trade by Enterprise Characteristics
(TEC) statistics.
4
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
GREATER MSBR IN BIG DATA PLATFORM
StatsBDA Proposed Architecture
TEC project has become one of the DOSM Big Data Analytics (StatsBDA) initiatives.
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
MSBR TRADE DATABASE
Business Registration
Number
Conventional Approach
MODERNIZE MSBR IN BIG DATA PLATFORM
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005https://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwiv4frYq9TPAhWKKo8KHRVKD1sQjRwIBw&url=https%3A%2F%2Fwww.edq.com%2F&psig=AFQjCNGMTKLNr0fP3ZoZw-pEk20cbdtBZw&ust=1476329903923498
-
1
2 3 4 5
6
String Matching Algorithm Approach
Data Profiling
Data Standardization
Data Clustering
Data Cleansing
Text Matching
Data Integration
MODERNIZE MSBR IN BIG DATA PLATFORM
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwi3042Ij9TPAhWMsI8KHY9CCqEQjRwIBw&url=http%3A%2F%2Fprezibase.com%2Fshop%2Finfographic-3d-frames-prezi-template%2F&psig=AFQjCNEPJYAzYAahbZR0AriBK3tv_h7ssQ&ust=1476319440219487
-
MODERNIZE MSBR IN BIG DATA PLATFORM
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
Proposed TEC Architecture
TEC project with big data solution has provided an opportunity to improve
the MSBR quality
MSBR QUALITY IMPROVEMENT WITH BIG DATA
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
OUTCOME: BUSINESS INTELLIGENCE & ANALYTICS
Transforms MSBR and trade data into more
meaningful and useful
information for analysis
purposes
Business Intelligence Business Analytics
Determine the
patterns and predict
future trade
outcomes and trends
Discover industries that will emerge,
evolve or disappear
in internatio-nal market
Manipulate complex pools of data to visually
display the data's
patterns, trends, and correlations
Visualisation
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
CONCLUSION
MSBR Rich with businesses information & become richer
when it is combined with other databases
MSBR + Trade Database
The effort is less efficient with existing business
solutions
Big Data Revolution Big Data platform is
used to process the data within a stipulated time
Data Management
Quick data quality checks and analysis
TEC Statistics
New information that is not exist in stand-alone
statistical domains
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjwyO-8itTPAhWHvo8KHQ3sAa8QjRwIBw&url=http%3A%2F%2Fvectorise.net%2Flogo%2F2010%2F04%2F28%2Fjabatan-perangkaan-malaysia-new-logo%2F&psig=AFQjCNFYE8lutnu-weX7p9F2FWibn1imAQ&ust=1476321008677005
-
Nur Aziha Mansor
Methodology & Research Division
Department of Statistics Malaysia
http://www.google.com.my/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=&url=http://traveloutsav.com/malaysia.html&bvm=bv.119408272,d.c2E&psig=AFQjCNFjLEVEwa42kbmusyh_Oc6XypDRpw&ust=1460599290986323mailto:[email protected]