making sense of data - iia fiji · • report informed decisions traditional risk based analytics....

39
Shagen Ganason, CIA CAE, Te Puni Kōkiri (Ministry for Māori Development) MAKING SENSE OF DATA Analytics in Action

Upload: others

Post on 26-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Shagen Ganason, CIACAE, Te Puni Kōkiri (Ministry for Māori Development)

MAKING SENSE OF DATAAnalytics in Action

Page 2: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Agenda

• Context

• Analytics

• Case Study 1

• Case Study 2

• Internal Controls

• Tools and Resources

• Summary

Page 3: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Context

Page 4: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Department of Conservation

11 Conservancies44 Area Offices1800 – 3200 StaffBudget NZ$390mAssets NZ$5.4b3 Auditors

Page 5: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

What business are they in?

Page 6: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

What business are they in?

Page 7: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

What business are you in?

Page 8: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Analytics

Page 9: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Quick Poll

Does your organisation use data analytics in fraud prevention and/or detection?

Yes

No

Page 10: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Data vs. Information

Page 11: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Data Analytics

• Collect• Transform• Analyse• Mine• Report

InformedDecisions

Traditional risk based analytics

Page 12: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Text Analytics

• Pattern• Frequency• Concept• Linkages• Key word

association

Based on what you already know

Non-traditional analytics

Page 13: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Visual Analytics

• Coordinate mapping

• Relationship• Linkages• Pattern• Proximity

analysis

Non-traditional analytics

Based on what you already know

Page 14: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Visual Analytics

Non-traditional analytics

https://maps.google.com.fj/locationhistory

Page 15: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Visual Analytics

Non-traditional analytics

https://maps.google.com.fj/locationhistory

Page 16: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1

Page 17: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1

• Excessive fuel usage noted

• Matched to fuel consumption

• Invoice documentation & approval

• Email connections and correlations

• PCard - purchase expensive & attractive items

• Public auction site link identified

• Handed over to Police

Page 18: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Loc 1 Loc 2 Loc 3 Loc 4 Loc 5 Loc 6 Loc 7 Loc 8 Loc 9 Loc 10 Loc 11 Loc 12 Loc 13

Avg Mthly Fuel Consumption

Avg Mthly Fuel Purchase

Fuel Usage

Page 19: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1Invoices

Invoice documentation• Evidence of delivery• No usage data provided

Invoice approval• User logged as the manager• Approved by site accountant• Circumvented approval limits

Page 20: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1Email

Text Analytics of emails from these individuals identified two strong correlation and several weak

Page 21: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1Email

Motivation Meet budget, favour, problem, committing, creative, concern, not sure, spread, revise, release,

Opportunity Override, write-off, capture cost,correct, appropriate, reserve, misconduct, departing, discount, difficult, fail, critical.

RationalisationIt’s OK, sounds reasonable, I deserve, therefore, find out, get back, find it, figure out, catch, doesn’t make sense.

Keyword

Page 22: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 1PCard

PCard• Over 3 yr period – excessive attractive assets• Purchase and sales of vehicles

Auction sites • On sold public assets

Page 23: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Discussion

Based on the analytics we discussed, what could the auditor have done to enhance/strengthen the internal controls using analytics?

What triggers could have been useful to detect this before it happened?

Page 24: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

• Exceptionally high use of helicopters

• Circumvent delegated authority

• Matched flight plans against Google Earth

• Email pattern and connections

• Fictitious invoices created

• Fictitious vendor set up

• Handed over to Police

Case Study 2

Page 25: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 2

Total Heli Use 2012/13

Selected an office where value of flights could not be justified against amount of areal work required

Page 26: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 2

Office Loc 1

Within the selected location, one supplier had more business than any other supplier

Page 27: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 2

Isolated one individual who procured more helicopter use at this location than anyone else

Circumvented approvals limits

Page 28: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 2

Obtained flight log from supplier and plotted route on Google Map

Locations flown had no assets

Asset Location

Page 29: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 2

Text analytics of email trails identified two with the highest email traffic and one with suspect name

Page 30: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Case Study 2

Suspect name turns out to be a fictitious vendorSet up approved by manager

Page 31: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Discussion

Based on the analytics we discussed, what could the auditor have done to enhance/strengthen the internal controls using analytics?

What triggers could have been useful to detect this before it happened?

Page 32: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Internal Controls

• Internal controls are only as good as the people who administer them. Many organisations claim to have sound control frameworks but in reality very few do.

• Proactive framework requires proactive people; and lots of thinking to identify “what could” and not “what is”.

• Most people are reactive (human nature). To many organisations, to identify “what could” is seen as a waste of resource (time and money).

• End result – reliance is placed on trust, hope, culture and people.

Page 33: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Tools and Resources

• Search engines• Public records for addresses and phone

numbers• Digital footprint• Birth, death and marriage registrar• Reverse look ups (phone & addresses)• PPSR (personal property security registrar)

Page 34: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Tools and Resources

• Google Earth (2D, 3D, Street View and Areal)• Physical address

Page 35: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Tools and Resources

• Social media (LinkedIn, Facebook, Twitter, etc.)• Online news sites

Page 36: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Tools and Resources

What do you search for?• Topical searches• Boolean logic• Refine and narrow searches• Acronyms, aliases and AKA’s• Try common misspellings• 5 wives and a husband (5W1H)

Page 37: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Tools and Resources

How do you search• Known particulars• Known events• Use “AND”, “OR” and “NOT”• Quotation marks• Character strings

Page 38: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email

Summary

• Understand your business

• Difference between data and information

• Different types of analytics

• What you can do with data

• Case studies

• Limitations of internal control

• Tools at your disposal to mine data for information

Page 39: MAKING SENSE OF DATA - IIA FIJI · • Report Informed Decisions Traditional risk based analytics. Text Analytics • Pattern • Frequency • Concept ... Text analytics of email