investigative review 2015-0006 palm tran connection
TRANSCRIPT
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
1/103
John A. CareyInspector General
OFFICE OF INSPECTOR GENERAL PALM BEACH COUNTY
Inspector General Accredited
“Enhancing Public Trust in Government”
Investigative Review
2015-0006
Palm Tran Connection
March 31, 2016
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
2/103
John A. CareyInspector General
OFFICE OF INSPECTOR GENERAL PALM BEACH COUNTY
INVESTIGATIVE REVIEW
CASE NUMBER: 2015-0006
DATE ISSUED: MARCH 31, 2016 Inspector General
Accredited
“Enhancing Public Trust in Government”
PALM TRAN CONNECTIONEXECUTIVE SUMMARY
WHAT WE DID
On May 13, 2015, the Office of InspectorGeneral (OIG) Investigations Divisionreceived a complaint containingallegations of misconduct by employeesof Palm Tran Connection (PTC).
The complainant alleged that PTCsupervisors were altering times and/ordirecting dispatchers to alter times in theircomputerized reservations and monitoringsystem, Trapeze System, to meet themonthly On-Time Performance Rate
(OTPR) goal of 95%
1
.
Based on the allegations, the OIGinitiated an Investigative Review.
WHAT WE FOUND
PTC supervisors were altering times
and/or directing dispatchers to alter timesin the Trapeze System that resulted ininaccurate and inflated OTPR. Reportsproduced by PTC on the OTPR were, forthe period of February 1, 2015, to thepresent, inaccurate and inflated.
The OTPR is not only used internally bystaff and the transportation providers togauge performance, it is used by PalmTran executives when making monthlypresentations to stakeholders, includingthe Palm Beach County Board of CountyCommissioners. Establishing a 95%OTPR was a priority as evidenced by thefact that untimeliness could result in theassessment of liquidated contractdamages against the transportationproviders. Additionally, the formerExecutive Director was demoted, partiallyas a result of poor OTPR.
Through his own admission, PTC DirectorRon Jones, stated that the OTPR hadbeen skewed, since March 9, 2015,based on the deactivation of Tracker
Action Settings (settings) in the TrapezeSystem which was ordered by him. Wefound that there was pressure exerted on
PTC employees and Mr. Jones to get theOTPR to at least 95%. However, we didnot find that Mr. Jones was improperlycoerced or instructed to alter records ormisrepresent the OTPR. Mr. Jonesadmitted that he was solely responsiblef ff
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
3/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
would come in every day and use a reportthat was prepared for her by Mr. Jones to
affect these changes. The report wouldlist bus trips from the previous day wherethe riders were picked up late. Thedispatcher, or in some cases hersupervisor, would change the rider pick-up window2 so that the actual pick-upwould fall within the newly adjustedwindow. These changes resulted in 1)
trips which should have been consideredlate, appear to be on time; 2) the now ontime trips had a positive effect on PTC’sOTPR; and 3) the TransportationProvider, who may have been assessedliquidated damages for the late pick-ups,were not being assessed.
We also found systemic weaknesses incontrol issues wherein complaints enteredinto the Trapeze System were allowed tobe deleted; all PTC employees,regardless of job requirement or need, aswell as, designated employees for thethree Transportation Providers, had
access to the Trapeze System, with rightsto make changes to rider route times;and, there were no monitoring/reviewprocedures in place to determine ifchanges made in the Trapeze Systemwere made for a valid purpose.
Additionally, several employees were
evasive or omitted their involvement inthe aforementioned activity. Someemployees were interviewed numeroustimes, under oath, and failed to discloseinformation or omitted their involvementuntil such time when we confronted them
Lastly, Mr. Jones stated that as ofSeptember 22, 2015, PTC was no longer
changing rider pick-up times and theywere calculating the OTPR based on theoriginally entered scheduled times.However, on February 18, 2016, as wewere in the process of writing this report aPTC Reservationist came forward andprovided documentation that changeswere still being made in the Trapeze
System resulting in an increase to theOTPR. A PTC Dispatcher was cancellingscheduled trips and creating new tripswith rider pick-up windows that wouldmake the actual rider pick-up appear tobe unchanged and on time.
We estimate that from the inception of thenew Transportation Provider contracts,February 1, 2015, through the writing ofthis report somewhere between 21,000 and 46,000 time changes were madethereby inaccurately increasing theOTPR.
WHAT WE RECOMMEND
We made a total of nine policy and controlrecommendations, some of which havealready been implemented.
Management disagreed with our finding;however, Management did concur with
our recommendations. OIG comments toManagement’s response begin on page15 of this report.
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
4/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
BACKGROUND
Palm Tran, Inc. (Palm Tran) was incorporated by the Palm Beach County (County)Board of County Commissioners (BOCC) in 1995 to provide public transportation for thecitizens of the County. Palm Tran has two departments, Palm Tran Fixed Route andPalm Tran Connection (PTC).
PTC is a shared ride, door to door paratransitservice that provides transportation for residentswith disabilities and visitors in Palm Beach Countyunder the following programs: Americans withDisabilities Act; Division of Senior Services; and,Transportation Disadvantaged.
In January 2014, County Administrator Robert Weisman assigned Assistant County Administrator Shannon LaRocque to address the problems PTC was having with theirTransportation Provider, Metro Mobility. There were many complaints from citizens
which were the result of poor performance issues by Metro Mobility and PTC staff. Approximately six months into her assignment, Ms. LaRocque recommended to theCounty Administrator that the Executive Director of Palm Tran, Chuck Cohen, bedemoted and that the County replace Metro Mobility with three new TransportationProviders. Ms. LaRocque became the Interim Executive Director of Palm Tran.
On September 9, 2014, the BOCC approvedseven year contracts with three new
Transportation Providers: MV Transportation Inc.,$72,670,431, First Transit Inc, $76,201,015, andMaruti Fleet & Management LLC $35,017,147.These three companies provide drivers to PTCand these drivers are also responsible forcleaning the vehicles they drive for PTC.
Ms. LaRocque had approximately four months (October 2014 – January 2015) to
implement the new PTC operations with the three new Transportation Providers. Underthe new contracts, PTC would handle dispatching, which was previously handled byMetro Mobility. An outside firm, Nelson Nygaard Consulting Associates, was hired toassist PTC in planning and implementing their operational programs. During the threemonths of planning the new PTC operations, several goals were developed, one ofwhich was a goal of having a 95% On Time Performance Rate (OTPR) Ms
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
5/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
The Trapeze Group (Trapeze Group) is the computer software vendor PTC contractedwith to assist in running their transportation operations. The Trapeze Group, through its
subsidiary Trapeze Software, Inc., provides transportation software solutions throughtheir Trapeze Software System (Trapeze System), for transit agencies providing fixedroute, rail, paratransit, or school transportation. Trapeze Group creates, delivers, andsupports software solutions and services that make it easier for transportation agenciesto manage their complex, day-to-day business operations. The Trapeze System isdesigned and developed to assist industry vendors, such as PTC, to managescheduling and dispatching, customer bookings, complaints, and reporting tostakeholders. PTC has been using the Trapeze System since 2003.
PTC schedules all trips, prepares vehicle manifests, handles customer concerns andcommendations, determines eligibility, and monitors the performance of theTransportation Providers through the use of the Trapeze System. PTC staff wasfamiliar with the Trapeze System as they used it during the contract with Metro Mobility.
As previously mentioned, the only new function PTC took over was dispatching.
On May 13, 2015, the Office of Inspector General (OIG) Investigations Division received
a complaint alleging that PTC supervisors were altering times and/or directingdispatchers to alter times in the Trapeze System in order to meet their OTPR goal.
The complaint to the OIG referenced a PTC complaint (#106594) filed by rider #115150on April 10, 2015. The rider was on the bus for approximately two hours and twentynine minutes (2hrs 29min) on April 10, 2015, for a trip that should have takenapproximately one hour. On Monday, April 13, 2015, PTC Customer ServiceRepresentative, Nadia Charles researched the rider’s trip in the Trapeze System andvalidated3 the complainant’s trip times. Ms. Charles noticed the drop-off time had beenchanged in the Trapeze System by 89 minutes making it appear the rider was droppedoff on time. Based on this information, the OIG initiated an Investigative Review.
ISSUE REVIEWED AND FINDING
As a result of our investigation, we concluded that reports produced by PTC on the
OTPR were, for the period of February 1, 2015 to the present, inaccurate and inflated.
Two issues made this Investigative Review difficult. First, the intentional deactivation ofthe Trapeze System Tracker Action Settings (settings), which turned off the TrapezeSystem’s internal audit function, eliminated our ability (or anyone else’s) to obtaindocumentary evidence of who actually made changes in the Trapeze System. Second,
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
6/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
Issue:
Did PTC supervisors al ter t imes and/or direct disp atchers to al ter t imes in th e
Trapeze System in ord er to meet their OTPR goal?
Finding:
PTC supervisors were altering times and/or directing dispatchers to alter times inthe Trapeze System that resulted in inaccurate and inflated OTPR.
Deactivation of the Tracker Action Settings
PTC Director Ron Jones was knowledgeable with the Trapeze System and designedthe program to extract specific information4 from the Trapeze System, to calculateOTPR. February 2015 was the first time the OTPR was calculated with the three newTransportation Providers, resulting in an 84% OTPR which was below the 95% goal.
On March 9, 2015, Mr. Jones instructed IT Systems Administrator II Dan Pace via emailto deactivate 22 (selected by Mr. Jones) of the 67 settings. The deactivation of thesesettings eliminated the ability of the Trapeze System to track the individual who madechanges to any of the data fields associated with these settings, which included theability to track changes affecting the OTPR. Mr. Jones stated the purpose for thedeactivation of the settings was to increase the speed of the computer server. Mr.Jones further stated that some of the settings he chose were the same ones used tocalculate the OTPR. The resultant OTPR calculations subsequent to the deactivation ofthese 22 settings (March 9, 2015) were: March – 95%, April – 98%, May – 96%, June – 96%, and July – 94%. Mr. Jones acknowledged to the OIG that the OTPR has been
skewed, since March 9, 2015, based on the deactivation of the 22 settings and theformula he designed when calculating the OTPR from the Trapeze System data. Forexample, scheduled rider pick-up and drop-off times were edited which resulted in tripsthat were performed late into trips recorded to be performed on time when the OTPRwas calculated.
Between March 9, 2015 and March 17, 2015, Mr. Jones requested an additional settingbe turned off as it was tracking every time someone looked at or queried a trip in the
Trapeze System. This additional setting was not turned off.
Directing Subordinate Employees to Alter Times
In March 2015, after the deactivation of the 22 settings, Mr. Jones instructed DispatchSupervisor Benjamin Espinoza to change rider window times of the rider’s routes (which
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
7/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
next working day. Mr. Espinoza said that Mr. Jones showed him and Ms. Lopez how tochange the rider pick-up window times. Mr. Espinoza said they were told to stop the
project by Mr. Jones sometime after the OIG started its investigation. He now realizesthat the changes he was making did have an effect on the OTPR. Mr. Espinoza saidthat at the time they were making the changes he was just concerned that he was doinghis job because he was a new supervisor and wanted to follow orders. He was moreconcerned with the daily operations. Mr. Espinoza was not concerned with the bigpicture.
Ms. Lopez’ explanation coincided with Mr. Espinoza’s. She said she would notify Mr.
Espinoza every morning after she completed her task of making time changes. Ms.Lopez said she altered rider’s window times “to get the OTP up.”
Ms. Lopez also confirmed, once shown documentation she accessed the screen in theTrapeze System, that she was the one who changed the time of the original complaintreceived by the OIG to show that the rider was only on the bus for one hour instead ofthe 2 hours and 29 minutes the rider was actually on the bus on her April 10, 2015 trip.Ms. Lopez acknowledged this would have been one of the trips she changed for Mr.
Jones.
Vendors Changing Data Inaccurately Inflating the OTPR
Although our complainant’s allegation was directed at PTC employees altering times inthe Trapeze System, which we substantiated, we found that the altering of times wasalso occurring externally by at least one of the Transportation Providers. On June 15,2015, Mr. Jones emailed First Transit Finance Director, John Coons, to inquire about “alot of client [rider] times (windows) are being changed under FT [First Transit] logins.”
As a result of the email, Mr. Coons stated he researched in his company who hadaccess to the Trapeze System. He stated that one of his company’s FOBs5 was in theMedi Wheels6 office and the Billing Manager, Kristine Thomas, was the person usuallyin control of the FOB. Mr. Coons said that he questioned Ms. Thomas and she did notadmit to using the FOB to gain access and change window times in the TrapezeSystem. However, Mr. Coons said that after talking to Ms. Thomas the activity stopped.
Ms. Thomas stated that she was hired to assist with billing because she had done so asa billing manager with Metro Mobility and was familiar with the Trapeze System. Sheexplained that Medi Wheels provides 20 drivers to First Transit for their transportationoperations and provides 45 routes per week for First Transit. Ms. Thomas said sheschedules the drivers, provides the manifest to the drivers, and performs payroll duties
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
8/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
said that she was using the same procedure she had done with Metro Mobility. No onefrom PTC or First Transit told her or trained her otherwise.
Ms. Thomas explained she would go back to the prior day or days (after service) andchange the times for the first r ider’s initial scheduled pick-up window time and the lastr ider’s drop-off window time to the actual time the driver arrived. She said that shemade the two changes to each route. Ms. Thomas said that Medi Wheels had 45routes per week and Peoples Transit also had 45 routes per week. She advised thatFirst Transit had 565 routes per week. Ms. Thomas explained that based on thenumber of routes she would make approximately 1,220 changes per week (610 x 2 =
1,220) between First Transit and Medi Wheels. She said that the Peoples Transit BillingManager, Latoya Kelly, was performing the same function. Ms. Kelly was making twochanges to each route, totaling 90 changes per week (45 x 2 = 90). Ms. Thomas statedthat based on the number of routes, 1,310 changes per week were being made, for FirstTransit, Medi Wheels, and Peoples Transit. She started the process for Medi Wheelsand First Transit from the beginning, February 1, 2015, continuing through June 16,2015 (a total of 19 weeks). Ms. Thomas stated that no one from PTC or First Transitinformed her that changing the rider ’s pick-up and drop-off window times was wrong.
Ms. Thomas said that Mr. Coons asked her if she had been changing the r ider’s windowtimes and she replied no. Ms. Thomas explained that she showed Mr. Coons what shewas doing in the Trapeze System. She said that Mr. Coons reviewed a screen shot ofthe example then told her to stop doing whatever she had been doing. Ms. Thomassaid that Mr. Coons also told Ms. Kelly from Peoples Transit to stop.
Ms. Thomas explained that she knew what she was doing by changing the r ider’swindow times made every route on time regardless of whether it was on time or late, butdid not know that it would be calculated for OTPR. Ms. Thomas explained that she didnot think that PTC (Mr. Jones) was calculating the OTPR from the entries Medi Wheels,Peoples Transit, or First Transit were making. She advised that no one instructed her tochange the r ider’s window times. Ms. Thomas said that she did not intentionally changethe times to increase the OTPR. She said that this was how she did it when working forMetro Mobility when billing PTC and thought she was doing it right by changing the
times.
Ms. Kelly advised that she worked for Metro Mobility in the Complaint Department priorto being hired by Peoples Transit in December 2014. She explained she was trained byMs. Thomas on how to process the billing to PTC. Ms. Kelly said she performed thesame process for billing as Ms. Thomas. She said that she started the billing procedure
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
9/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
just the company. Ms. Kelly explained that when using the FOBs, the Trapeze Systemwas wide open for anyone to access it and manipulate the numbers.
As of August 17, 2015, Mr. Jones ordered the reactivation of three of the 22 settings toaccount for the changing of times and deleted events. The OTPR for the monthsfollowing the reactivation were: August 92%, September 91%, October 93%, November93%, December 92%.
As of September 23, 2015, all but seven settings were re-activated at Mr. Jones’ direction. It should be noted, according to Mr. Jones, since the reactivation of these
settings, there has been no problem with the speed of PTC’s computer server .
On February 17, 2016, during his third and final interview, Mr. Jones stated that PalmTran Assistant Director, Charles Frazier, is not knowledgeable of PTC operations belowMr. Jones. He said Mr. Frazier only knows what he tells him. Mr. Jones stated that Mr.Frazier did not instruct him to change the rider times or to deactivate the settings. Healso stated that Ms. LaRocque did not instruct him to change the rider times or todeactivate the settings. Mr. Jones said that he changed the OTPR numbers so he
would not be questioned by Ms. LaRocque why the OTPR was low and they did notmeet their 95% goal. Mr. Jones stated that he is responsible for what has occurred.
We found that Mr. Jones created an operating environment where he was ableto manipulate the Trapeze System and in doing so, the OTPR by: deactivatingspecific settings; directing employees under his supervision to change r ider’swindow times; as well as, design a program that calculates the changed times,
not the original scheduled times, when calculating the OTPR. We also foundthat even when the manipulation of the Trapeze System and the changing ofrider’s window times did not result in an acceptable OTPR, Mr. Jones wouldsubstitute an acceptable OTPR for an unacceptable OTPR.
Cancelling and Rescheduling Trips
On February 18, 2016, PTC Reservationist, Amanda Wright, came forward andprovided documentation of examples in February 2016 where PTC Dispatcher CalebRichelieu was changing rider times in a different manner. Ms. Wright alleged thatinstead of changing the rider pick-up window times to make a trip appear to be on time,Mr. Richelieu was cancelling scheduled trips and creating new trips with rider pick-upwindows that would make the actual rider pick-up appear to be unchanged and on time.
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
10/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
picking up the rider and replacing them with new rider pick-up windows since he washired by PTC as an Assistant Dispatcher in October 2014. Mr. Richelieu advised that
he does not know how many changes he has performed but knows that it was“ a lot.
” Mr. Richelieu advised that no one taught him this procedure and that he learned do it on
his own when he realized what the Trapeze System can do. Mr. Richelieu stated thathe had not received any gifts, money, or favors from any of the Transportation Providerrepresentatives for making their late trips into trips performed on time. Mr. Richelieustated that in one of the instances brought to us by Ms. Wright (a February 14, 2016trip), the reason why he changed the window time was because the rider contacted PTCthat day and requested a later pick-up time.
On February 24, 2016, we asked PTC Customer Service Representative Nadia Charlesto review the Trapeze System regarding the examples Ms. Wright provided. Ms.Charles checked the Trapeze System and advised that none of the TransportationProviders were assessed a late violation fee of $200 because Mr. Richelieu made thelate trips into trips performed on time. Ms. Charles also checked the Trapeze System(which records all calls) to see if the rider for the February 14, 2016 incident called onthat date to change his scheduled pick-up time as Mr. Richelieu stated in his interview.
Ms. Charles advised that the rider did call on that day, but only to check on the driver ’sETA as the driver was late.
Financial Impact of Changing the OTPR
We estimate that Ms. Thomas and Ms. Kelly made 1,310 time changes per week forFirst Transit, Medi Wheels, and Peoples Transit between February 1, 2015, continuingthrough June 16, 2015 (19 weeks) for a total of up to 24,890 changes. Due to thesettings being turned off, we cannot determine how many of these changes were maderesulting in late trips being changed into on time trips. We know that Mr. Espinoza andMs. Lopez changed late trips into on time trips daily from March 2015 through July2015. We also know that Mr. Richelieu cancelled “a lot” of late trips, doing so dailybetween February 1, 2015, through at least February 23, 2016 and replaced them withon time trips.
Mr. Jones calculated that there were an average of 286 time changes made per daybetween March 9, 2015, when the settings were deactivated and August 17, 2015,when they were turned back on – for a total of 161 days. The estimated total number oftime changes during this time frame was 46,046. This number does not account for thechanges made by Mr. Richelieu between February 1, 2015, and at least February 23,2016 as this was unknown at the time Mr. Jones did his calculation. We estimate that
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
11/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
$60 liquidated damage as PTC occasionally did, it could have resulted in $1.26 million or more in liquidated damage that may have been assessed by PTC7. It should be
noted, in no instance did we find changes to rider pick-up times that had a negativeeffect on the OTPR. Furthermore, even when improper changes were identified, PTCdid not go back and correct the changes.
The OTPR is not only used as an internal measurement by PTC to gauge theeffectiveness and efficiency of operations. It is also used when Palm Tran executivesgive presentations to stakeholders, such as the BOCC.
Examples of Email Traffic Which Demonstrates the Operating Environment at PTC
February 23, 2015, Ms. LaRocque forwarded an undated email (based on the content,from February 23, 2015) to Keith Whalen [First Transit representative]. The forwardedemail was from Michael Cassidy [Palm Tran Data Analyst]. The forwarded emailcontained the daily OTPR broken down by Transportation Provider from the beginningof February through February 22, 2015. In this forwarded email, First Transit’s dailyOTPR ranged from a low of 58% to a high of 96%. The body of the email from Ms.
LaRocque to Mr. Whalen, “I think you need to start firing people.”
February 23, 2015 from Mr. Whalen to Ms. LaRocque, “Were you told the MDTs8 wentdown for an hour and a half yesterday? This seems to be a major problem that isaffecting OTP.”
February 23, 2015, from Ms. LaRocque to Mr. Whalen, “I respectfully di sagree. Yes theMDT’s did go down for a few hours in the morning and there was adequate time torecover. You are getting excuses. Rick [Richard Gonzalez, General Manager for FirstTransit] does nothing but make excuses.”
The above emails demonstrate senior management’s desire and guidance to increasethe OTPR. They do not reflect improper pressure or guidance to improperly manipulatedata.
March 31, 2015, from Mr. Jones to Mr. Cassidy and Mr. Frazier, CC: Charles Miller[Palm Tran IT Manager], “We had MDT issues Friday also, so while we show 95% forthe day, which is good, I don’t think First Transit was truly at 89%. If we show that, it willcreate more questions. Can we just show all were at 95%.
March 31, 2015, from Mr. Cassidy to Mr. Jones and M r. Frazier, CC: Mr. Miller, “so
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
12/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
March 31, 2015, from Mr. Jones to Mr. Cassidy and Mr. Frazier, CC: Mr. Miller,“Correct.”
When Mr. Jones was shown the March 31, 2015 email chain he said that he changedFirst Transit’s OTPR from 89% to 95% so it would not make them look as bad whencompared to the other Transportation Providers when presenting the numbers to Ms.LaRocque. Mr. Jones said that he changed the numbers so he would not bequestioned by Ms. LaRocque why the OTPR was low and did not meet their 95% goal.Mr. Jones said that in hindsight he agrees that he “fudged the numbers” and should nothave done it. Mr. Jones said that they did leave off days and make the OTPR numbers
comparable in February, March, and April, but that has stopped.
April 13, 2015, from Mr. Cassidy to Mr. Jones, “Should I use these numbers? Still don’tmatch the 74,530 [the total number of trips for March 2015]”
April 13, 2015, from Mr. Jones to Mr. Cassidy, “My concern is Stanley [Voice]9 will catchthe deviation, unless there is a good reason you could just tell him and Charles [Frazier] should he question the difference”
April 24, 2015, from Mr. Frazier to Will Rodman [Nelson Nygaard Consultant], “Will, Ineed the power of an outside consultant! Can you confirm that the way in which wemeasure OTP is the industry standard? Might be easiest to talk it out, but there is someconfusion about how we measure OTP.”
April 24, 2015, from Mr. Rodman to Mr. Frazier, “Hi Charles, the Short answer is yes, i t’s t he industry standard, but you could probably tighten up the drop-off window.
Agreed, we can discuss when you visit. In the Paratransit industry, OTP is measured interms of whether the pick-up is within the stated pick-up window, and whether the drop-off is late, regardless of whether the customer requests a pick-up time or requests adrop-off/appointment time…”
April 28, 2015, from Mr. Frazier to Mr. Rodman, CC: Mr. Jones, “Very helpful, thankyou. See the attached back and forth between our county Administrator and me. It
seems like we almost on the same page, but something is off.”
When Mr. Jones was shown this email chain between Mr. Frazier and Mr. Rodman, Mr.Jones stated that he was not using the industry standard to calculate the OTPR basedon Mr. Rodman’s description of what the industry standards are. Mr. Jones was askedif the reason why he did not calculate the non-scheduled drop-off times when deriving
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
13/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
April 28, 2015 from Ms. Larocque to Mr. Frazier, “I would really like to understand thisbetter. Let’s set a time to discuss. I need visuals or something to wrap my hands
around this. 99% seems unrealistic.”
June 4, 2015, from Ms. LaRocque to Mr. Cassidy, Mr. Jones, Mr. Frazier, Mr. Miller, andsix others, “The OTP goal should be 95% not 92% as that is what is in the contract.”
July 6, 2015 from Mr. Frazier to Mr. Jones and Ms. LaRocque, “FYI – Stanley [Voice] called Joe this afternoon complaining that the Connection OTP number of 95% isimpossible. Not sure where it will go.”
July 6, 2015 from Mr. Jones to Mr. Frazier and Ms. LaRocque, “Impossible?”
July 7, 2015, from Mr. Frazier to Mr. Jones and Ms. LaRocque, “ Bottom line – he thinkswe are manipulating the numbers.”
August 31, 2015, from Ms. LaRocque to Mr. Frazier, Mr. Jones, CC: Louis Ferri [PalmTran Operations Manager], “It seems to me that the downward trend really started mid
August. This is very concerning. I am not sure that I accept the weather situation.Please look into this further and provide specific information for each vendor. Pleasedon’t rush this. Take the time to analyze the data. I would like information by end ofday Wednesday. Until things improve again, I would like the date reported on a dailybasis.”
August 31, 2015, from Mr. Frazier to Ms. LaRocque, “We will put something together.Don’t forget that school started as well and we’ve seen the same decline on Fixed.”
August 31, 2015, from M s. LaRocque to Mr. Frazier and Mr. Jones, “BUT school was insession when we started and we had much better OTP. I don’t buy that either .”
September 18, 2015 from Mr. Jones to Ms. Ricketts, “ ‘Buffer’ – there is no buffer foranyone (staff) to use. It seems what has happened over time is that since we deducted15 minutes from each appointment time, the schedulers have been adding 15 minutes
when needed to force trips but the dispatchers have been assuming the same thing, sowe have been really moving times. No one should be assuming this as the OTP adds itback in. They need to stop……”
December 8, 2015 from Ms. LaRocque to Mr. Jones, “What is the challenge getting to95%”
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
14/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
there were no monitoring/review procedures in place to determine if changes made inthe Trapeze System were made for a valid purpose.
On April 13, 2015, Ms. Charles reviewed complaint #106594 (the OIG’s originalcomplainant). Ms. Charles found in the Trapeze System’s original bus route manifestthat the rider was picked up at 1432hrs (2:32PM) and dropped off at 1706hrs (5:06PM).Ms. Charles noticed the drop off time for this rider had been changed in the TrapezeSystem’s manifest to 1537hrs (3:37PM) which made it appear that the rider had onlybeen on the bus for one hour instead of the 2 hours and 29 minutes the rider wasactually on the bus. Ms. Charles reviewed the Tracker Action Browser Notes in the
Trapeze System to determine which employee changed the time. The notes did notreflect an employee name nor the date and time it was changed as it normally shouldhave (because Mr. Jones had the settings turned off in March). Ms. Charles thoughtthis to be suspicious because she believed that all entries were stamped with anemployee identification number. Ms. Charles validated complaint #106594 andsubsequently initiated an internal complaint of her own (#106619) to determine whichemployee changed the time. Ms. Charles notified her supervisor, PTC CustomerRelations Supervisor Jeff McGregor, and PTC Dispatch & Scheduling Supervisor,
Evette Ricketts, for further follow up. Mr. McGregor told Ms. Charles in an April 14,2015 email that he deleted her complaint (#106619) from the Trapeze System. Wefound that the time for complaint #106594 was changed by Ms. Lopez on April 13, 2015,prior to Ms. Charles arriving for work that day.
We found that all PTC employees, regardless of their job requirement had access to theTrapeze System and rights to make changes once in the system. We also found thatFOBs assigned to the Transportation Providers were not controlled. In Ms. Kelly’s ownwords, they were interchanging the FOBs all the time to get things done; the FOBs donot identify a person just the company; and, when using the FOBs, the system was wideopen for anyone to access it and manipulate the numbers.
PTC did not have supervisory internal audit or review procedures for the TrapezeSystem. PTC has not reviewed who is accessing the system, why they are accessingthe system, or what they are doing once in the system.
RECOMMENDED CORRECTIVE ACTIONS
Based on the findings, the OIG recommends that PTC take the following correctiveactions:
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
15/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
4. Restrict Trapeze System access rights to the Transportation Providerseliminating their ability to change times, as well as, granting access rights only
to those essential PTC employees needing to make changes in the system aspart of their position duties.
5. Calculate the OTPR according to industry standards.
6. Create an internal policy to monitor times changed so the period endingOTPR can be calculated from the initial scheduled time not the edited time.
7. Create an internal policy to monitor deleted records to require a review byManagement. This policy should, at a minimum, be in accordance withFlorida State Statutes relating to public records.
8. Ensure that authorized employees are instructed on the approved reasonsthat would constitute any changes in the Trapeze System.
9. Implement an external control measure (Periodic Review) to accurately
account for the OTPR or any other targeted data.
During the OIG Investigative Review, PTC Management took actions to address someof the issues that were raised. Three new written Standard Operating Guidelines weredistributed and implemented10 effective September 1, 2015. The three TransportationProviders were restricted from accessing the Trapeze System to make changes to theroute times and PTC Management is in the process of minimizing access only to thosePTC personnel that are required to change times. Mr. Jones has modified his OTPRprogram to only take into account the original scheduled times when calculating theOTPR. PTC Management advised that further actions will be taken and Guidelinesimplemented on an as needed basis to correct any remaining underlying issues.
RESPONSE FROM MANAGEMENT
Pursuant to Article XII, Section 2-427 of the Palm Beach County Code, on March 10,
2016, Assistant County Administrator Shannon R. LaRocque and Palm Tran ExecutiveDirector Clinton B. Forbes were provided the opportunity to submit a written explanationor rebuttal to the findings as stated in this Investigative Review within ten (10) calendardays. Ms. LaRocque requested two extensions which were granted and she along withMr. Forbes provided a joint response on March 28, 2016. Their response is attached tothis report in its entirety.
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
16/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
OTPR is a metric frequently used in the transportation industry (i.e. airlines, bus, andlight rail) to measure delivery of services in accordance with the provider’s published
delivery schedule. Some organizations measure OTPR by comparing scheduled pick-up times against actual pick-up times, while other organizations also measure drop-offtimes. As advised by Will Rodman, a representative of the County’s own consultant,Nelson Nygaard,
“In the Paratransit industry, OTP is measured in terms of whether the pick-up is within the stated pick-up window, and whether the drop-off is late,regardless of whether the customer requests a pick-up time or requests a
drop-off/appointment time…”
In our Draft report our finding read, “PTC supervisors were altering times and/ordirecting dispatchers to alter times in the Trapeze System in order to meet their OTPRgoal.” One of Management’s concerns is with “in order to meet their OTPR goal.” Thephrase “in order to” relates to motive of supervisors to change the data. While webelieve sufficient evidence supports this wording, we have changed our finding to read,“PTC supervisors were altering times and/or directing dispatchers to alter times in the
Trapeze System that resulted in inaccurate and inflated OTPR.” The evidenceoverwhelmingly and clearly supports this finding.
Management Response: Management’s Request for Recorded Testimony, page 1,second sentence of the introduction – “It should be noted that Palm Tran did request,but has not been provided any recorded testimony.”
OIG Comments to Response: To reiterate for Management and to provide the reader
background on this issue, the following is provided. On March 18, 2016, Ms. LaRocqueemailed IG Carey asking “Are we able to get interview transcripts prior to our meeting?”IG Carey responded the same date to Ms. LaRocque stating, in part, “We will not beable to provide confidential records related to the investigation prior to the release of thefinal report. Per the County IG Ordinance (Article XII, Section 2-423, Palm BeachCounty Code), ‘The inspector general’s records related to active audits, investigationsand reviews are confidential and exempt from disclosure, as provided by §112.3188(2)and Chapter 119, Florida Statutes.’ All interviews that were taken under oath andrecorded, along with all other supporting evidence will be made available once our finalreport is issued.” Additionally, as we noted in our March 23, 2016 meeting withManagement, several witnesses expressed fear of retaliation by Management for theircooperation.
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
17/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
Page 7 - "...Mr. Jones instructed two PTC employees...to change rider windowtimes" - not correct, Mr. Jones instructed the Dispatch Manager
Page 9 - "... Mr. Jones ordered the reactivation of three (tracker actions)" - notaccurate, Charles Frazier ordered the reactivation of the tracker actions.
OIG Comments to Response:- The page one reference is in the ‘Executive Summary’ portion of our report. On
page three, in the ‘Background’ section we state “ Approximately six months intoher assignment, Ms. LaRocque recommended to the County Administrator thatthe Executive Director of Palm Tran, Chuck Cohen, be demoted and that the
County replace Metro Mobility with three new Transportation Providers.” Ourreference on page one is intended to say that the former Director was dismissedfrom his position as Director, not terminated or fired. This is evidenced by ourmore detailed description on page three. However, for clarification we deletedthe word “dismissed” and inserted “demoted.”
- The page five reference has been changed to read “until November 2015 whenClinton Forbes was hired”
11. It is noted that the June 2015 date which appeared
in our Draft report was provided to us by Palm Tran administrative staff.
- The page seven reference, which now appears on page five for theaforementioned reason, is correct as it comes from sworn testimony by Mr.Jones, Mr. Espinoza, and Ms. Lopez. We believe Management’s reference to“the Dispatch Manager”, is Evette Ricketts, who advised us her title was PTCDispatch & Scheduling Supervisor. All three witnesses, Mr. Jones, Mr. Espinoza,and Ms. Lopez stated that Ms. Ricketts was aware of what they were doing.
Additionally, all three stated that Mr. Jones gave instructions to Ms. Lopez whenshe would have problems changing the times. For clarification, we have restatedthis reference to read “Mr. Jones instructed Dispatch Supervisor BenjaminEspinoza to change rider window times of the rider’s routes (which wouldincrease the OTPR) who delegated the task to Dispatcher Heather Lopez.”
- The page nine reference, which now appears on page eight, is correct andcomes from Mr. Pace. Mr. Pace stated he was told to turn the first three TASback on by Mr. Jones.
Management Response: Page 2,Of critical importance, the report discusses the financial impact of changing on-time
performance records and states that vendors could have been assessed Liquidated
l $ ll $ ll f h l
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
18/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
performance and no vendor has been assessed LQDs for the on-time performance
metric. It should be noted that LQDs for valid contract violations have been assessed in
the amount of $177,740.
OIG Comments to Response: First, clarification is required here for the reader. Wedifferentiate between drivers picking up scheduled passengers late and OTPR. The firstis a scheduled event and is either on-time or late. The second is a ratio of the numberof trips conducted on-time to the total number of trips conducted. Management assertsthat “no Liquidated Damages (LQDs) are associated with on-time performance and novendor has been assessed LQDs for the on-time performance metric.” We disagree
with the premise that there are no liquidated damages associated with OTPR.
The chart at Article 21, Section C ofthe Contract contains the sumswhich the vendors agreed to payupon failure to perform inaccordance with the terms of theContract. The fifth item in the chart
references performance measuresas referenced in 4.4.19 (4.4.18 isComplaint/Commendation Policies)of Exhibit A. The chart includes (butdoes not limit it to) three of the sixperformance measures listed in4.4.19. The first performancemeasure listed in 4.4.19 is “95% on-
time performance [OTPR].” Thus, the Contract lends itself to these liquidated damages;however, our report does not address this particular liquidated damage when arriving atour financial impact of changing the OTPR.
What we do address and what we used to arrive at “$4.2 million and $9.2 million infines that may have been assessed by PTC” in our Draft report is the assessment ofliquidated damages for late pick-ups. During public meetings Ms. LaRocque oftenstated that vendors would not be assessed liquidated damages since PTC had takencontrol of dispatching. However, during other public meetings, Ms. LaRocque and Mr.Jones12, as well as Mr. Frazier 13 did state that vendors can be assessed liquidateddamages for late pick-ups. More importantly, the Contract itself which was signed bythe County and the vendors, allows for liquidated damages for late pick-ups in itemsfour and six of the above chart. Additionally, both PTC and the vendors acknowledgedb li id t d d i l d d id th t d ld b d
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
19/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
OIG believes that the Contract lends itself to an interpretation that $200 14 could havebeen assessed for each late pick-up. However, management’s objection to this
interpretation is noted and we did adjust our report (page 10) to reflect $60, instead of$200, in calculating total potential liquidated damages that could have been assessed.
Management Response: Quantifying Inflation, page 3,The report does not quantify how much on-time performance could be inflated, but
does estimate that a range of 21,000 (2.3%) to 46,000 (5.1%) invalid time changes were
made to the Trapeze system. Even though this is a very small percentage of the over
900,000 trips provided, it is important to state that Palm Tran did not and will not
condone any employee manipulating data with ill intent.
Valid changes are made within the Trapeze system on a day-to-day basis as part of
standard operating procedures associated with paratransit service delivery. In fact, on a
single day of normal service, we will make upwards of 1,700 valid time changes.
OIG Comments to Response: We found that all of the time changes mentioned in ourreview that were completed by Mr. Espinoza and Ms. Lopez at PTC were done between
March 2015 and June 2015. We also found that all of the changes completed by Ms.Thomas and Ms. Kelly at First Transit were done between February 2015 and June2015. Focusing on March 2015 through June 2015 where all four individuals werechanging times and therefore discounting the approximate 5,000 changes made at FirstTransit in February 2015, between 21,000 and 41,000 times were changed in the March2015 through June 2015 time period. During this same time period, approximately298,000 trips were completed by PTC15. The 21,000 to 41,000 changed times couldhave resulted in 7.05% to 13.76% reduction in the OTPR. The average OTPR during
this time period that was reported to BOCC, stakeholders, and the public was 96.25%.Had these changes not been made, the average OTPR between March 2015 and June2015 could have been between 82.49% and 89.2%. It is noted that after Mr. Espinoza,Ms. Lopez, Ms. Thomas, and Ms. Kelly stopped changing times that the average OTPRreported to BOCC, stakeholders, and the public between July 2015 and February 2016dropped by 3.87% to 92.38%.
14Article 21 Section C of the Contract contains a chart of negotiated liquidated damages which is prefaced by a
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
20/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
Management notes that “Valid changes are made within the Trapeze system on a day-
to-day basis as part of standard operating procedures associated with paratransitservice delivery.” While valid changes may be necessary depending on thecircumstance, PTC used the Wizard Report to make changes indiscriminately withoutregard to whether changes were valid or not. Moreover, the failure to be on-time maybe caused by many factors (e.g. poor scheduling or weather). They do not convert latetrips into on-time trips. Our report does not address valid changes made as needed toproperly operate their business. We do address changes made by Mr. Richelieu, butonly to the fact that they occurred. His changes are not part of the 21,000 to 46,000 in
our report. Those 21,000 to 46,000 changes were, in fact, not made as needed for PTCto properly operate their business. Those changes were made after the fact, to makelate pick-ups appear to be on-time.
Management Response: Persons Interviewed, but no Interview Quotes in OIGReport, page 5,
(it should be noted that both the Operations Manager and the Dispatch Manager were
interviewed as part of the investigation, but no testimony from either witness has been
included in the report).
OIG Comments to Response: We noted at the outset in our report that we conducted45 interviews of 32 individuals. Direct statements from 11 of those individuals are usedin this report. As is the case in most OIG reports (in Palm Beach County andnationall ) not all inter ie ed parties are listed q oted or s mmari ed in final reports
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
21/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
Management Response: Requests for Proposals Incorporated into Contract, page7,
CONTRACT FOR PALM TRAN CONNECTION PARATRANSIT SERVICES (RUN PACKAGE A)
o Article 2, Order of Precedence - the provisions of RFP No. 14-041/SC and allAmendments thereto, which are incorporated into and made a part of this
Contract (Attachment 6).
OIG Comments to Response: So that the reader does not have to rely onManagement’s truncated version of Article 2 in the body of its response or refer toManagement’s Attachment 6, below is the entire Article 2 from the cited Contract:
ARTICLE 2 - ORDER OF PRECEDENCE
Conflicting provisions hereof, if any, shall prevail in the followingdescending order of precedence: (1) the provisions of the Contract,including Exhibit A - Scope of Work and Exhibit B - CONTRACTOR's priceproposal; (2) the provisions of RFP No. 14-041/SC and all Amendmentsthereto, which are incorporated into and made a part of this Contract; (3)
CONTRACTOR's proposal consisting of Part 1 and Part 2 dated June 27,2014; and (4) all other documents, if any, cited herein or incorporatedherein by reference.
We note that in the event of conflicting provisions between the RFP cited inManagement’s response and the Contract, the Contract prevails. We only mention theContract in our report as it relates to liquidated damages, Article 21, pick-up windowdefinitions, Section 4.4.5, and performance metrics, Section 4.4.19. We cite to the
Contract as it relates to these three issues because the Contract takes precedence.
Summary of OIG Comments to Management’s Response: “Of critical importance” toManagement is our discussion of the financial impact of changing the OTPR.Regardless of the rate that could have been assessed, manipulating the systemnegated PTC’s ability to accurately track performance and assess liquidated damages,when appropriate. It is difficult at this stage to definitively determine the total value ofliquidated damages that PTC could have assessed because PTC supervisors andemployees altered the times (as well as vendor employees) and disabled the TrapezeSystem’s ability to track what changes were made, why they were made, and theidentity of the individuals who made the changes.
Had the PTC supervisors and employees accurately monitored the OTPR, it could haveid tifi d f il i f d dd d th i l i th t
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
22/103
OFFICE OF INSPECTOR GENERAL CASE # 2015-0006
indirect consequence of the actions of PTC supervisors and employees who altereddata to inaccurately reflect pick-up times as on-time.
Overwhelming evidence supports our finding that PTC supervisors were alteringand/or directing dispatchers to alter times in the Trapeze System that resulted ininaccurate and inflated OTPR. The results of these altered times:
- Inaccurate and inflated reports were given to the BOCC, senior Countyexecutives, and the public.
- A higher percentage of citizens covered by the Americans with Disabilities Act;the Division of Senior Services; and, the Transportation Disadvantaged16 were
left waiting for public transportation or waiting on buses that went unreported.- Taxpayers lost potential funds in uncollected liquidated damages.- Vendors who were not informed of problems in late pick-ups, or assessed
liquidated damages, were not given the opportunity or incentive to improveperformance.
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
23/103
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
24/103
March 28, 2016
Palm Tran – Response to IG Case 2015-0006
Introduction
Thank you for the opportunity to provide a written response to Case Number 2015-0006. Palm Tran
takes the allegations and the finding in your investigative review of Palm Tran Connection very seriously
and we will consider each of the recommendations provided by your staff. It should be noted that Palm
Tran did request, but has not been provided any recorded testimony.
The draft case report outlines the following finding, supporting sections and recommendations:
A.
Finding:
1. PTC supervisors were altering times and/or directing dispatchers to alter times in the
Trapeze System in order to meet their OTPR goal.
B.
Supporting Sections:
1. Deactivation of the tracker action settings to inflate the OTPR
2. Directing subordinate employees to alter times to inflate the OTPR
3. Vendors changing data inaccurately inflating the OTPR
4. Cancelling and rescheduling trips to inflate the OTPR
5. Financial impact of changing the OTPR
C. Recommendations:
1. Develop personnel and operational policies.
2. Take appropriate personnel action.
3. Reactivate the tracker action settings to track and account for every entry, change, and
deleted event within the system.
4.
Restrict Trapeze System access rights to the Transportation providers eliminating their
ability to change times, as well as granting access rights only to those essential PTC
employees needing to make changes in the system as part of their position duties.
5.
Calculate the OTPR according to industry standards.
6.
Create an internal policy to monitor times changed so the period ending OTPR can be
calculated from the initial scheduled time not the edited time.
7.
Create an internal policy to monitor deleted records to require a review by
Management. This policy should, at a minimum, be in accordance with Florida State
Statutes relating to public records.
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
25/103
March 28, 2016
ResponseWe appreciate the effort put forth in the investigation and the subsequent recommendations; however,
Palm Tran disagrees with the Finding and Supporting Sections 1, 2, 4, and 5 of Case 2015-0006 as theydo not accurately reflect how or why system times were changed. We partially agree with Supporting
Section 3 and have already taken corrective action. Additionally, there were several non-substantive
errors included in the report, listed below, that should be corrected and/or removed from the final
report.
It is important to describe the nature of the situation leading up to and during the immediate months
following the February 1, 2015 start-up date of the new transportation system for Palm Tran
Connection. Service quality with the prior vendor had deteriorated to a completely unacceptable level
for the customers, staff, and the Board of County Commissioners (BCC). With the assistance of a
professional transportation consultant, Palm Tran worked with the BCC to develop a completely new
service delivery model; this included bringing the dispatch function in-house and vehicle ownership for
the County. In less than one (1) year, staff was able to negotiate an exit strategy for the prior vendor,
procure 231 new vehicles, identify and procure a new technology system, develop a Request for
Proposal, and execute three new vendor contracts. The culmination of this work was the single day
transition from one system to another. The months following the February 1, 2015 start-up were
difficult and the learning curve steep; problems with technology, vehicles, radios, new drivers, and new
processes occurred on a daily basis. Fortunately, the hard work and dedication of our staff endured and
service soon stabilized and allowed Palm Tran Connection to provide the excellent service that our
customers deserve and enjoy today.
Of critical importance, the report discusses the financial impact of changing on-time performance
records and states that vendors could have been assessed Liquidated Damages resulting in $4.2 million
to $9.2 million in fines. This is simply not true. From the onset of the project, communication with the
Board of County Commissioners (BCC) has been consistent; the new business model brought the
dispatch function in-house and put both on-time performance and productivity in the hands of County
staff, not the vendors. As such, no Liquidated Damages (LQDs) are associated with on-time performance
and no vendor has been assessed LQDs for the on-time performance metric. It should be noted that
LQDs for valid contract violations have been assessed in the amount of $177,740.
Non-Substantive Errors in the Report
• Page 1 - "...the former Director and vendor were dismissed" - not accurate, the former director
was demoted to another position within the organization due to managerial deficiencies.
• Page 5 - " until June 2015 when Clinton Forbes was hired" - not accurate Clinton Forbes was
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
26/103
March 28, 2016
FindingThe Finding states that changes were made within the Trapeze system in order to inflate the on-time
performance metric. Changes were indeed made within the Trapeze system, but not for the reasoncited. There is no financial impact associated with on-time performance and there is no peripheral
benefit gained by inflating the on-time performance numbers. A purposeful inflation of the on-time
performance metric would be overtly inconsistent with other published indicators of service delivery,
such as complaint and commendation metrics.
The report does not quantify how much on-time performance could be inflated, but does estimate that
a range of 21,000 (2.3%) to 46,000 (5.1%) invalid time changes were made to the Trapeze system. Even
though this is a very small percentage of the over 900,000 trips provided, it is important to state that
Palm Tran did not and will not condone any employee manipulating data with ill intent.
Valid changes are made within the Trapeze system on a day-to-day basis as part of standard operating
procedures associated with paratransit service delivery. In fact, on a single day of normal service, we will
make upwards of 1,700 valid time changes.
Valid Changes - Why we need to Change Times in the System
Consistent with shared-ride paratransit service delivery across the nation, there are many valid reasons
to change system times on a daily basis; the goal is to accurately reflect the service delivered, not inflate
on-time performance. Driver manifests are created by schedulers the day before service, but they are
not concrete. On the day of service, trips on the manifest are in a constant state of change due to
requests by the riders, traffic, weather, reservations errors, driver errors, accidents and vehicle
breakdowns. Reasons to change a trip time are as follows:
1.
Mobile Data Terminal (MDT) is unable to perform a trip - If there is a driver who is unable to
perform his/her time with the MDT, we have to manually enter times for them in order for them
to see their next trip.
2.
Modifying a driver's lunchtime/break in route - We may have a driver who drops a customer
off and may not have another pickup for 2 hours. We would then contact their provider and
advise them that the driver dropped a customer off and does not have another pickup until
later. We would then change their lunch to 5 minutes after their last drop. This helps us withtrips that may be running late during the time that the driver was originally scheduled to take
lunch. This happens due to No-shows or customer trip cancelations.
3.
Routes are extended due to trip needs - There are times when we change the time at the end
f d h d i f h W h d i h d 3 d
h 28 2016
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
27/103
March 28, 2016
verify location of said trip using MDT GPS data and ask what time they arrived and perform the
correct arrival time. The Dialysis Scheduler is also modifying trips due to a Dialysis customer that
may not be finished with their chair time or may be bleeding when getting finished dialysis.
5.
Going back to get the customers to take them home - We may have a customer who has called
back to reschedule their trip because they were No Showed earlier. We would speak to a
Reservationist who would then create a “Will Call” trip; this would change the original trip and
create a new time. Our Dispatch Assistant would then give the trip a time and confirm it with
the customer. We have made a conscious effort to get a rider home if we take them there.
6.
Fix driver MDT mistake - A driver may pick up a client and forget to perform the departure.
They would call Dispatch and inform us that they forgot to perform the departure. We would
then verify the location and time of said trip using MDT data in Trapeze and enter the time for
the driver. If we don't enter this time the driver will not be able to perform his trip and get the
information for the next customer.
7.
Geo Code/Map address corrections - A driver may arrive to a location and the Geo Code may be
wrong. This causes the driver not to be able to enter a time on the MDT. They would then call
Dispatch and we will verify location and manually enter the time for the driver.
8.
Billing/Finance department changes - The finance section changes times by adding/removing a
break, end a route that is left open, clean up any errors or change start times because the driver
left the yard at a different time then stated in Trapeze.
Many of the changes made to the Trapeze system that are referenced in Case Report 2015-006 were
done so to correct inaccuracies caused by either technical issues with equipment or by human error, not
to inflate on-time performance.
Technical Issues with Equipment
There were two distinct technology issues, one of which required staff to change system times to reflect
the actual service provided. First, during the start-up period the Trapeze system would routinely slow
down and in many cases became non-responsive rendering it useless. At the recommendation of
Trapeze, tracking mechanisms were disabled in March 2015 to improve server performance (Detail
provided in Supporting Section 1). Second, it was discovered that the vehicle Mobile Data Terminals(MDTs) did not automatically arrive group trips properly which made many of the on-time arrivals late
even though they were on-time. Staff manually changed these times on a daily basis until the MDTs
were reprogrammed in May 2015 (Example provided in Supporting Section 2).
H man Error
M h 28 2016
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
28/103
March 28, 2016
Section 2). Second, it was discovered that a dispatch assistant was incorrectly cancelling and
rescheduling trips. The dispatch assistant was not following procedures and has been counseled and
retrained (Detail provided in Supporting Section 4). Third, vendors had unnecessary access to theTrapeze system; residual credentials from when the dispatch function was the vendor's responsibility. It
was discovered that unauthorized changes were made to times in the Trapeze system (Details provided
in Supporting Section 3). The vendor's access to the Trapeze system has been restricted.
Supporting Sections
Supporting Section 1
Supporting Section 1 of the report states that tracking mechanisms in the Trapeze system were
deactivated to inflate on-time performance. The tracking mechanisms were indeed temporarily
disabled, but not for the reasons stated in the report. Aspects of the tracking mechanism were disabled
in order to alleviate repeated server crashes during the early start-up phase of the new business model.
The Trapeze system would routinely slow down, and in many cases became entirely non-responsive
rendering it useless. At the recommendation of the Trapeze software vendor (Attachment 1), severaltracking mechanisms were disabled in March 2015 to improve server performance. Since that time, the
server hardware has been upgraded and the tracker mechanism reactivated. All time changes are
tracked providing a reliable audit trail (Recommendation #3)
Supporting Section 2
Supporting Section 2 of the report states that staff were directed to alter times to inflate on-time
performance. Staff did alter times, but not for the reasons stated in the report. Further, the direction
came from the Dispatch Manager, not Mr. Jones (it should be noted that both the Operations Manager
and the Dispatch Manager were interviewed as part of the investigation, but no testimony from either
witness has been included in the report). Early in the start-up phase of the project, technical and human
errors caused many on-time trips appear late in the system even though they were in fact on-time.
First, Palm Tran staff discovered that the MDTs did not show the driver all of the trips on the manifest
and did not allow the driver to "arrive" a group trip. For example, a group trip of four (4) people that all
arrived on time would show one (1) person as on-time and three (3) people as late. To address this
inaccuracy, a report was developed to show late group trips and staff were directed to manually change
the records. This practice went on daily until the MDTs were reprogrammed in May, 2015. It is
estimated that approximately 4,000 trips were manually modified. Additionally, it should be noted that
that in a subsequent interview with Mr Jones he stated that the direction provided to staff could have
March 28 2016
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
29/103
March 28, 2016
people the vehicle even though they had been dropped off. It is estimated that no more than 200 trips
were changed for this reason.
Supporting Section 3
Supporting Section 3 of the report states that vendors were changing data inaccurately inflating on-time
performance. A subcontractor was indeed changing times in the system, possibly for payroll purposes,
and stated that she "did not know it (the changes) would be calculated for on-time performance. She
also stated that "no one instructed her to change the rider's window times...and that she did not change
the time to increase the on-time performance." The vendors should not have had the ability to make
changes to the times and vendor access has been restricted (Recommendation #4).
Supporting Section 4
Supporting Section 4 of the report states that staff were cancelling and rescheduling trips to inflate on-
time performance. Staff did cancel and reschedule trips, but it was a training issue, not an overt attempt
to inflate on-time performance. It was discovered that one (1) dispatch assistant was incorrectly
cancelling and rescheduling trips, and although there are valid reasons to cancel and reschedule trips
the dispatch assistant was not following the correct procedure. The dispatch assistant was counseled in
the correct procedure for rescheduling trips, has been retrained, and is presently being monitored. A
formal operating policy (Recommendation #1) is being developed and Palm Tran will ensure that
authorized employees are instructed on valid reasons for making time changes in the Trapeze system
(Recommendation #8).
Supporting Section 5
Supporting Section 5 of the report discusses the financial impact of changing on-time performance and
states that vendors could have been assessed Liquidated Damages resulting in $4.2 million to $9.2
million in fines. This is simply not true. From the onset of the project, communication with the Board of
County Commissioners (BCC) has been consistent; the new business model brought the dispatch
function in-house and put both on-time performance and productivity in the hands of County staff, not
the vendors. As such, no Liquidated Damages (LQDs) are associated with on-time performance and no
vendor has been assessed LQDs for the on-time performance metric. Public and legal documentsmemorialize this intention as follows:
• Approval of the Request for Proposals April 22, 2014 - BCC Presentation (Attachment 2)
o Page 17, Service Performance Metrics describes the goal of Palm Tran Connection staff
March 28 2016
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
30/103
March 28, 2016
• Non-Mandatory Pre-Bid Proposal Conference May 21, 2014 - Presentation (Attachment 3)
o Page 28, 4.4.19 Service Performance Metrics describes the goal of Palm Tran Connection
staff is to obtain 95% on-time performance and a productivity ratio of 1.71 trips per
service hour.
o Page 33, Article 21 - describes Liquidated Damages of $200 for Failure to pick up
passengers, not for failure to pick up passengers on-time.
• REQUEST FOR PROPOSAL RFP NO. 14-041/SC (Attachment 4)
o
Page 45, Section 4.4.19 Service Performance Metrics describes the goal of Palm Tran
Connection staff is to obtain 95% on-time performance and a productivity ratio of 1.71
trips per service hour.
• AMENDMENTS REQUEST FOR PROPOSAL RFP NO. 14-041/SC (Attachment 5)
o Page 21, C.A.37 Response to Veolia Transportation - there will be no liquidated damage
for failure to meet on-time performance goals.
o Page 53, C.A.37 Response to SCR Medical - the RFP does not incorporate LQDs for late
trips.
• CONTRACT FOR PALM TRAN CONNECTION PARATRANSIT SERVICES (RUN PACKAGE A)
o
Article 2, Order of Precedence - the provisions of RFP No. 14-041/SC and all
Amendments thereto, which are incorporated into and made a part of this Contract(Attachment 6).
o Article 21, Section C - Liquidated Damages - Failure of the Contractor's driver to pick up
a scheduled passenger, which was reasonably within the driver's control (Attachment
7).
It should be noted that LQDs for valid contract violations have been assessed in the amount of $177,740
(Attachment 8).
Recommendations
As an organization dedicated to continuous improvement, we recognize the benefits this investigation
March 28 2016
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
31/103
March 28, 2016
• In development and to be completed within 30 days.
2. Take appropriate personnel action.
• Will be evaluated within 90 days.
3. Reactivate the tracker action settings to track and account for every entry, change, and
deleted event within the system.
• Completed on August 17, 2015.
4.
Restrict Trapeze System access rights to the Transportation providers eliminating their
ability to change times, as well as granting access rights only to those essential PTC
employees needing to make changes in the system as part of their position duties.
• Completed on August 19, 2015.
5. Calculate the OTPR according to industry standards.
•
Will be evaluated within 90 days.
6. Create an internal policy to monitor times changed so the period ending OTPR can be
calculated from the initial scheduled time not the edited time.
• Will be evaluated within 90 days.
7. Create an internal policy to monitor deleted records to require a review by
Management. This policy should, at a minimum, be in accordance with Florida State
Statutes relating to public records.
• Completed on September 14, 2015.
8.
Ensure that authorized employees are instructed on the approved reasons that would
constitute any changes in the Trapeze System.
• In development and to be completed within 30 days.
9. Implement an external control measure (Periodic Review) to accurately account for the
OTPR or any other targeted data.
From: Dan Pace
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
32/103
Sent: Monday, March 09, 2015 9:17 AMTo: Ron Jones; Louis Ferri; Evette Ricketts
Cc: Charles Miller K.; Chris EatonSubject: RE: Trapeze PASS Tracker Actions settings
Trapeze suggest
we
turn
off
everything
that
you
don't
need
and
no
show
seems
to
be
the
only
one
set
for
notes.
Let us know if you want to disable all of them except for no show?
Dan
From: Ron JonesSent: Friday, March 06, 2015 9:40 AM
To: Dan Pace; Louis Ferri; Evette RickettsCc: Charles Miller K.; Chris EatonSubject: RE: Trapeze PASS Tracker Actions settings
Defiantly turn off the Pass/Query as that notes every time someone looks at a trip. Looking at the list, with a lot of them
we do not even know what mean, like CopyTrip. Could we see what Trapeze recommends?
From: Dan Pace
Sent: Thursday, March 05, 2015 1:55 PMTo: Ron Jones; Louis Ferri; Evette RickettsCc: Charles Miller K.; Chris EatonSubject: Trapeze PASS Tracker Actions settings
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
33/103
Daniel Pace
System Administrator II
Palm Tran
3201 Electronics Way
West Palm Beach, Florida 33407
561‐841‐4228
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
34/103
Approval of the Request for Proposals
Palm Tran Connection Paratransit Services
April 22, 2014
2
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
35/103
Prior BCC Direction
January 28, 2014
Not bring Connection service delivery in-house
Create in-house dispatch operation to supplementcurrent centralized reservation and scheduling
Have the County purchase and own all vehicles
Do Not make any changes to the current level ofservice
Develop the Request for Proposals
3
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
36/103
Prior BCC Direction
February 25, 2014
Contract with three (3) providers
Incorporate two (2) 40% work packages and one (1)
20% work package
Contract for all dedicated service
Do not incorporate zones for trip distribution
Incorporate County’s Living Wage Ordinance
Do Not include a veteran preference for provideremployees
4
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
37/103
RFP – Section 1: General
1.5 – Purpose: Directly contract with Three (3) Contractors
Ru n Packa ge “A” – 40 % of t o t a l t r i p s
Operational Facility based north of Forest Hill Boulevard
Incorporates western communities
Operates Monday through Saturday
Ru n Packa ge “B” – 40 % of t o t a l t r i p s
Operational Facility based south of Forest Hill Boulevard
Operates Sunday through Friday
Ru n Packa ge “C” – 20% o f t o t a l t r i p s
Operational Facility based between Northlake Boulevard and Boynton Beach Boulevard
Operates Monday through Friday
5
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
38/103
RFP – Section 1: General (Cont’d)
1.5 – Purpose: Directly contract with Three (3) Contractors
Allows proposers to submit on multiple run packages
Does not permit multiple run package awards
Trips are not limited to Run Package area
6
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
39/103
RFP – Section 1: General (Cont’d)
1.6 - Non-mandatory Pre-Proposal Conference
Federal Law does not permit a mandatory meeting
1.7 - Contract Period – Seven (7) years plus Mobilization Mobilization Period: October 7, 2014 – January 31, 2015
Contract Period: February 1, 2015 – January 31, 2022
1.8 – Qualifications Metro Mobility has agreed to not submit a proposal under this RFP
l
7
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
40/103
RFP – Section 1: General (Cont’d)
1.9 - Timeline
May 1, 2014 – Advertise RFP
May 12, 2014 – Non-mandatory pre-proposal meeting
June 20, 2014 – Receipt of proposals
July 14/18, 2014 – Selection committee meeting(s)
September 23, 2014 – BCC ratification of recommendations
October 7, 2014 – BCC contract award
1.12 - Cone-of-Silence
In effect from date of proposal submission
8
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
41/103
RFP – Section 2:
General Terms & Conditions (Cont’d)
2 .9 - R i gh t t o P r o t est
Within five (5) days after posting Notice of Intent to award
2 .10 - D i s adv an t a ged B u si n ess En t er p r i se (D BE )
Establishes a minimum 20% DBE goal for all three (3) Contracts
2.15 – Excep t i on s t o t h e RFP
No exceptions are permitted
RFP Section 2:
9
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
42/103
RFP – Section 2:
General Terms & Conditions (Cont’d)2 .17 - Evaluation Criteria Experience, Qualifications, Past Performance & References 10 Points
Project Approach & Start Up Plan 15 Points
Key Personnel & Operations Information 10 Points
Maintenance Plan and Facility 15 Points
Financial and Business Stability 10 Points
Price Proposal 40 Points
10 0 Po i n t s
RFP – Section 2:
10
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
43/103
RFP – Section 2:
General Terms & Conditions(Cont’d)
2 .26 - Transit Employees Protective Arrangements
Proposer awarded a Contract is responsible for compliance with
and the implementation of the 13 (c) obligations applicable to paratransit operations and employees, if any
Proposer awarded a Contract solely responsible for all costsassociated with compliance or failure to comply
County encourages, but does not require, consideration of paratransit workers from the incumbent paratransit contractor(Metro Mobility) and its subcontractors (Two Wheels, Medi Wheels)to fill vacant positions for which such transit workers are qualified
RFP – Section 3:
11
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
44/103
RFP – Section 3:
Proposal Requirements3 .1 – Experience, Qualifications and Past Performance – 10 PointsPa r a t r a n si t Ser v i c e Con t r a c t s
Last five (5) years
Value over $5 Million (Run Packages “A” & “B”) and $1 Million (Run Package “C”) Letters of recommendation are encouraged
Fa i l u r e t o Com p l et e Con t r a c t s
Last five (5) years
P r e v i o u s L i t i g a t i o n Rega r d i n g Pa r a t r a n s i t Ser v i c e De l i v er y
Over past five (5) years Exceed $100,000
H i st o r y o f DBE Com p l i a n c e
Co n t r a ct o r I n t eg r i t y & Com p l i a n c e w i t h P u b l i c Po l i cy
12
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
45/103
RFP – Section 3: Proposal
Requirements (Cont’d)
3.2 - Project Approach and Start Up Plan - 15 Points
Co r p o r a t e p h i l o so p h y a n d com m i tm en t t o p a r a t r a n s i t s er v i ces
St a r t u p a p p r o a ch t o m eet F eb r u a r y 1, 20 15 dead l i n e
Transition Plan
Facilities Securement
Staffing
RFP – Section 3:
13
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
46/103
RFP – Section 3:
Proposal Requirements (Cont’d)
3.3 Key - Personnel & Operations Information - 10 Points
O r g a n i za t i o n ch a r t
Resum es o f key per son n el
Project/General Manager
Operations Manager
Vehicle Maintenance Manager
Safety & Training Manager
Human Resource Manager
Finance Manager
Mobilization Manager
RFP – Section 3:
14
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
47/103
RFP Section 3:
Proposal Requirements(Cont’d)
3.3 - Key Personnel & Operations Information (Cont’d) - 10 Points
Proposed wage schedule
Training programs
Safety record
List of subcontractors
3.4 - Maintenance Plan & Facility - 15 Points
System safety program
Maintenance capabilities
Proof of facility securement (lease, own, etc.)
RFP Section 3:
15
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
48/103
RFP – Section 3:
Proposal Requirements (Cont’d)3.5 - Financial & Business Stability - 10 Points
I n c om e st a t em en t s
Current year and two (2) years prior, or
Tax returns - three (3) years
W ho l l y -o w n ed su b si d i a r y – p a r en t com p a n y i n f o r m a t i o n
F r a n ch i se, p a r t n er sh i p – f i n a n c i a l i n f o rm a t i o n o n p a r t n er s
3.6 - Price Proposal - 40 PointsLow est p r i c e, r espon si v e an d r espon si b l e p r oposa l over seven ( 7) y ea r s
F or m u l a t o est a b l i sh r a n k i n g o f r em a i n i n g p r o p o ser s
RFP – Section 4:
16
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
49/103
RFP Section 4:
Scope of Work4.2 - Payment Structure
Mobilization costs amortized over first year paid weekly
Fixed cost amortized over each of the seven (7) years paid weekly
Variable costs based on per hour rate
Fuel cost paid weekly with fuel adjustment based on Oil Price
Information Service (OPIS)
4 .3 - Run Package Modification
Ability to shift vehicles for non-performance
Ability to shift to future non-dedicated providers
RFP – Section 4:
17
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
50/103
RFP – Section 4:
Scope of Work (Cont’d)
4.4.19 - Service Performance Metrics
95% on-time performance (currently 91%)
Productivity – 1.71 trips per service hour
Complaint ratio – 3.0 valid per 10,000 trips
Accident ratio – 1.0 per 100,000 vehicle miles
0% uncovered runs
0% late pullout
One (1) road call per 10,000 vehicle miles
RFP – Section 4:
18
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
51/103
Scope of Work(Cont’d)
4 .5.9 - Driver Qualifications
Valid drivers license for three (3) years
Level 2 background screening per Florida Statute
No traffic violation convictions
Driver record check with FL Dept. of Highway Safety
No license suspension for last three (3) years
Must pass drug and alcohol testing
Physically able to perform duties
New drivers – 120 hours minimum training before starting
19
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
52/103
RFP – Section 4:
Scope of Work (Cont’d)
4 .6 - Vehicle Maintenance
Con t r a ct o r t o m a i n t a i n a l l v eh i c l es a n d equ i pm en t
Preventative Maintenance
Vehicle Cleaning
Body Damage
RFP – Attachment 1:
20
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
53/103
Contract for Paratransit ServicesRequ i r ed t o execu t e a t t a c hed Con t r a c t w i t h no ex cep t i o n sA r t i c l e 7 – Per f o r m an ce Bon d
Run Package “A” - $1 Million
Run Package “B” - $1 Million
Run Package “C” - $700,000
• Security for faithful performance
• Costs to obtain a replacement contractor due to failure to perform
• Ensures faithful performance of all the requirements
RFP – Attachment 1:
21
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
54/103
Contract for Paratransit ServicesRequ i r ed t o execu t e a t t a c hed Con t r a c t w i t h no ex cep t i o n sA r t i c l e 9 – Ter m i n a t i o n
Provides for termination for default
Provides for termination for convenience
A r t i c l e 16 - I n su r an ce
Commercial general liability $1 Million
Business automobile $1 Million
Umbrella or excess liability $5 Million
RFP – Attachment 1:
22
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
55/103
Contract for Paratransit Services(Cont’d)
A r t i c l e 21 – L i q u i d a t e d Dam ages
L i q u i d a t e d d am ag es n o t a p en a l t y
Failure to maintain vehicles $100/incident per day
Failure to adhere to driver qualifications/training $100/per incident
Failure to maintain employee files $60/per incident
Failure of driver to provide service $60/per incident
Failure to meet Performance Measures $2,500/month
• Accident ratio
• Breakdown ratio
• Complaint ratio
Failure to pick up passengers $200/per incident
Contractor is unable to cover a route $300/per incident
RFP – Attachment 1:
23
-
8/18/2019 Investigative Review 2015-0006 Palm Tran Connection
56/103
Contract for Paratransit Services(Cont’d)
A r t i c l e 3 4 – M od i f i ca t i o n s o f W o r k
County reserves right to shift work
6% of Trips – 40% package
6% of Trips – 20% package
No l i m i t t o sh i f t f o r n o n - p er f or m a n c e
A r t i cl e 39 – L i v i n g W age O r d i n a n ce
Incorporated for prime and subcontractors
Staff Recommendatio