package evaluation criteria - general

General Package Evaluation Criteria Template

mq025tm1.xls

Vendor A Vendor B

Reference Category/Criteria Score Score

Availability/Recovery 0 0

0 0

0 0Audit trails automatically provided for all transaction detail. 0 0System capable of enabling before and after logging feature. 0 0Reporting tools provided for browsing audit trails. 0 0

Architecture 0 0Opportunities for phased modular deployment provided. 0 0

0 0

Products use a widely recognized database management system. 0 0Data dictionary provided. 0 0Data shared in same file structures across sub-systems. 0 0Redundant versions of data are not maintained. 0 0

0 0

0 0Data structures can be integrated with customized software 0 0Supports exports of data extracts. 0 0Supports batch import of data files. 0 0Supports customer programmer access to database. 0 0

0 0

0 0Correctly computes comparisons of dates into the next century. 0 0

Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

Recovery mechanism ensures data integrity to the business function level.

Data is recoverable after computer failure with minimal operator assistance, within 24 hours.

Products developed in or can interface with a widely used 4GL development tool.

All subsystems can deliver data to and accept data from other automated systems.

Modification of data in one subsystem automatically updates related data in all subsystems.

Predefined facilities and interfaces to allow addition of custom routines.

Product implementation supports inherent designs of operating system and does not attempt to override them.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0

0 0Supports multiple users. 0 0Accessible from remote locations. 0 0Supports Electronic Data Interchange (EDI). 0 0

Architectural Principles 0 0Supports an open system approach. 0 0Provides single system image. 0 0Operates on preferred hardware (e.g., PC, Mac, Mini). 0 0

0 0Platform independent. 0 0

Layered architecture with maximum independence between layers. 0 0Re-usability employed during code development. 0 0Supports client/server implementations. 0 0

0 0

Contract 0 0Ownership of components clearly defined. 0 0Source code available in hard copy and electronic media. 0 0Ownership of modifications to source code clearly defined. 0 0

0 0

Functions that require exclusive use of data files are clearly identified and documented.

Supports timely updating of information; critical updates take place immediately.

Operates in preferred operating environment (e.g., Windows, UNIX, MVS).

Consistent with customer standards for protocols, operating systems, network operating systems, disk storage mediums, and other technologies).

Protection of source code provided against bankruptcy, receivership, liquidation, take-over, absorption.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

ScoreWarranties for performance available. 0 0Satisfactory right to terminate clause in contract. 0 0Remedies for breach of contract provided. 0 0

0 0Payments are milestone/delivery based. 0 0

Conversion Aids 0 0

0 0Will coordinate data conversion activities. 0 0Provides data cleansing services. 0 0Provides conversion utilities. 0 0

Costs and Pricing 0 0Pricing arrangements available (purchase, license, lease) 0 0Invoices will be payable in appropriate currency. 0 0One time costs are included in pricing. 0 0Recurring annual and monthly costs are included in pricing. 0 0

Incremental costs for upgrades and expansions are included in pricing. 0 0Implementation support costs identified. 0 0Training costs identified. 0 0Customization costs identified. 0 0Conversion support costs identified. 0 0

0 0

0 0

Contract protects customer from damages due to non-performance of software.

Will supply conversion expertise on-site on a per-diem basis (provide rates).

Prices of other products that must be licensed/purchased for use with each product (e.g., DBMS license) identified.

No or low price increases (including maintenance/support) over last 3 years.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

ScoreTraining materials include in price. 0 0All documentation included in price. 0 0

0 0No or low costs for additional copies of documentation. 0 0On-line help facilities included in price. 0 0

0 0Pricing structure for follow-up training provided. 0 0

Documentation 0 0Installation guide available. 0 0Maintenance guide available. 0 0System documentation available. 0 0Operating documentation available. 0 0Training documentation available. 0 0User documentation available. 0 0

0 0User documentation clearly defines procedures for all processes. 0 0System documentation includes design and setup information. 0 0Documentation is available in electronic format (e.g., CD-ROM). 0 0Documentation may be maintained by the customer. 0 0

Copies of documentation included in price: ** quantify requirements ** 100 % of requirements met, 80 to 99 % of requirements met, 50 to 79 % of requirements met, less than 49 % of requirements met.

Training Days included in price: ** quantify requirements ** 100 % of requirements met, 80 to 99 % of requirements met, 50 to 79 % of requirements met, less than 49 % of requirements met.

User and training documentation describes how to use each component in non-technical terms (e.g., functional description).


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

ScoreDocumentation can be copied by customer without restriction. 0 0Documentation is regularly updated and distributed. 0 0Source code provided. 0 0

Human Interface 0 0

0 0

0 0Makes consistent, effective use of colour. 0 0

Data (decimals, dates) entered, stored, and displayed consistently. 0 0

0 0

0 0Single point of entry provided for all data input. 0 0Menus provide access to all applications. 0 0Menus can be customized. 0 0

0 0

0 0Context sensitive help provided (e.g., F1 from any window field). 0 0

0 0

Consistent user Interface; e.g., screen layouts, keyboard functions, and navigation.

GUI interface (e.g., windows, icons, mouse, pull-down menus) consistent with CUA or similar standard.

Provides formatting options for dates (e.g., DD/MM/YY, MM/DD/YY, YY/MM/DD) that can be easily changed from one format to another.

Provides formatting options for currency (e.g., amounts formatted with commas or spaces).

Quick paths provided from one function to another without using menus.

On-line help provided including: features to assist in locating a function or feature, descriptions of how each function works, descriptions of fields, their contents, and acceptable formats.

Minimal effort required to escape from incorrect selection or system error.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0

Provides on-line look-ups on partial keys (e.g., part of customer name). 0 0

0 0

Minimum two levels of error messages provided: error and warning. 0 0Descriptions of error messages are understandable. 0 0

Interface Requirements 0 0Ability to interface/interoperate with existing systems. 0 0

Maintainability/Flexibility/Expandability 0 0System upgradeable without migration to another platform. 0 0Incremental growth path to permit expansion, as needed. 0 0Minimal customization to products required. 0 0

0 0

Performance/Reliability 0 0

0 0

Platform 0 0Proposed configuration supports expected performance levels. 0 0

Provides on-line look-ups of key field information (e.g., customer by ID or name).

Numeric entries automatically signed where possible (e.g., credit displays as negative).

Customization and developed interfaces will not impact option to upgrade product.

Response time for devices not using telecommunications: ** specify response requirements; e.g., 98 % of window to window response within 0 to 2 seconds. **


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0Designed for easy installation and support. 0 0Designed for use in a distributed environment. 0 0

0 0

Security 0 0Name and password control provided. 0 0Provides individual control of password. 0 0Provides central control of passwords. 0 0Passwords never display on monitors. 0 0Automatic password expiry definable. 0 0Stored passwords are encrypted. 0 0Provides an add/query/delete security function. 0 0Functional security by user provided. 0 0Functional security by user group provided. 0 0File level security by user provided. 0 0File level security by user group provided. 0 0Data attribute (field) level security provided. 0 0

0 0

0 0Security violations are automatically logged. 0 0

Reporting Requirements 0 0

0 0

Resource requirements (e.g., memory, storage, I/O channels, special) defined and costed.

Capable of supporting external portable devices; e.g., handheld computers.

Access control of data (read, write, delete, copy) at the file level by user provided.

Access control of data (read, write, delete, copy) at the file level by user group provided.

Title, page number, report ID, report date, rundate, and time are shown consistently.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0Tools provided to create custom reports. 0 0Report writing tools are user friendly with a short learning curve. 0 0

0 0Provides ability to print multiple copies per request. 0 0Able to reprint reports. 0 0Provides ability to select specific pages of a report to print. 0 0Provides automated report distribution facilities. 0 0

Training 0 0Training in functional use provided. 0 0System administration training provided. 0 0

0 0Training pre-requisites defined; e.g. basic keyboarding skills. 0 0

Multi-language training and training materials provided, as required. 0 0Computer based training software provided. 0 0Classroom instruction and hands-on training provided. 0 0

0 0

Vendor Qualifications 0 0

Provides for special forms alignment, interrupting, restarting, and backward and forward spacing through printouts.

Provides choice of print directly or view display on monitor and then route to printer.

Training provided at: customer site(s), vendor site(s).

Training program can be customized to meet specific customer requirements.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0

0 0

0 0

0 0

0 0

0 0

0 0

Years in business: 0 to 2, 3 to 5, 5+.

Age of product (in years): 0 to 2, 3 to 5, 5+.

Number of new customers in last 24 months (as a percent of customer base): 0 to 5, 6 to 10, 11 to 25, 26+.

Number of employees: 1 to 100, 101 to 500, 501 to 1000, 1001+.

Employees are assigned to product development for each product in sufficient numbers to allow for regular maintenance and enhancements.

Number of employees in customer service for each product per installed user base is sufficient to meet service levels.

Developers of products are currently employed by vendor (i.e., original developers are available for enhancements): 1 to 10, 11 to 25, 25+.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0A methodology was used to develop the products. 0 0

0 0

0 0

0 0

0 0

0 0Satisfactory policy on supporting past releases. 0 0

0 0

Percentage of sales revenue allocated for R&D on each product: 0 to 1, 2 to 5, 6+.

Vendor's customer service employees are available for implementation.

Location of customer service employees (in relation to customer): same city, same region, same country, different country.

Number of customers (e.g., companies, organizations) using each product: 0, 1 to 9, 10 to 24, 25+.

Number of releases (functional enhancements) for each product in last 5 years: 0 to 1, 2 to 3, 4 to 5, 6+.

Number of these releases still being supported: 0 to 1, 2 to 3, 4 to 5, 6+.

Other software products that could be integrated with these products are available.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

ScoreActive user group exists for each product. 0 0

0 0Reference sites provided for each product. 0 0Published evaluations of software provided. 0 0Proof of success in similar organization provided. 0 0

0 0Proposed contract provided. 0 0Sample plans provided (e.g., implementation, training). 0 0

0 00 00 0

0 0

0 0

0 0

User Group influences release of the product; e.g., controls x% of enhancements to the product.

Willing to demonstrate products: at customer site, at vendor site.

Software license agreements provided (e.g., software maintenance, support).

Vendor Financial Position (using financial statements for last three years)

Gross Margin on Sales (Net Sales Revenue - Cost of Goods Sold) / Net sales Revenue: 0 to 30, 31 to 40, 41 to 50, 51+.

Return (before taxes) percent on sales (Income before extraordinary items and taxes / Net Sales): 0 to 5, 6 to 10, 11 to 15, 16+.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0

0 0

0 0Equity / Assets is at least 30%. 0 0Equity / Debt is at least 50%. 0 0

0 0Average Collection Period 30 days or less. 0 0

0 0No significant cautions in Dun & Bradstreet report. 0 0

0 00 00 0

Warranty/Support 0 0

0 0

Return (before taxes) on Shareholders' Investment ((Net Income before extraordinary items - Preferred Dividends) / (Average Total Shareholders Equity - Preferred Shares)): 0 to 5, 6 to 10, 11 to 15, 16+.

Working Capital Ratio (Current Assets / Current Liabilities) is 1:1 or more.

Acid Test Ratio ((Cash + Marketable Securities + Current Receivables) / Current Liabilities) is 0.75:1 or more.

Times Interest Earned (Earnings before interest expense and income taxes / Interest Expense) is at least 1.5.

No significant cautions in financial statement notes (e.g., legal actions, tax assessments, contingent losses or gains, large lump sums due).

Consistent financial position over last three years: very consistent, somewhat consistent, inconsistent.

Telephone service provided: 24 hours per day, 7 days per week, 24 hours per day, 5 days per week, 8 hours per day, 7 days per week, 8 hours per day, 5 days per week.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0

0 0Documentation updated for any fixes. 0 0Procedures for vendor-initiated fixes provided. 0 0On-site expertise available at no or low cost. 0 0

0 0

Customer can modify software without impacting warranty or support. 0 0

0 0

0 0

Guaranteed response time (e.g., customer representative responds with either fix or action plan) within: 1 to 2 hours, 3 to 5 hours, 6 to 12 hours, 24 hours.

Maximum time to implement an emergency fix: 1 to 2 days, 3 to 5 days, 6 to 10 days, 11+ days.

Software warranty begins at: shipment, receipt, installation, acceptance.

Updates, enhancements, and new releases covered under maintenance agreements.

Failure to install an update, enhancement, or new release impacts the warranty/support/maintenance after: 30 days or less, 31 to 60 days, 61 to 90 days, 91+ days.


mq025tm1.xls

Vendor A Vendor B


Rank (e.g., M,

D, O)Weighting

FactorWeighted

ScoreWeighted

Score

0 0

0 0

Total Score 0 0

Warranty/support/maintenance continues after a product function or the entire product is discontinued for: 30 days, 31 to 60 days, 61 to 120 days, 120+ days.

Warranty/support/maintenance is provided for modifications specifically requested by the customer.


mq025tm1.xls

Developing Professional Intellectual Property for our Clients since 1995

Imagination Edge Consulting

(416) 410-0647 [email protected]

package evaluation criteria - general

Documents