practice prize impact mktg science (1)

Upload: taimur-ali-zaidi

Post on 14-Apr-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    1/17

    Vol. 32, No. 2, MarchApril 2013, pp. 229245ISSN 0732-2399 (print) ISSN 1526-548X (online) http://dx.doi.org/10.1287/mksc.1120.0756

    2013 INFORMS

    Effective Marketing Science Applications:

    Insights from the ISMS-MSI Practice PrizeFinalist Papers and Projects

    Gary L. LilienSmeal College of Business, Pennsylvania State University, University Park, Pennsylvania 16802,

    [email protected]

    John H. RobertsCollege of Business and Economics, Australian National University, Canberra, Australian Capital Territory 0200,

    Australia; and London Business School, London NW1 4SA, United Kingdom, [email protected]

    Venkatesh ShankarMays Business School, Texas A&M University, College Station, Texas 77843, [email protected]

    From 2003 to 2012, the ISMS-MSI Practice Prize/Award competition has documented 25 impactful projects,with associated papers appearing in Marketing Science. This article reviews these papers and projects, exam-ines their influence on the relevant organizations, and provides a perspective on the diffusion and impact ofmarketing science models within the organizations. We base our analysis on three sources of datathe articles,authors responses to a survey, and in-depth interviews with the authors. We draw some conclusions abouthow marketing science models can create more impact without losing academic rigor while maintaining strongrelevance to practice.

    We find that the application and diffusion of marketing science models are not restricted to the well-knownchoice models, conjoint analysis, mapping, and promotional analysisthere are very effective applications acrossa wide range of managerial problems using an array of marketing science techniques. There is no one successfulapproach, and although some factors are correlated with impactful marketing science models, there are a num-

    ber of pathways by which a project can add value to its client organization. Simpler, easier-to-use models thatoffer robust and improved results can have a stronger impact than academically sophisticated models can. Orga-

    nizational buy-in is critical and can be achieved through recognizing high-level champions, holding in-housepresentations and dialogues, doing pilot assignments, involving multidepartment personnel, and speaking thesame language as the influential executives. And we find that intermediaries often, but not always, play a keyrole in the transportability and diffusion of models across organizations.

    Although these applications are impressive and reflect profitable academicpractitioner partnerships, changesin the knowledge base and reward systems for academics, intermediaries, and practitioners are required formarketing science approaches to realize their potential impact on a much larger scale than the highly selectivesample that we have been able to analyze.

    Key words : marketing models; decision making; marketing analytics; implementationHistory : Received: May 9, 2011; accepted: August 30, 2012; Russell Winer served as the Practice Papers Section

    editor-in-chief for this article. Published online in Articles in Advance January 23, 2013.

    1. IntroductionOver the past several decades, numerous market-ing science models have been successfully adoptedin practice. However, the breadth and depth of theimpact of these models on the user organizationsare often unclear, leading to several questions: Whichtypes of models are typically adopted in practice?Why? Which types of models have had the great-est impact? Where and why? What can academics,practitioners, and intermediaries learn from the suc-cessful implementation of marketing science models?

    The INFORMS (ISMS Society for MarketingScience) Practice Prize finalist projects provide a valu-able database to address these questions. In 2003,ISMS introduced a Practice Prize to be awarded tothe most outstanding implementations of market-ing science concepts and methods. The methodol-ogy used had to be sound and appropriate for themanagement problem and organization, and the workhad to have significant, verifiable, and preferablyquantifiable impact on the client organizations per-formance. Although other awards (e.g., the Little and

    229

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    2/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications230 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    Bass awards) recognize outstanding rigor in market-ing science, the ISMS Practice Prize1 recognizes rele-vance and organizational impact as well.

    Since its inception, the Practice Prize has recognized25 pieces of work as finalists and winners (see Table 1)in the competition. Each work represents, in its own

    way, a remarkable success story that illustrates theimpact of marketing science, both in a specific situa-tion and in its potential for broader application. Theprojects success and organizational impact have beendocumented in presentations at the prize competition(available at http://techtv.mit.edu/collections/isms),and the details have, with one exception, been pub-lished in Marketing Science.

    In this article, we address four objectives: (1) toidentify common factors that characterize finalistpapers and projects, (2) to cluster projects with com-mon characteristics, (3) to develop a framework thatcharacterizes the successful development and appli-

    cation of marketing science models, and (4) to offerinsight into the diffusion and impact of marketing sci-ence models, with implications for academics, practi-tioners, and intermediaries. We blend three sources ofdatathe published papers, responses of the authorsof the papers to a battery of survey questions, andin-depth interviews with the authors.

    We find that effective marketing science appli-cations span a wide range of managerial prob-lems (e.g., marketing strategy, salesforce management,advertising, and direct marketing) using a varietyof marketing science techniques. And these appli-cations emerge in a number of ways, showing that

    there are multiple paths to success. Sometimes sim-pler, easier-to-use models that offer robust resultshave greater influence than more rigorous, sophisti-cated models do. As with any mode of operation newto the firm, organizational buy-in is critical; such buy-in can be achieved through high-level champions, in-house presentations and dialogues, pilot assignments,the involvement of personnel from multiple depart-ments, and the use of the language of the influentialexecutives. Finally, intermediariesconsultancies andmarket research firmsoften play a vital role in theintroduction of models and their diffusion acrossorganizations.

    In the next section, we summarize the related lit-erature from the perspectives of three actors. In 3,we provide a synthesis of the award finalist projectsthe problems addressed, methods used, and authorsperceptions of the project characteristics. To character-ize the process of development and implementationof marketing science models in organizations, we thenoffer a framework that synthesizes the lessons that

    1 Beginning with the 20112012 competition, the award wasrenamed the Gary L. Lilien ISMS-MSI Practice Prize.

    the studies authors draw from their specific projects.Next, we discuss the diffusion of marketing sciencemodels in practice, focusing on the gap between man-agers and academics with regard to adopting mar-keting science models and how that gap might be

    bridged. We close by highlighting the lessons from

    our review and suggesting ways forward for aca-demics, managers, and intermediaries.

    2. Literature Related toThree Sets of Actors inMarketing Science Practice

    Over the past several decades, a number of authorshave discussed the development and implementationof marketing decision models from the perspectivesof three sets of actors: academics, practitioners (theultimate model users), and intermediaries (analysts orfirms that sit between academia and the firms imple-

    menting the marketing decision models). A recur-ring theme is that the lack of appropriate incentivesmay hamper academics involvement in the devel-opment and execution of practice-oriented market-ing science models. Reflecting on changes since hisseminal decision calculus paper (Little 1970), Littlenotes that although technology, data, and methodol-ogy have changed dramatically, two things remainthe same: organizational inertia and academic pro-motion criteria (Little 2004, p. 1858). Lodish (2001,p. S54) similarly describes his lessons from decades of

    building and applying successful models:

    The criterion for a good, productive model is notwhether it is theoretically or empirically perfect. Itis, will the managers decision, based on the model,improve productivity enough to justify the costs andresources devoted to developing and using the model?This orientation has made it difficult to get somemodel descriptions into the best academic journals.However, I consider practical application to be one ofthe most important attributes of my academic work.

    Lilien (2011) argues that the penetration of market-ing science models in practice is far below its poten-tial. For example, retailers have been slow to adoptpricing decision models even when they are shownto improve retail performance (Reda 2002). Sullivan(2005) reports that only 5%6% of retailers use price-optimization models that their firms have purchased,and most prefer to rely on gut feelings for pricingdecisions. Winer (2000, p. 143) reports,

    My contacts in consumer products firms, banks, adver-tising agencies and other large firms say that mod-els are not used much internally. Personal experiencewith member firms of the Marketing Science Instituteindicates the same I have not seen the penetrationof marketing modeling to which the authors [Leeflangand Wittink 2000] refer.

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    3/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 231

    Table 1 ISMSMSI Practice Prize Finalist Papers/Projects

    Authors and Managerialyear of Finalist paper titlea application (productpublication (Organization) category/industry) Approach Impact

    Kumar et al. (2013) Creating a Measurable SocialMedia Marketing Strategyfor Hokey Pokey:Increasing the Value andROI of Tangibles andIntangibles (Hokey Pokey)

    Customerrelationshipmanagement (icecream retailing)

    Regression and choicemodels

    Financial (F): 83% return on investment (ROI);40% increase in sales

    Cultural (C): Creation of marketing spendingaccountability mind-set

    Transportable (T): Scalable model can be usedby other types of retailers

    Methodological (M): Introduction of a new socialmedia measure: Customer Influence Effect

    Skiera and Nabout (2013) A Bidding Decision SupportSystem for ProfitableSearch Engine Marketing(SoQuero)

    Advertising(childrensproducts)

    Optimization model F: Increase in profit per keyword per year byE33.12; increase in profit per campaign peryear by E10.13139.25

    C: From rules of thumb to optimal DSS withvisualization to understand the decisionsimpact

    T: Company positioned its services as aperformance marketing agency extending tomore clients.

    M: Newton search method to determine optimalbid per keyword

    Sinha et al. (2013) Category Optimizer: ADynamic Assortment, NewProduct Introduction, PriceOptimizer, andDemand-Planning System(ASMI)

    Categorymanagement(packaged goods)

    Regression andoptimization

    F: Profit increase of 70%, increased intangibleassets (brand value) with no decrease inmarket share

    C: Used to support price increase strategy byCEOs in investor meetings

    T: Used with other clients such as Procter &Gamble (P&G), Johnson & Johnson, HomeDepot, and Golden Circle with impact of morethan $9 billion

    M: Innovative methodology to simultaneouslyaddress price optimization, assortment/mixoptimization, and the timing and order of newproduct introduction

    Fischer et al. (2011) Dynamic Marketing BudgetAllocation Across

    Countries, Products, andMarketing Activities(Bayer)

    Advertising(pharmaceuticals)

    Math programming F: Provided market share implications of pricechanges, more than $100 million saved in

    operations, and $16 million in resourceallocation savingsC: Provided more structure to allocation decision

    making, changed organizational thinking aboutkey metrics, generated new heuristics used inbudgeting decisions

    T: Organizational shifts in product and customerstrategy were made based on new insight;model is appropriate for use in manyindustries including consumer durables andconsumer packaged goods

    M: Allocation method for multiproduct budgetsetting process, thus solving the dynamicportfolio-profit maximization problem

    Danaher et al. (2011) Jetstar: Driving the Brand(Jetstar)

    Service design andadvertising

    (airlines)

    Choice models F: 57% increase in profit, 4.1% increase inmarket share

    C: Focused management on high return areas,helped develop a new service-mindedorientation and develop new key metrics foremployees

    T: Provided growth vehicle for QANTAS; putpressure on competitors within the industry;model has already been successfully applied intelecommunications, banking, and retirementfund industries and can be applied in manyother contexts where repositioning isimportant

    M: Model accounts for unobserved heterogeneityof perceptions and relative importance ofservice attributes

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    4/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications232 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    Table 1 (Contd.)

    Authors and Managerial

    year of Finalist paper titlea application (product

    publication (Organization) category/industry) Approach Impact

    Kumar and Shah(2011)

    Uncovering ImplicitCustomer Needs for

    Determining ExplicitProduct Positioning:Growing PrudentialAnnuities Variable AnnuitySales (Prudential)

    Positioning and sales(financial services)

    Regression(structural

    equationmodeling)

    F: More than $453 million in sales lift, increasedsales growth over competition by 8%

    C: Higher level of customer orientation andimproved ability to understand, preempt, andaddress customer needs, even implicit needs

    T: Can be used for any financial service investmentproducts company, especially if products can bepositioned along implicit customer needs

    M: A new tool (Emotion Quotient Tool) thataddresses managers to identify and quantifyemotional states and react accordingly

    Wiesel et al.(2011)

    Marketings Profit Impact:Quantifying Online andOffline Funnel Progression(Inofec)

    Direct marketing (B2B capitalequipment)

    Time-seriesanalysis andfieldexperiments

    F: 14.18 times higher net profit increaseC: Introduced more rigor to marketing fund

    allocation process, altered mental models ofdecision makers, increased the importance ofmarketing analytics in the organization

    T: Improved understanding of the role of marketing

    activities has led to strategic changesM: Model considers importance of multiple stages

    of purchase process, includes dynamic effectsand ROI of online and off-line efforts in abusiness-to-business (B2B) context

    Kannan et al.(2009)

    Pricing Digital ContentProduct Lines: A Model andApplication for the NationalAcademies Press (NAP)

    Pricing (publishing) Discrete choicemodels

    F: Increased revenue (14.4%), increased net sales(6.7%), higher prices on print sales

    C: Policy changes (free PDFs to developingcountries, free PDFs of slow-moving titles)

    T: Models were applied to time-series data ofoverall book sales and other metrics

    M: Shows and accounts for the heterogeneity inperceptions of substitutability orcomplementarity of content forms amongcustomers and how online retail contexts can beused to execute innovative experiments

    Du et al. (2009) PIN Optimal Auction VehicleDistribution System:Applying Price Forecasting,Elasticity Estimation, andGenetic Algorithm to UsedVehicle Distribution (JDPower ODAV)

    Distribution (used durables) Mathematicalprogramming

    F: Increased profits ($220 per car), improvedoperating cost

    C: Operational efficiency (managers freed fromdaily operational tasks), increased transparency,improved strategic decision-making capabilities

    T: Provides a blueprint for similar businesschallenges requiring supply and demandoptimization

    M: Combines linear regression, autoregressiveintegrated moving average, and geneticalgorithm in one model

    Kumar et al.(2009)

    Marketing MixRecommendations to

    Maximize Value Growth atP&G Asia-Pacific (P&GAsia-Pacific)

    Distribution and pricing(packaged goods)

    Regressionanalysis

    F: Increased profits ($39.3 million, obtained viaincreased volume, distribution, and price)

    C: Shift from competing for market share tomanaging value growth

    T: Enables managers to instantly develop pricing,distribution, or sizing strategies with aknowledge of actual close-competing brandsand stock-keeping units

    M: The first time a three-step weighted randomcoefficient regression is used on a system ofequations

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    5/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 233

    Table 1 (Contd.)

    Authors and Managerialyear of Finalist paper titlea application (productpublication (Organization) category/industry) Approach Impact

    Kumar et al.(2008)

    The Power of CLV(IBM-CLV)

    Customer accountmanagement (B2B IT)

    Discrete choicemodels

    F: Increased revenue ($19.2 million from aparticular customer sample group), increasedROI (new ROI 160%)

    C: Alignment of marketing and sales activities,coordinated messaging strategy; shifted fromconsumer spending score to consumer lifetimevalue (CLV)

    T: Can be used in segmenting, profiling, andunderstanding customer migration

    M: The first integrated framework for CLVmanagement that is also suitable for fieldimplementation

    Silva-Risso andIonova (2008)

    Incentive Planning System:A DSS for Planning Pricingand Promotions in theAutomobile Industry (J.D.Power DSSIP)

    Promotion (B2C durables) Discrete choicemodels

    F: Increased efficiency (lower discounts withoutloss in volume) $4.6 million per month

    C: Less dependent on incentives and promotionalprograms, offers insights on consumerheterogeneity in preferences for different typesof promotion applicable to many situations

    T: Characterizes price and promotion

    responsiveness in durables marketsM: Model captures demand shocks, reducing

    endogeneity bias

    Shankar et al.(2008)

    BRAN EQT: A Model andSimulator for Estimating,Tracking, and ManagingMulticategory BrandEquity (Allstate)

    Advertising spending(financial services)

    Discrete choicemodels,regressionanalysis

    F: ROI of 2,500%, short-term savings of$10 million, increased brand awareness (18%),improved brand equity (5%), increased brandcontribution to market capitalization (11%)

    C: More scientific view of and approach tobranding and advertising, increasedcross-functional interest in branding, greatermanagerial accountability; top management viewof branding as an investment

    T: Can be applied to a good or service in either B2Bor business-to-business (B2C) contexts,applicable across functions and across differentbrands

    M: The first model that estimates and tracks brandequity for multicategory brands. The modelincorporates several new means of measuringbrand equity

    Natter et al. (2008) Planning New Tariffs attele.ringAn IntegratedSTP Tool Designed forManagerial Applicability(tele.ring)

    Positioning and segmentation(telecommunications)

    Multidimensionalscaling

    F: Increased share of new customers (23%),$28 million additional profit (estimated)

    C: Easier internal dissemination of informationT: Improved ability to position products

    competitively and target consumers accurately,can be used in a wide variety of contexts

    M: Segmentationtargetingpositioning isintegrated into a single procedure rather than alinear sequence; insights into managerialusability are applied to perceptual mapping

    Ailawadi et al.(2007)

    Quantifying and ImprovingPromotion Profitability at

    CVS (CVS)

    Promotions (retailing) Regressionanalysis

    F: Increased net profit of $44.8 million (eliminatedunprofitable category promotions), improved

    inventory managementC: Promotions discontinued in 15 categories,increased scrutiny of requirementsaccompanying vendor funding, improvedmanager preparedness to negotiate with vendors

    T: Store-level model was applicable in allcategories and drew important conclusions forall functions; the model is applicable for anyretailer with multiple categories

    M: The model is among the first to examinepromotion lift effects at a multicategory retailerlevel and accounts for stockpiling effects whileconsidering gross lift and net impact ofindividual promotions

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    6/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications234 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    Table 1 (Contd.)

    Authors and Managerialyear of Finalist paper titlea application (productpublication (Organization) category/industry) Approach Impact

    Natter et al. (2007) An AssortmentwideDecision-Support System

    for Dynamic Pricing andPromotion Planning(bauMax)

    Pricing and promotion(packaged goods)

    Regressionanalysis

    F: Increased gross profit and sales (varies by timeperiod, but average profit over last three periods

    increased 8.1% and sales increased 2.1%)C: Management now sees price in a much richercontext and has adopted a more rigorous,formal, and disciplined pricing process

    T: Model can be used to plan price and promotionsfor virtually any frequently purchased consumergood (given certain data requirements)

    M: Reference price models are expanded upon andelaborated in several ways, including the use ofa management-driven explicit weighting scheme

    Kitts et al. (2005)b The Right Product for theRight Person: ProductRecommendation fromInfrequent Events(Clickthrough)

    Account management(various)

    Stochastic models F: Increased profit by 40%, revenue by 38% unitssold by 61%; response rate increase of morethan 100%

    C: New system replaced static product offeringwith dynamic offerings

    T: Applicable to a wide range of direct marketing

    applicationsM: Leading-edge probabilistic recommendationagent

    Tirenni et al.(2007)

    Customer Equity andLifetime Management(CELM) (Finnair/IBM)

    Customer accountmanagement (airlines)

    Mathematicalprogramming

    F: Reduced marketing costs (>20%), improvedresponse rates (10%)

    C: More strategically planned marketing campaignsand allocation of marketing resources

    T: Applicable in any industry where companies canidentify customer and engage in directmarketing efforts

    M: Using cross validation for model selection, weare able to build a robust Markov decisionprocess taking into account the uncertainty ofthe parameters of the model and its impact onpredictive performance

    Zoltners and Sinha

    (2005)

    Sales Territory Design: 30

    Years of Modeling andImplementation (ZSAssociates)

    Salesforce management

    (various)

    Mathematical

    programming

    F: More than 1,500 projects for more than 500

    companies in 39 countries; revenue increases of2%7%, leading to over $5 billion in incrementalsales; saved selling time equivalent to over12,500 salespeople; 100% implementation

    C: Increased sales force coordination and efficiencyT: Can be used in almost any salesforce alignment

    situation; allows for better execution ofmarketing strategy

    M: Combination of established models(SmartAlign, SmartSize, MAPS) and aframework for their implementation

    Sinha et al. (2005) Attribute Drivers: A FactorAnalytic Choice MapApproach for ModelingChoices Among SKUs(Campbell Soup Company)

    Category and portfoliomanagement (packagedgoods)

    Discrete choicemodels

    F: Increase in sales (2%), ROI of 3,300%(estimated)

    C: Improved ability to get shelf space(demonstrated value to vendors)

    T: Has been used in multiple categories, can beused to examine and adjust product attributesfor multiple product types

    M: Greater generalizability and managerialusefulness

    Divakar et al.(2005)

    CHAN4CAST: AMulti-Channel Multi-RegionForecasting Model andDecision Support Systemfor Consumer PackageGoods (PepsiCo)

    Price and promotionforecasting (packagedgoods)

    Regressionanalysis

    F: $11 million (estimated) savings fromproductivity enhancement and redeployment ofpersonnel

    C: Altered the top-down approach to salesforecasting, bringing more rigor and reality toforecasting and planning; heightenedaccountability for the sales organization

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    7/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 235

    Table 1 (Contd.)

    Authors and Managerialyear of Finalist paper titlea application (productpublication (Organization) category/industry) Approach Impact

    T: Generalizable to any consumer packaged good,the model has impacted shared best practices

    within the companyM: Model captures the effects of nontraditional vari-

    ables, adjusts for known forecast irregularities,and adjusts for the relationship between weeklysales and wholesale shipments

    Tellis et al. (2005) Modeling the Effects ofDirect TelevisionAdvertising(Futuredontics)

    Advertising evaluation(professional services)

    Regressionanalysis

    F: 30%35% media savings from staffing shifts,$1 million savings from going off air, 25%savings in creative budget

    C: Creative aspects were easier to design to fitspecific targets

    T: Model was successfully applied in otherbusiness units as well as other companies

    M: Joins consumer behavior and econometricmodeling to simultaneously address issues inadvertising such as medium, timing, repetition,

    age of the market, ad age, and ad creative cuesFoster et al. (2004) Will It Ever Fly? Modeling the

    Takeoff of Really NewConsumer Goods(Whirlpool)

    New product management(consumer durables)

    Diffusion models F: Saved major marketing investment by planningfor a longer takeoff, possibly saved a newproduct from being abandoned prematurely

    C: Allowed managers to understand the timehorizon for product takeoff and plan accordingly

    T: Can be used for any new product to predicttime-to-takeoff

    M: First to model new product takeoff, anelbow-shaped irregularity early in the salescurve (product life cycle)

    Roberts et al.(2004)

    Defending Marketing ShareAgainst a New Entrant(Telstra)

    Market shareretention/defensive strategy(telecommunications)

    Discrete choicemodels,

    diffusion models

    F: Provided market share implications of pricechanges, more than $100 million saved inoperations, $16 million in resource allocationsavings

    C: Bills were redesigned, customer-based sitevisits were initiated, and service improvementswere made

    T: The results affected allocation, decision formultiple functions within the company; themodel can be used for a variety ofcircumstances and product or company types

    M: The model accounted for environmentalphenomena as well as the more commonmanagerial decision variables

    Elsner et al. (2004) Optimizing Rhenanias DirectMarketing BusinessThrough DynamicMulti-Level Modeling(DMLM) in a

    Multi-Catalog-BrandEnvironment (Rhenania)

    Direct marketing (directretailing)

    Mathematicalprogramming

    F: Project saved the company, it went from number5 to number 2 in the industry

    C: More effective microsegmentation, moretargeted offerings

    T: Effective across different brands, helped with

    resource allocation across the organization, andis potentially useful in any catalog-like marketingsituation

    M: Dynamic multilevel models introduced tomulticatalog-brand environment and examinesoptimal levels of various marketing activities

    aThe titles here reflect those of the competition entries, not the published papers.bThis entry did not appear in Marketing Science.

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    8/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications236 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    The use of some models is widespread, whereas theapplication of other models is not so common. Thus,Roberts (2000, p. 130) asks the following:

    What is it about conjoint analysis, customer satis-faction models and discriminant-based segmentationapproaches that has led to their managerial adoption

    while in relative terms diffusion models, game theo-retic competitive analysis and multi-equation econo-metric models have languished in the hands of themanager?

    Little (1979) argues that good marketing decisionmodels are not enough but must be embedded inmarketing decision support systems (MDSS) that alsofeature data, analytic tools, and computing power.Wierenga and Van Bruggen (1997, 2000) argue thatdecision aids for marketing managers must match thethinking and reasoning processes of the decision mak-ers who use them, suggesting that there can be nosuch thing as a best MDSS. In a similar vein, Albers

    (2012) notes that to be effective, academic models anddiscussion should shift focus from reducing bias instatistical estimation to calibrating models for opti-mization by managers.

    Most of these issues appear implicitly or explicitlyin the Wierenga et al. (1999) framework for deter-mining the success of applying MDSS to marketingdecision models. In particular, these authors recognizedemand-side issues, supply-side issues, design char-acteristics of the MDSS, the implementation process,and success measures. This extensive set of factors,along with the many drivers in Rogerss (2003) adop-tion criteria, suggests there are a number of potholes

    in the road to the successful implementation and useof marketing decision models.

    From the intermediarys perspective, marketingscience models represent an opportunity to bridgethe gap between academics and practitioners. Robertset al. (2009) use the term marketing science valuechain, including the key role of marketing scienceintermediaries in diffusing new technology andmethodology throughout marketing. They cite twoarticlesby Guadagni and Little (1983) and Greenand Srinivasan (1990)as exemplifying high aca-demic and high managerial impact, and they showthe key role intermediaries played in generating thatmanagerial impact. These intermediaries, each withdifferent business models and incentives, includeinfrastructure vendors (e.g., IBM SPSS), boutiquevendors of model solutions (e.g., Management Deci-sion Systems (MDS), MarketShare), large generalistfirms (e.g., Boston Consulting Group, McKinsey),implementation-oriented firms (e.g., Accenture),accounting firms (e.g., Deloitte), and market researchsuppliers (e.g., Nielsen). As our analysis of the PracticePrize finalist projects will show, these intermediariesare often central to the effective development and

    implementation of marketing science models andmethods.

    3. Characteristics of theFinalist Projects

    Table 1 includes details about projects financial andorganizational impact as well as the transportability(and methodological novelty) of the finalists. Mostof the finalists report substantial levels of economic

    benefits from the projects, with an average reportedprofit increase of 64%, revenue increase of 44%, shareincrease of 24%, and cost savings of 44%. The other

    benefits vary significantly in size and type. ZS Asso-ciates reports completing more than 1,500 projects(with 100% implantation) for more than 500 compa-nies in 39 countries, with revenue increases of 2% to7%, leading to more than $5 billion in incrementalsales. Rhenania reports a system that saved the com-

    pany, moved its position in the industry from num-ber five to number two, and significantly increasedits active customer base. AS Marketing International(ASMI), in addition to increasing profit by 70% withno decrease in sales, reports a major increase in intan-gible assets/brand value.

    In Table 2, we classify these projects along twodimensions: the level and nature of marketing deci-sions and the type of methodologies adopted to makethose decisions, while noting marketing problem typeand industry.

    Analysis of the information summarized in Tables 1and 2 shows that the finalist projects cover appli-

    cations ranging from positioning/product/brandmanagement (36%) to customer relationship manage-ment (16%). The methodologies include regressionmodels (36%), choice models (36%), and optimiza-tion (32%). The projects span industries, includingconsumer packaged goods (20%), consumer durables(12%), retailing (12%), telecommunications (8%), andB2B equipment (8%). The organizational benefitsinclude profit increase (64%), revenue generation(44%), and cost savings (44%), among numerous other

    benefits. In addition, the projects represent a mix oflarge (40%) and small (60%) firms. The main gapsin the coverage of the finalist projects include digital

    marketing applications (problem type), game theoret-ical analysis (method), and B2B services (industry).

    To investigate the genesis, implementation details,and impact of these projects, including reasons fortheir continued adoption or disadoption by the orga-nization, we administered a survey and interviewedkey project members from each team, consistent withBell et al. (2002). (See Web Appendix 1, availableat http://dx.doi.org/10.1287/mksc.1120.0756, for thecover letter, questionnaire, and interview protocol.)In each case, one author conducted the interview

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    9/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 237

    Table 2 Project Portfolio: Marketing Issue vs. Analytical Method and Breakout by Characteristics

    Marketing issue/decision (Strategic Tactical)a

    Response Branding Customer SalesAnalytical to new products/ Category relationship force/ method entry Positioning Forecasting NPD portfolio mgmt. Pricing Advertising Channels direct Promotion

    Mapping/ Prudentialmultidimensional (B2CS)scaling tele.ring

    (B2CS)

    Regression Prudential PepsiCo Allstate Hokey bauMax Futuredontics P&G bauMaxmodel (B2CS) (Fmcg) (B2CS) Pokey (Fmcg) (B2BS) Asia- (Fmcg)

    (Fmcg) P&G PepsiCo Pacific CVSAsia- (Fmcg) (Fmcg) (retailing)

    Pacific PepsiCo(Fmcg) (Fmcg)PepsiCo(Fmcg)

    Choice model Telstra Jetstar Campbell IBM-CLV NAP Jetstar Inofec J.D. Power(B2CS) (B2CS) Soup (B2BS) (B2BD) (B2CS) (durables) DSSIP

    Company Hokey Pokey Allstate (B2CD)(Fmcg) (Fmcg)

    Stochastic Clickthroughprocess (various)

    Diffusion Telstra Whirlpoolmodel (B2CS) (Durables)

    Optimization/ ASMI Finnair/IBM Bayer J.D. Power Rhenaniamath (Fmcg) (B2CS) (pharma) ODAV (retailing)programming SoQuero (B2BD) Campbellmodel (durables) Soup

    Company(Fmcg)

    ZS Associates(various)

    Note. B2CS, business-to-consumer service; B2BD, business-to-business durables; B2BS, business-to-business services; Fmcg, fast-moving consumer goods;

    NPD, new product development.

    (averaging 4560 minutes, though one interviewinvolved two one-hour sessions).2 The interviewswere recorded and transcribed and provide the datafor much of our qualitative analysis and discussion.

    Question 11 of the questionnaire (see WebAppendix 1) comprises items with closed-endedanswers to characterize and classify the projects. Theitems and the summary statistics of the question-naire responses appear in Figure 1. Interestingly, theaverage Practice Prize organization was not analyti-cally strong, used few if any marketing-mix optimiza-

    tion models, and had no recognized reward structurefor those who introduced marketing science models.In contrast, most projects required a strong internaladvocate to succeed.

    An exploratory factor analysis on the items, usingprincipal components analysis with varimax rotation,revealed a three-factor solution, according to both

    2 Two of the authors have been finalists for the award. Each wasinterviewed by a different author. All the authors of this articlehave served as judges in the competition.

    the scree plot and interpretability criteria (each fac-tor explains at least 10% of the variance based oneigenvalues and scree plot, and each factor is inter-pretable in terms of the items that load highest onit). Three factors emerged from the analysisnamely,the degree of (1) (client) analytic resources, (2) strate-

    gic leverage gained by client from analysis, and (3) advo-cacy of analytics within the client.3 If we plot finalistsscores on the first and second factors, for example(see Figure 2), we find that some organizations arefar more advanced than others in their analytic capa-

    bilities, whereas others derive more strategic lever-age. (Note that operational leverage can also leadto large financial impact.) Based on these scores,we divide firms into four quadrants. We call firmswith high analytic skills and high strategic leverage(e.g., Allstate, P&G) analytic leveragers, those withhigh analytic skills but low strategic leverage (e.g.,CVS, NAP) operationally focused, those with highstrategic leverage but low analytic skills (e.g., Hokey

    3 Factor loadings are provided in Web Appendix 4.

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    10/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications238 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    Figure 1 Summary of Characteristics of ISMS-MSI Practice Prize Finalist Projects

    0

    0.5

    1.0

    1.5

    2.0

    2.5

    3.0

    3.5

    4.0

    4.5

    5.0

    Mean Std. dev.

    Companya

    dvocate

    Unexploite

    dvalue

    CEOessential

    Comm

    unicati

    ontools

    Analytic

    rewards

    Analytich

    ighlight

    Quantitativesupporte

    xpected

    Adoptearly

    Analytic

    skills

    Market-response

    models

    Mixoptim

    ization

    Useful

    insigh

    ts

    Satisfycu

    stomers

    Improve

    profits

    State-of-artIT

    ITadvantage

    Notes. Based on responses to the following questionnaire statements (scale: 1=strongly disagree, 2=disagree, 3=neither agree/disagree, 4=agree, 5=stronglyagree):

    1. This project would never have gotten off the ground without a strong advocate within the firm. (Company advocate)2. While the project was impactful, I feel that there was a lot of value in the study left unexploited. (Unexploited value)3. Top management support (at the CEO level) was essential to the success of this project. (CEO essential)4. The key to the realization of the benefits was having a series of communications tools with which to diffuse the insights throughout the organization.

    (Communication tools)5. The firm has a recognized reward structure for those who contribute to its analytical capabilities. (Analytic rewards)6. The firms annual reports and other publications highlight the use of analytics as a core competitive advantage. (Analytic highlight)7. The firms senior management expects quantitative analysis to support important marketing decisions. (Quantitative support expected)8. The firm adopts new modeling and data analysis approaches soon after they become available. (Adopt early)9. The firm has mastery of many different quantitative marketing analysis tools and techniques. (Analytic skills)

    10. The firm has market response models in place for most of its major products. (Market-response models)11. The firm has marketing-mix optimization models in place for most of its major products. (Mix optimization)12. The firm has found that the insights it obtains from marketing analytics are almost always very useful. (Useful insights)13. The firm generally feels confident that the use of marketing analytics improves its ability to satisfy its customers. (Satisfy customers)14. The firm feels that if it reduces its marketing analytics act ivities, its profits will suffer. (Improve profits)15. The firm has a state-of-the-art IT infrastructure. (State-of-art IT)16. The firm uses IT to gain a competitive advantage. (IT advantage)

    Pokey, SoQuero) outsourcers (of marketing sciencemodels), and those that score low on both strategi-cal leverage and analytic capabilities (e.g., bauMax,Bayer) greenfield enterprises (concerning market-

    ing science).To investigate internal differences across applica-

    tions, we cluster-analyzed finalists and found a three-cluster solution using k-means cluster analysis (seeTable 3).4 Cluster 1 scores very low on the essentialrole of the CEO (relative to Clusters 2 and 3), whereasCluster 3 reveals a low score for use of mix optimiza-

    4 We chose a three-cluster solution based on maximum the Bayesianinformation criterion value, the number of members in each cluster,and interpretability.

    tion and market-response models, relative to Cluster 2 inparticular. These results suggest alternative avenuesto success. A project may have the active engagementof the CEO (Clusters 2 and 3), but if it lacks this

    level of engagement, there must be good penetra-tion of modeling elsewhere, perhaps external to theorganization. Consulting firms such as ZS Associatesand J.D. Power (as well as bauMax and Futuredon-tics) constitute this cluster (Cluster 1). Nor is it nec-essary for an organization to have deeply embeddedmarketing modeling skills, which can be outsourced,as in Cluster 2. But for this strategy to succeed, theCEO must be actively engaged (Bayer, Hokey Pokey,SoQuero, etc.). Finally, in Cluster 3 both drivers are atwork; this cluster has a large proportion of firms that

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    11/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 239

    Figure 2 Positioning of Finalist Projects

    ZS Associates

    PepsiCo

    bauMax

    Futuredontics

    Allstate

    Bayer

    Inofec

    Hokey Pokey

    IBM-CLV

    SoQuero

    ASMI

    Clickthroughtele.ring

    Rhenania

    Finnair/IBM

    Campbell Soup Company

    CVSTelstra

    P&G Asia-Pacific

    NAP

    Jetstar

    Whirlpool

    Prudential

    CLUSTER 1

    CLUSTER 2 CLUSTER 3

    3

    2

    1

    0

    1

    2

    3 2 1 0 1 2

    Strategic

    leverage

    Analytic resources

    Outsourcers Analytic leveragers

    Greenfield enterprises Operationally focused

    J.D. Power DSSIP

    J.D. Power ODAV

    are large and well established, with strong strategicthinking and analytical capabilities (P&G, Whirlpool,Prudential, Jetstar, CVS, IBM-CLV, Finnair/IBM, etc.).Firms embody a good balance of rigor and rele-vance of marketing science models. This cluster alsoincludes a few sophisticated, smaller organizations(e.g., NAP, tele.ring, and Rhenania).

    4. A Framework for theDevelopment and Application ofMarketing Science Models

    We used our review of the relevant literature andthe open-ended sections of the interviews in addi-tion to the quantitative analysis above to develop a

    view of the organizational diffusion of innovationsfor the development and adoption of marketing sci-ence models (see Figure 3). In that framework, eachproject starts with the identification of a marketingdecision problem, either by company executive(s) or

    by academic(s), or by both, followed by commission-ing the project and adoption of a marketing scienceapproach to address it. The project then exerts animpact on the organization, often leading to decisionsto continue the implementation in the same area andtransport it to other areas. Triggers, drivers, barriers,

    and enablers influence progression between the dif-ferent stages of this process. We use this frameworkto identify characteristics common to many PracticePrize finalist projects.

    4.1. Project TriggersProjects start when connections develop betweenmarketing decision makers and marketing scientists.Some projects begin because a new set of execu-tives receives the mandate to effect a major changein the organization. In the Allstate project, the newlyhired chief marketing officer challenged the organi-zation to estimate and demonstrate the value of its

    brand. Tasked with this challenge, the lead executivereached out to an academic because such an approachrequired cutting-edge thinking in that area.

    Some projects start because an academic or inter-mediary develops a new technique and searchesfor an appropriate problem (e.g., ZS Associatesand tele.ring) to which it could add value in thedecision-making process. Other projects start as afollow-up to a student project; the NAP project was anextension of an MBA field study led by the academicsinvolved. Many projects emerge from ongoing rela-tionships between client organizations and academicsor intermediaries (e.g., CVS, IBM-CLV, J.D. PowerDSSIP, Finnair/IBM, Clickthrough, and the Campbell

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    12/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications240 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    Table 3 Cluster Means and Profiles by Project Characteristics and

    Cluster Membership

    Cluster

    1 2 3CEO CEO involved and CEO involved and

    Characteristic independent high analytic skills low analytic skills

    Company advocate 450 480 473Unexploited value 250 290 191CEO essential 275 420 445Communication tools 350 380 418Analytic rewards 158 183 378Analytic highlight 300 150 355Quantitative support 263 380 427

    expectedAdopt early 175 290 373Analytic skills 200 290 336Market-response 325 275 373

    modelsMix optimization 250 220 300Useful insights 300 410 386Satisfy customers 250 430 418Improve profits 200 370 382State-of-art IT 275 320 445IT advantage 200 315 436

    Notes. The figures in the cell are cluster means of project characteristicsmeasured on a scale from 1 to 5 with a higher number indicating a morefavorable score on the project characteristic.

    The numbers in bold represent scores of 4.00 and higher.Cluster 1: ZS Associates, J.D. Power-DSSIP, bauMax, Futuredontics.Cluster 2: PepsiCo, Allstate, J.D. Power ODAV, Bayer, Inofec, Clickthrough,

    Telstra, SoQuero, ASMI, Hokey Pokey.Cluster 3: tele.ring, Rhenania, Campbell Soup Company, Finnair/IBM, CVS,

    IBM-CLV, Whirlpool, NAP, Jetstar, P&G Asia-Pacific, Prudential.

    Soup Company). Yet others evolve from a personalencounter between academics and firm executives

    (e.g., Inofec, PepsiCo, NAP, and Bayer).

    Figure 3 Framework for the Development and Application of AcademicPractitioner Marketing Science Models

    Determinants Analytics orientation

    Rigor vs. relevance

    Implementation results

    Culture

    Training

    Communication

    Commissioning of projectModel development

    and implementation

    Organizational

    impact and learning

    Enablers Prototypes/pilots Top management

    involvement

    Implementation aids Training sessions Constant communication

    Trust building

    Barriers

    Lack of time/involvement Differences in perspective Poor buy-in Insufficient stakeholder

    involvement Data integration and

    action link problems Communication problems Intraorganizational

    conflict

    Continuation and

    transfer

    Identification of marketing

    decision problem

    Triggers

    Practitioner management change

    Academic reach-out to

    practitioner

    Academicpractitioner dialogue

    Limitations of practitioners

    default approach

    Drivers

    Project champion

    Resources

    Role of intermediaries/consultants

    Determinants

    Executive turnover

    Updating

    Transportability

    In a number of cases, academicpractitioner con-nections are mediated by intermediaries. Someemerge through direct intermediary contacts (e.g.,

    bauMax), whereas others evolve in response to a com-mercial request for proposal (e.g., Whirlpool, Jetstar,and Telstra).

    Many projects start when the default approachbecomes unacceptable and firms differ in their pre-dictions about what they would have done with-out the benefit of a marketing science approach.Some (e.g., Allstate, J.D. Power DSSIP, IBM-CLV, andFinnair/IBM) would have carried on with businessas before, whereas others (e.g., Bayer, Telstra, andPepsiCo) indicate that they would have used an off-the-shelf method to address the problem. Still othershad no alternative: there were no options. Rhenanianeeded a new approach to save the company, andWhirlpool would have stopped marketing its productwithout the project.

    4.2. Project DriversWhen a practitionermarketing scientist link has beenestablished, the project still cannot start without somepowerful drivers such as models, statistics, data, andoptimization (Little 1979) as well as key stakeholderengagement. Sometimes, consultants themselves areimportant drivers (e.g., as in ZS Associates, J.D.Power DSSIP, J.D. Power ODAV, Finnair/IBM,Clickthrough, Campbell Soup Company). However,projects by Allstate, Bayer, Whirlpool, NAP, P&GAsia-Pacific, IBM-CLV, Prudential, Inofec, Rhenania,and tele.ring used no outside consultants, and for the

    projects involving CVS, Telstra, Jetstar, and bauMax,

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    13/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 241

    academics partnered with the consultants. Addition-ally, in almost all cases, there was at least one clearinternal project champion.

    4.3. Project BarriersFor firms like Allstate, J.D. Power ODAV, and Bayer,

    the lack of executives time and the need for on-site involvement presented significant barriers. Manyprojects required changes to the culture or men-tal models of relevant executives (e.g., Allstate, J.D.Power ODAV, Whirlpool, NAP, IBM-CLV, P&G Asia-Pacific, Clickthrough, tele.ring, and Inofec). Aca-demics and practitioners differ considerably in termsof the time horizon of their work. Many academicstreat firm projects as they would a traditional researchproject, focusing on rigor and due diligence, withless regard for timeliness. In contrast, practitionersexpect concentrated focus and quick results. Thetime horizon thus became a significant issue in the

    Bayer, PepsiCo, and Telstra projects. Furthermore,different perspectives and social norms character-ize the academic and practitioner communities; insome academic circles, working on practical, appliedresearch projects has negative connotations, whereasin the practitioner community, executives working onprojects involving leading-edge methodology may beviewed as impractical.

    Some projects cannot gain traction without theinvolvement of multiple stakeholders or buy-in fromkey executives in other functional areas (e.g., finance,operations, and IT, in particular). At Allstate, a strate-gic project required the approval and involvement of

    the finance and accounting departments. In the J.D.Power DSSIP project, automobile dealer involvementwas necessary for project success. At ZS Associates,field sales representatives constituted a major, criticalstakeholder community; and at the Campbell SoupCompany, retailers were key to successful outcomes.

    Data collection, integration, and management canalso pose hurdles. At Inofec and bauMax, these issuespresented formidable challenges, and at the CampbellSoup Company the time and cost of ensuring dataavailability were critical. Connecting insights from thedata to marketing actions can also be difficult. Thelack of links in some cases resulted from significantcommunication problems (e.g., such as those for J.D.Power ODAV, ZS Associates, Finnair/IBM, and IBM-CLV), both within the organization and between orga-nization and client. At J.D. Power DSSIP, Telstra, CVS,Clickthrough, and IBM-CLV, barriers between themarketing and sales organizations presented majorhurdles.

    4.4. Project EnablersProject buy-in by key stakeholders requires a strategy,such as a pilot or proof-of-concept exercise (as was

    done for Rhenania and Inofec) or some credible, well-planned set of actions. The Inofec team reported thatwe took them on a journey, whereas Finnair/IBMdid lots of training sessions and made results acces-sible. Top management involvement (observed for

    Jetstar, Prudential, Inofec, Rhenania, Telstra, Allstate,

    and Bayer) and early demonstration of value or a highreturn on investment (observed for Inofec, J.D. PowerDSSIP, IBM-CLV, Pepsi, Rhenania, and Bayer) werecritical enablers. For example, according to J.D. PowerDSSIP: The executive who championed the effortmentioned that with just this one test they [Chrysler]made more than they paid for the project. Other keytactics included practical solutions and applied wis-dom (e.g., observed for ZS Associates), implementa-tion aids such as visualization tools (e.g., tele.ring),Web-based dashboards (e.g., J.D. Power DSSIP and

    Jetstar), training sessions (e.g., Telstra), and .Net andExcel applications (e.g., PepsiCo).

    Cultural immersion also provided a strong facilita-tor at Finnair/IBM, resulting in trust. According to theleader of the Campbell Soup Company project, Thefirm does not need to look under the bonnet. They

    just need to trust the people that do.

    4.5. Short- and Long-Term Impact of theProject on the Organization

    All the projects had significant short-term impactson their respective organizations, but some projectswent further and continue to be used (e.g., Allstate,Rhenania, J.D. Power DSSIP, Bayer, ZS Associates,NAP, Jetstar). However, a few firms terminated their

    projects, for reasons such as an industry slump orexecutive turnover.

    Although all the projects had substantial positiveimpacts, those impacts differed considerably. The Jet-star project enabled the firm to earn profits even amidindustry-wide losses, and the Campbell Soup Com-pany project helped the firm grow sales faster thanits category. P&G Asia-Pacific already enjoyed valuegrowth, but its project offered a new approach tomanaging that growth. At Inofec, the project helpedtransform the company from ad hoc decision mak-ing to highly analytical approaches; at NAP, theproject resulted in an analytical pricing structure in

    a nonprofit organization in place of simplistic, adhoc methods. For J.D. Power ODAV, the project-baseddistribution system enabled the firm to reroute morethan two million vehicles at greater profit. At Allstate,top management and the finance department beganviewing brands as assets and marketing spendingas investments. And the Telstra project provided aframework for management to successfully combat anunknown new entrant prior to its launch.

    Many models had immediate financial impact, suchas the promotion models for J.D. Power, bauMax,

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    14/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications242 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    Clickthrough, and CVS. At J.D. Power DSSIP, theproject contributed to new learning about a menuapproach to automobile promotional strategies. Thepromotion decision support system at bauMax sig-nificantly improved both sales and profits, and theClickthrough project achieved a transformative online

    promotions strategy. The CVS promotional tool appli-cation identified the categories that should not be pro-moted for greater overall profitability.

    With regard to medium- or long-term impact,the sales territory design model developed by ZSAssociates involved cumulative learning from modelinsights and expert judgments from hundreds ofclients over three decades. The Allstate project helpedestablish a strong marketingfinance collaborativeapproach to address strategic issues within the orga-nization. As a result of its implementation of aforecasting model, PepsiCo developed a system thatcombined analytical modeling with practical rele-

    vance for rapid, fact-based decision making. Theapplication of multilevel direct marketing modelingat Rhenania was so successful that it allowed the firmto buy several competitors. The CEO of tele.ring flewto the U.S. with the [perceptual-preference] map in hispocket that enabled him to command a considerablyhigher valuation for the company.

    Some benefits were unexpected. The tele.ringproject introduced a visually oriented, analytic cultureto the firm for its tariff development or pricing deci-sions. At IBM-CLV, a stronger customer-oriented cul-ture took hold in a firm that had been deeply rootedin technology. And the customer lifetime value-based

    optimization model at Finnair/IBM created a newmind-set for managing loyalty programs for the longterm, rather than simply managing promotional cam-paigns with the loyalty database.

    4.6. Organizational Learning from the ProjectSome firms considered directional insights justas important as quantitative guidance. Rhenaniaasserted that management needed to optimize long-term profitability, not customer satisfaction, noting itwent from a culture of less is more (focusing onlyon customers profitable in the short run) to moreis more (including many customers unprofitable in

    the short run but profitable in the long run because itgrew the customer base).

    Some of the applications demonstrate the trade-offbetween rigor and relevance. To quote a Finnair/IBMinformant, It is important to move away from themathematics barrier to innovation It should not

    be a show of technical prowess; it should be muchmore a show of what makes [an application] seemuseful. At J.D. Power ODAV, an informant stated,We were academics; we were not talking their talk.I remember one client who told me, I hear all the

    music but I dont hear the song. And a ZS Asso-ciates executive explained, Most academic work isnot valuable to companies In some cases you opti-mize, but most often you satisfice. We found that ifyou come out of a computer with an alignment fora sales force of 100 people, 85 of them are going to

    want to kill you.

    5

    The extent of organizational learning depends onmany factors: analytics orientation, rigorrelevancetrade-off, implementation results, culture, training,and communication. If the organization is inclined touse results from quantitative analyses of marketingdata, then it is more likely to implement marketingscience models faster and wider across the organiza-tion (Germann et al. 2012). Companies focusing onthe suitability of the marketing model to their con-text tend to adopt faster and realize immediate gains.Moreover, initial positive results drive the pace andscope of further adoption. Furthermore, firms steeped

    in a data-driven tradition with strong internal dissem-ination of analytical insights are better positioned toimprove their decision-making capabilities.

    4.7. Determinants of Project Continuation andTransfer

    When a project has been implemented successfully,there are substantial challenges to sustain momentum.At bauMax, after the key executives left, project adop-tion slowed and eventually stopped. At PepsiCo, thedriving executives were recruited away by other orga-nizations. Although their successors wanted the aca-demic authors to continue the project, those executives

    also expected the authors to participate in running thebusiness, slowing the penetration of the work withinthe firm. In the Campbell Soup Company project, themodel needed continuous updating, requiring a tran-sition from the development team. These types of sto-ries recurred in many organizations, suggesting that,even after initial project success, without a plan forongoing management and transportability (like at ZSAssociates, which reports nearly 100% client reten-tion), success will likely be short term. Additionally,not all problems are recurrent.

    5. Conclusions and RecommendationsEffective marketing science applications as repre-sented by the finalists in the ISMS-MSI Practice Prizecompetition span a wide range of managerial prob-lems and use an extensive set of marketing sci-ence techniques. We view that finding as very goodnews for the marketing science profession. There isno one successful approach, though, as our applica-tion framework in Figure 3 indicates, there are many

    5 We provide a rich collection of additional comments and quotesfrom the interviews in Web Appendix 2.

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    15/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 243

    pathways by which a project can add value to itsclient organization. The marketing scientists whomwe interviewed reported great personal and profes-sional satisfaction with the work while also acknowl-edging the challenges involved.

    These 25 projects (and the other entrants that did

    not become finalists) are showpieces of the marketingscience profession, demonstrating the practical valueof some of our most important developments. Theyrepresent fruitful (and remarkably effective) partner-ships between marketing scientists and practicingmanagers. But the upside potential for such part-nerships and applications remains largely unfulfilled.For example, seven academics were involved withat least two finalists and one academic (V. Kumar)had a hand in four, including the 20112012 winner.When compared with the more than 1,100 marketingscientists who attended the 2012 ISMS conference, itwould seem that the group of academics represented

    in the competition should be more diverse. We sketchsome lessons from this review and the literature thatprecedes it so that such collaborations occur moreregularly and provide more value for the academics,practitioners, and intermediaries involved.

    5.1. Implications/Lessons for AcademicsMarketing is an applied profession. If its practiceis important, then the lessons from projects suchas those described in this paper suggest that someweight should be given to impact on practice inthe tenure and promotion process, alongside the tra-

    ditional dimensions of research, teaching, and ser-vice. Such an incentive would encourage academicsto work with the intermediaries who implement thelatest marketing models. The Practice Prize competi-tion and publication of finalists papers in MarketingScience represent a step in that direction.

    A key limitation for many marketing academicsis data. One way to obtain data is to consult withfirms for the use of data in publications. Although thefirm enjoys cost-effective consulting, the payoff foracademic is strongly differentiated, top-quality, high-impact publications. Academics should be preparedto overcome additional challenges relating to navigat-

    ing confidential data through suitable nondisclosureagreements, turnover of personnel, and issues of dataquality.

    We should also consider a version of the med-ical school model, in which both faculty and stu-dents (i.e., MBA and Ph.D. students in marketing)engage in ongoing work that involves real problemsin real organizations. Schools of education do some-thing similar by opening their own primary schools.Although there are ethical issues involved in lettingstudents treat medical patients, we can develop our

    methods and skills by serving corporate patientseven as we continue writing articles.6

    We offer six recommendations for academics (forfurther discussion, see Roberts 2010): (1) place someweight on impact in our promotion and tenureprocess, at least for promotion to full professor;

    (2) encourage leaves and sabbaticals for practicework, especially with intermediaries; (3) add intern-ships to doctoral programs; (4) encourage lettersfrom nonacademic referees in promotion and tenuredossiers; (5) consult in return for data and prob-lem access (rather than just for money); and (6) con-sider some form of the medical or education schoolmodel that integrates practice into both research andeducation.

    To elaborate on the second recommendation, theneed for academics to remove themselves from theconfines of the university and immerse themselves inthe problems of practitioners has never been greater.

    Marketing managers today are confronted by newchallenges, including harnessing big data, leverag-ing social and digital media, and maximizing brandand customer assets. These challenges call for originalsolutions from informed, leading-edge academics.

    5.2. Implications/Lessons for PractitionersPractitioners are the ultimate consumers of market-ing models: if they do not comprehend the poten-tial benefit of academic developments (directly orthrough intermediaries), then why should practition-ers bother? If an academicintermediary partnershipsucceeds, it creates higher visibility of the potential

    and benefits of marketing models, a prerequisite foradoption and use.Nor will practitioners generally use models whose

    approaches they do not understand (if not the detailthey contain). Managers have an ongoing need foreducation, which should encompass both just-in-case education (e.g., as in MBA and executive MBAprograms, which give managers concepts and tools)and just-in-time education, such that knowledge ofavailable and appropriate models is communicated tothe manager as business problems arise.

    As recommendations for practitioners, we thuspropose the following: (1) engage academics in just-

    in-time education to learn marketing concepts andmodels in the context of their own problems; (2)document and communicate both short- and long-term (and soft and hard) benefits of such interac-tions; (3) take marketing analytics courses which linkmethodology, insight, and decision making; (4) docu-ment model and MDSS failures, as well as successes,

    6 For an example of how such an arrangement can work, seehttp://www.informs.org/Connect-with-People/Speakers-Program/Search-for-a-Speaker/Search-by-Location/West-U.S./Woolsey-Gene-Colorado-School-of-Mines.

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    16/17

    Lilien, Roberts, and Shankar: Effective Marketing Science Applications244 Marketing Science 32(2), pp. 229245, 2013 INFORMS

    to enable future success that addresses those failures;and (5) experiment with marketing models. Somemay fail. But as Hogarth (1987, p. 199) notes, Whendriving at night with your headlights on, you do notnecessarily see too well. However, turning your head-lights off will not improve the situation.

    5.3. Implications/Lessons for IntermediariesIntermediaries can provide fertile ground for the dif-fusion of marketing science tools because they arein business to make money, and methodology pro-vides one of the major bases with which they can dif-ferentiate themselves. But if academics partner withthem, copresent with them at conferences, and coau-thor papers with them, intermediaries can generatethe reputational capital that makes clients listen moreclosely to them when they describe the benefits ofleading-edge models and methods. We recognize atleast two barriers: (1) intermediaries find little incen-

    tive to write for academic journals, and (2) they oftenfear the loss of intellectual property through suchdisclosures.

    Academics can answer the first barrier throughcoauthorships facilitated by internships and industrysabbaticals. Intermediaries that share their methodol-ogy rarely lose business to rivals; rather, they tendto increase the size of the overall market. When Silkand Urban (1978) published their work on Assessor,they helped legitimize the market for pretest marketmodels; the intermediary MDS reaped the benefits.

    Of the vast amount of data that intermediariescollect, some are of little commercial value after

    they go out of date, yet they often retain signif-icant academic value. Proactively publicizing theavailability of such data for academic purposesmight motivate high-quality research. The availabil-ity of the PIMS (Profit Impact of Market Strat-egy) database to academics, offered by the StrategicPlanning Institute (see http://www.pimsonline.com/about_pims_db.htm) spawned considerable research(e.g., Boulding and Staelin 1990), and IRI hasdone something similar with its data set initia-tive through ISMS (http://www.informs.org/Pubs/mktsci/Online-Databases).

    Thus, for intermediaries we recommend the fol-

    lowing: (1) recognize the possibility of breakthroughwork that could lead to new lines of business,achieved by working with academics; (2) leverage thepublicity and social currency of copublishing withacademics; (3) seek appropriate academic partnersat both academic conferences (i.e., many academics,few appropriate partners) and industry conferences(attending academics are likely attractive partners);(4) offer internships to faculty and Ph.D. students; and(5) seek creative business relationships with businessschools (e.g., research/consulting blends).

    George Box (1979, p. 202) pointed out, All modelsare wrong, but some are useful. The quest for use-ful marketing models, while far from easy, can pro-vide significant rewards to both the individuals andthe organizations involved. But both need the courageand determination to begin the journey. The aca-

    demics, practitioners, and intermediaries representedin the Practice Prize competition have demonstratedthat courage and determination and have provided amodel that others can follow. We hope these pioneerssee even more company in the future.

    Electronic CompanionAn electronic companion to this paper is available aspart of the online version at http://dx.doi.org/10.1287/mksc.1120.0756.

    References

    Ailawadi KL, Harlam BA, Csar J, Trounce D (2007) Quantifyingand improving promotion effectiveness at CVS. Marketing Sci.26(4):566575.

    Albers S (2012) Optimizable and implementable aggregate responsemodeling for marketing decision support. Internat. J. Res. Mar-keting 29(2):111122.

    Bell PC, Anderson CK, Kaiser SP (2002) Strategic operationsresearch and the Edelman Prize finalist applications 19891998.Oper. Res. 51(1):1731.

    Boulding W, Staelin R (1990) Environment, market share and mar-ket power. Management Sci. 36(10):11601177.

    Box GEP (1979) Robustness in the strategy of scientific model build-ing. Launer RL, Wilkinson GN, eds. Robustness in Statistics(Academic Press, New York), 200210.

    Danaher P, Roberts JH, Simpson A, Roberts K (2011) Applying adynamic model of consumer choice to guide brand develop-ment at Jetstar Airways. Marketing Sci. 30(4):586594.

    Divakar S, Ratchford BT, Shankar V (2005) CHAN4CAST: A mul-tichannel, multiregion sales forecasting model and decisionsupport system for consumer packaged goods. Marketing Sci.24(3):334350.

    Du J, Xie L, Schroeder S (2009) PIN optimal distribution of auctionvehicles system: Applying price forecasting, elasticity estima-tion, and genetic algorithms to used-vehicle distribution. Mar-keting Sci. 28(4):637644.

    Elsner R, Krafft M, Huchzermeier A (2004) Optimizing Rhenaniasdirect marketing business through dynamic multilevel model-ing (DMLM) in a multicatalog-brand environment. MarketingSci. 23(2):192206.

    Fischer M, Albers S, Wagner N, Frie M (2011) Dynamic marketingbudget allocation across countries, products, and marketing

    activities. Marketing Sci. 30(4):568585.Foster JA, Golder PN, Tellis GJ (2004) Predicting sales takeoff for

    Whirlpools new Personal Valet. Marketing Sci. 23(2):182185.

    Germann F, Lilien GL, Rangaswamy A (2013) Performance impli-cations of deploying marketing analytics. Internat. J. Res. Mar-keting. Forthcoming.

    Green PE, Srinivasan V (1990) Conjoint analysis in marketing:New developments with implications for research and practice.

    J. Marketing 54(4):319.

    Guadagni PM, Little JDC (1983) A logit model of brand choice cal-ibrated on scanner data. Marketing Sci. 2(3):203238.

    Hogarth RM (1987) Judgment and Choice: The Psychology of Decision,2nd ed. (John Wiley & Sons, Oxford, UK).

  • 7/27/2019 Practice Prize Impact Mktg Science (1)

    17/17

    Lilien, Roberts, and Shankar: Effective Marketing Science ApplicationsMarketing Science 32(2), pp. 229245, 2013 INFORMS 245

    Kannan PK, Pope BK, Jain S (2009) Pricing digital content prod-uct lines: A model and application for the National AcademiesPress. Marketing Sci. 28(4):620638.

    Kitts B, Vrieze M, Freed D (2005) The right product forthe right person: Product recommendation from infrequentevents at Clickthrough. MIT TechTV video, 35:56. Posted

    June 16, 2010. http://techtv.mit.edu/collections/isms:1135/videos/7475-clickthrough.

    Kumar V, Shah D (2011) Uncovering implicit consumer needs fordetermining explicit product positioning: Growing PrudentialAnnuities variable annuity sales. Marketing Sci. 30(4):595603.

    Kumar V, Bhaskaran V, Mirchandani R, Shah M (2013) Creatinga measurable social media marketing strategy: Increasing thevalue and ROI of tangibles and intangibles for Hokey Pokey.

    Marketing Sci. 32(2):194212.

    Kumar V, Fan J, Gulati R, Venkat P (2009) Marketing-mix rec-ommendations to manage value growth at P&G Asia-Pacific.

    Marketing Sci. 28(4):645655.

    Kumar V, Venkatesan R, Bohling T, Beckmann D (2008) The powerof CLV: Managing customer lifetime value at IBM. MarketingSci. 27(4):585599.

    Leeflang PS, Wittink DR (2000) Building models for marketingdecisions: Past, present, and future. Internat. J. Res. Marketing

    17(2/3):105126.Lilien GL (2011) Bridging the academic-practitioner divide in mar-

    keting decision models. J. Marketing 75(4):196210.

    Little JD (1970) Models and managers: The concept of a decisioncalculus. Management Sci. 16(8):B-466B-486.

    Little JDC (1979) Decision support systems for marketing man-agers. J. Marketing 43(3):926.

    Little JD (2004) Comments on Models and managers: The conceptof a decision calculus. Management Sci. 50(12):18411861.

    Lodish LM (2001) Building marketing models that make money.Interfaces 31(3, Supplement):S45S55.

    Natter M, Mild A, Wagner U, Taudes A (2008) Planning new tar-iffs at tele.ring: The application and impact of an integratedsegmentation, targeting, and positioning tool. Marketing Sci.27(4):600609.

    Natter M, Reutterer T, Mild A, Taudes A (2007) An assortmentwidedecision-support system for dynamic pricing and promotionplanning in DIY retailing. Marketing Sci. 26(4):576583.

    Reda S (2002) Despite early positive results, retailers haventjumped on analytics bandwagon. Stores 85(3):34.

    Roberts JH (2000) The intersection of modeling potential and prac-tice. Internat. J. Res. Marketing 17(23):127134.

    Roberts JH (2010) Has research in marketing lost its way?Australasian Marketing J. 18(3):161164.

    Roberts JH, Kayande U, Stremersch S (2009) From academicresearch to marketing practice: Exploring the marketingscience value chain. Working paper, Australian NationalUniversity, Canberra, ACT, Australia.

    Roberts JH, Morrison PD, Nelson CJ (2004) Implementing aprelaunch diffusion model: Measurement and managementchallenges of the Telstra switching study. Marketing Sci.23(2):186191.

    Rogers EM (2003) Diffusion of Innovations, 5th ed. (Free Press,New York).

    Shankar V, Azar P, Fuller M (2008) BRAN EQT: A multicategorybrand equity model and its application at Allstate. MarketingSci. 27(4):567584.

    Silk AJ, Urban GL (1978) Pre-test-market evaluation of new pack-aged goods: A model and measurement methodology. J. Mar-keting Res. 15(2):171191.

    Silva-Risso J, Ionova I (2008) A nested logit model of product andtransaction-type choice for planning automakers pricing andpromotions. Marketing Sci. 27(4):545566.

    Sinha A, Saghal A, Mathur SK (2013) Category Optimizer:A dynamic-assortment, new-product-introduction, mix-optimization, and demand-planning system. Marketing Sci.32(2):221228.

    Sinha A, Inman JJ, Wang Y, Park J (2005) Attribute drivers: A fac-tor analytic choice map approach for understanding choicesamong SKUs. Marketing Sci. 24(3):351359.

    Skiera B, Abou Nabout N (2013) PROSAD: A bidding decisionsupport system for profit optimizing search engine marketing.

    Marketing Sci. 32(2):213220.

    Sullivan L (2005) Fine-tuned pricing. Inform. Week(August 15) http://www.informationweek.com/fine-tuned-pricing/168601052.

    Tellis GJ, Chandy RK, MacInnis DJ, Thaivanich P (2005) Mod-eling the microeffects of television advertising: Which adworks, when, where, for how long, and why? Marketing Sci.24(3):359366.

    Tirenni G, Labbi A, Berrospi C, Elisseeff A, Bhose T, Pauro K,Pyhnen S (2007) Customer equity and lifetime management(CELM) Finnair case study. Marketing Sci. 26(4):553565.

    Wierenga B, Van Bruggen GH (1997) The integration of marketingproblem-solving modes and marketing management supportsystems. J. Marketing 61(3):2137.

    Wierenga B, Van Bruggen GH (2000) Marketing Management SupportSystems: Principles, Tools and Implementation (Kluwer AcademicPublishers, Boston).

    Wierenga B, Van Bruggen GH, Staelin R (1999) The successof marketing management support systems. Marketing Sci.18(3):196207.

    Wiesel T, Pauwels K, Arts J (2011) Marketings profit impact: Quan-tifying online and off-line funnel progression. Marketing Sci.30(4):604611.

    Winer RS (2000) Comments on Leeflang and Wittink. Internat. J. Res.Marketing 17(23):141145.

    Zoltners AA, Sinha P (2005) Sales territory design: Thirty years ofmodeling and implementation. Marketing Sci. 24(3):313331.