Price dynamics and quality in information markets

Price dynamics and quality in information markets

Decision Support Systems 28 Ž2000. 35–47 www.elsevier.comrlocaterdsw Price dynamics and quality in information markets Jakka Sairamesh, Jeffrey O. Ke...

711KB Sizes 1 Downloads 166 Views

Decision Support Systems 28 Ž2000. 35–47 www.elsevier.comrlocaterdsw

Price dynamics and quality in information markets Jakka Sairamesh, Jeffrey O. Kephart ) IBM T.J. Watson Research Center, Hawthorne, NY 10532, USA

Abstract We explore the price dynamics of a vertically differentiated market in which two or more sellers compete to provide an information good or service to a population of buyers. Each seller offers the good or service at a fixed level of ‘‘quality’’, and attempts to set its price in such a way that it maximizes its own profit. Five different seller pricing strategies, ranging widely from ones that require perfect knowledge and unlimited computational power to ones that require very little knowledge or computational capability, are employed in two different buyer populations. The resulting collective dynamics are studied using a combination of analysis and simulation. In a population of quality-sensitive buyers, all pricing strategies lead to a price equilibrium predicted by a game-theoretic analysis. However, in a population of price-sensitive buyers, most pricing strategies lead to large-amplitude cyclical price wars. The circumstances under which cyclical price wars occur can be explained in terms of the topology of an underlying ‘‘profit landscape’’ wJ.O. Kephart, J.E. Hanson, J. Sairamesh, Price and niche wars in a free-market economy of software agents, Artificial Life Journal, 4Ž1., 1998, 1–23x. q 2000 Elsevier Science B.V. All rights reserved. Keywords: Price dynamics; Information market; Product quality

1. Introduction In the coming years, the explosive growth in electronic commerce can be expected to continue, fueled in large part by increasing automation. Much of this automation will be cast in the form of autonomous software agents. Matchmaking and advertising agents will help people and other agents to find customers or suppliers. Agents will help negotiate prices, product parameters, and terms of contracts, and then carry out the transactions. Agents will encapsulate data-mining and other technologies that allow various forms of transaction post) Corresponding author. Tel.: q1-914-784-7370; fax: q1-914784-6054. E-mail address: [email protected] ŽJ.O. Kephart..

processing, enabling better-targeted advertising, for example. We envision a world a decade or two hence in which billions of software agents will act as economic players in their own right, exchanging information goods and services with humans and with other agents w4,6,7x. It is quite conceivable that the inclusion of large numbers of software agents as economic players will have a strong effect upon the global economy, giving rise to collective phenomena that are rare or even unknown in today’s economy. We believe this because software agents differ from human agents in a number of economically relevant ways. They are capable of making decisions of orders of magnitude faster than humans make, and can potentially base those decisions on greater volumes of much fresher information. Within limited domains, they are, in

0167-9236r00r$ - see front matter q 2000 Elsevier Science B.V. All rights reserved. PII: S 0 1 6 7 - 9 2 3 6 Ž 9 9 . 0 0 0 7 3 - 1

36

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

some cases, more capable than humans. In general, however, they are considerably less intelligent and flexible. Our previous work on an economy of information-filtering agents has shown that these differences, coupled with the reduced friction that one expects to find in agent-based information economies, can engender rampant price wars in which sellers’ prices undergo periodic oscillations that can be harmful to sellers and buyers alike w4,6,7x. Another important distinguishing feature of software economic agents is that they are fundamentally more consistent and understandable in their individual behavior than their human counterparts. Understanding and modeling the decision-making behavior of individual humans is notoriously difficult. Mathematical utility functions are often used to model human choices, but this can only be taken to be a rough approximation. In contrast, the behavior of a software agent is codified completely in the form of a computer program. Thus, models of software agents can be regarded as proposals for, rather than mere approximate descriptions of, the behavior of boundedly rational individuals. This permits a different research emphasis. Rather than measuring our success in terms of our ability to understand individual and societal behavior, our goal is to design an agent economy that will work well from the perspective of the individual agents that participate in it. Our study of the collective dynamics of large number of economic software agents w4–7x is not an end in itself; it is motivated by the hope that we can derive principles that will help us design effective agent strategies, interaction protocols, and market mechanisms w9x. The information-filtering economy that we have studied previously is an example of a horizontally differentiated w15x market: an article that is worthless to one consumer may be priceless to another. However, in a broad information economy of the sort we envision, there will also be a number of markets in which information goods and services are Õertically differentiated, i.e., there is near-universal agreement among consumers of what constitutes higher or lower quality. For example, a population of human or softwareagent consumers of network services will have diverse requirements, and network providers will jockey for position in the market by offering a

variety of tradeoffs between price and quality of service ŽQoS.. Note that, in general, quality may be a multi-dimensional concept w1,2,14,15x. An agent representing a multimedia application might require a transmission rate of 1.5–3.0 Mbrs in order to support compressed real-time video ŽMPEG-II or JPEG.. Additionally, it might require a maximum packet-loss probability of 1% and a maximum packet delay of 20 ms in order to support a minimum guaranteed viewing quality. Suppose that a given provider can meet these basic requirements for a certain fee. The multimedia agent might still prefer to patronize a higher-priced supplier that offers a higher transmission rate, a lower packet-loss probability, or a smaller packet delay. The degree to which it is willing to pay for extra quality in any of these three dimensions depends on how that extra quality will translate into improvements in the quality of the service that the multimedia agent can offer to its customers, and how much more it could charge for this improved service. As the demands placed on the multimedia agent may vary from one moment to the next, so in turn will the demands that it makes upon the network service providers. A network services market will be expected to offer multiple services at multiple rates, with low costs and latencies for switching from one service type to another. Market mechanisms capable of supporting these requirements are a topic of active research w8,10x. As a second example, consider a market in which information brokers compete to provide information-filtering services. As has been discussed, the varied preferences among users for different categories of information induce horizontal differentiation. However, there may be several vertical dimensions as well. Different brokers could offer different response times. One broker could, by using a faster processor or a much clever algorithm, implement a more sophisticated and accurate filtering algorithm than another. Numerous works in the economics literature treat various aspects of the behavior of horizontally and vertically differentiated markets w1–3,11–13,15,16x. In Ref. w1x, price and quality equilibria are discussed under specific oligopolistic settings. This paper differs from these previous works in that it presents a comparative study of non-equilibrium price dynamics resulting from a wide range of different individ-

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

ual pricing strategies that might be employed by software agents. This paper also differs from our own previous work in that it considers a vertically — rather than a horizontally — differentiated market. We are particularly interested in determining whether vertically differentiated markets are vulnerable to the same pathological, cyclical price wars that we have observed previously in a horizontally differentiated market, in which seller agents offer filtered streams of news articles to buyer agents w4,6x. After presenting the model in Section 2, we shall find in Sections 3 and 4 that, under some circumstances, the model does exhibit cyclical price wars. In Section 5, we discuss the mechanisms that underlie these dynamics, and conclude that, just as in our previous work, much can be attributed to the topology of the sellers’ profit landscapes. Finally, we summarize our findings and point out directions for future work in Section 6.

2. Model The model, illustrated in Fig. 1, consists of S sellers and B buyers. Each seller offers a single product or service Žhenceforth referred to generically as a unit.. The unit may have a number of different attributes, each with several discrete possible values, or a continuous range of possible values. However, we shall make the simplifying assumption that the preferences of the buyers are correlated in such a way that there exists a universally agreed-upon mapping that transforms a unit’s set of attributes and

37

values, however complex this may be, into a simple scalar quality. 1 Through some mechanism Žsuch as a bulletin board., all buyers are informed about the price Ps and quality Q s of units offered by each seller s. The qualities Q s may be reported by the sellers Žassumed to be honest., or alternatively they could be measured or derived and then reported by an independent, trusted third party. For simplicity, we assume that time is discrete. ŽThis is not an essential aspect of the model.. At any given moment t, each buyer purchases a unit from at most one of the sellers — either the one it perceives to be the best choice given its understanding of the prices and qualities, or none if no seller’s offer is sufficiently attractive. Note that a buyer’s understanding of the prices and qualities may be imperfect and delayed because it may not have the resources or ability to continuously monitor them. We model a buyer’s decision-making process as ˆ follows. Each buyer b has a utility function u b Ž P, Qˆ ., which is a single-valued function of the perceived price Pˆ and perceived quality Qˆ of a prospective supplier. The buyer b will select the single ˆ Qˆ . is maximized, so long as seller s for which u b Ž P, that maximal utility is positive, and purchase a unit at the actual price Ps . If the maximal utility is zero or negative, the buyer does not purchase a unit from any seller. In this paper, we will take the utility functions to have the simple form u b s Ž g b Ž q y qb . q Ž 1 y g b . Ž p b y p . . =Q Ž p b y p . Q Ž q y qb .

Ž 1.

where p b is the buyer’s price ceiling Žthe maximum price it is willing to pay., qb is its quality floor Žthe minimum quality it is willing to accept., g b is a parameter in the range w0,1x, and Q Ž x . represents the step function: 1 for x ) 0 and 0 otherwise. A buyer

Fig. 1. Vertically differentiated market economy of software agents.

1 For example, Consumer Reports and other such agencies often evaluate several aspects of a product, and perform a Žusually linear. weighting of these factors to obtain an overall numerical rating for the product. We are considering a case where the entire population only pays attention to the overall rating.

38

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

with g b s 0 is at the extreme limit of price sensitivity: it will choose the seller with the lowest price, just so long as its quality is no less than the quality floor qb . A buyer with g b s 1 is at the extreme limit of quality sensitivity: it will choose the seller with the highest quality, just so long as its price is no more than the price ceiling p b . For a given set of assumptions about how the estimated prices and qualities Pˆs and Qˆ s are obtained from the actual values Ps and Q s , a buyer b can be characterized completely by its set of three parameters Ž p b , qb , g b .. The sellers are somewhat more complex in behavior. At time t, several events may occur. Firstly, at most one randomly selected seller is given the opportunity to revise and publicize its price Ps andror quality Q s . There is no cost for doing so. Then, each buyer is given the opportunity to receive and make use of this updated information Žif it wishes. to revise its choice of seller. Finally, each seller receives Ps from each buyer that has selected it, and pays a cost cŽ Q s . Žassumed to increase monotonically with Q s . to produce this good and deliver it to the buyer. When a seller has the opportunity to modify its price andror quality, its decision is based upon an attempt to maximize its own profit. Various assumptions may be made about the nature and accuracy of information available to the seller, as well as its computational capability. In this paper we will consider the following five strategies that cover a broad range of assumptions. Ø A game-theoretic strategy can be used in the limit of perfect knowledge about the entire market, including all buyers and sellers and their strategies, and unlimited computational capability. Ø A myoptimal, or ‘‘myopically optimal’’ strategy requires virtually unlimited computational capability and full information about the consumer population’s desires and the prices and qualities of competitors. However, the strategies of the competitors are unknown, and the myoptimal seller simply assumes that the status quo will be maintained Ži.e., the other sellers will not change their parameters before the seller has another opportunity to reset its parameters.. The myoptimal seller performs an exhaustive search over all of the parameters over which it has control. For each potential setting of parame-

ters, it computes the expected profit per unit time under the assumption that no other sellers change their parameters. It chooses the parameter setting that yields the highest expected profit. Ø A computationally limited myoptimal strategy, which is like the myoptimal strategy except that the computational capabilities are weaker: an exhaustive search of all possible new parameter settings is replaced with a tighter search in the neighborhood of the current parameter set, with a few random forays further afield. From this smaller set of candidate parameter settings, the one yielding the highest expected profit is chosen. Ø A trial-and-error strategy, in the extreme limit where sellers have no knowledge of one another and no knowledge of the consumer population. In the trial-and-error approach, new prices are generated randomly and tried out for a short period. If profits are found to improve after the adoption of a new price, that price is retained. Otherwise, the previous price is reinstated. Ø A deriÕatiÕe-following strategy, in the extreme limit where sellers have no knowledge of one another and no knowledge of the consumer population. A derivative follower simply experiments with its parameters, continuing to change them in the same direction until the observed profitability is reduced, at which point the direction of change is reversed. For example, consider the case in which the derivative follower adjusts its price only. Then the new price at time t can be expressed in terms of the prices and average profits per unit time at earlier times tX and tY via: pt s ptX q d sign Ž p tX y p tY . sign Ž ptX y ptY .

Ž 2.

where p tX and p tY represent the average profits made during the time intervals Ž tX , t . and Ž tY , tX ., respectively. The price increment d is chosen from a uniform distribution between 0 and a small positive value. Experimentation has shown that randomizing d can be very advantageous, as it greatly reduces the likelihood of getting caught in small depressions in the profit landscape that arise in systems of finite size. There are numerous questions that one might ask about the collective behavior that arises in such a

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

model under various assumptions about the consumer population, including the accuracy of the buyers’ estimates of current prices and qualities, the joint distribution of consumer parameter sets Ž p, q, g ., the sellers’ parameter update strategies, etc. Can a reasonable, stable equilibrium set of prices be reached under conditions of information delay and uncertainty? Are there reasonable price-adjustment or quality-adjustment strategies for sellers to pursue, even when they have imperfect, incomplete information andror limited computational capabilities? If an equilibrium is reached, how favorable is it for the various sellers and buyers in the system? This work addresses only a subset of these questions. We restrict ourselves to the study of two consumer populations generated by widely different consumer parameter distributions. First, we study a population of buyers that are quality sensitiÕe, i.e., each buyer seeks the highest quality seller whose price does not exceed that buyer’s budget. The second population of buyers is price sensitiÕe, i.e., each buyer seeks the cheapest seller that meets that buyer’s minimum quality requirement. For each of these populations, we perform five experiments. In each experiment, we assume that each seller adopts a given one of the five price adjustment algorithms outlined above, and we observe the resulting price dynamics.

39

maximization strategies employed by the sellers. Without loss of generality, we can order the sellers such that s s 1 is the seller with the highest quality, s s 2 is the seller with second-highest quality, etc. Then seller 1 will attract all buyers for which P1 F p b F 1, and in general Žtaking P0 s 1. seller s will attract all buyers for which Ps F p b F Psy1. Thus, the profit for seller s will be

P s s Ž Ps y c s . Ž Psy1 y Ps .

Ž 3.

provided that Ps ) c s and Ps - PsX for all sX - s. ŽIf the first condition were not satisfied, then seller s would lose money on each sale because it would be charging less than the marginal cost. If the second condition were not satisfied, P s s 0 because s would be undersold by a higher-quality seller.. First, suppose that the sellers behave game-theoretically. Seller s s 1 is free to set its price at will because any buyer that is willing to pay its price P1 Ži.e., p b ) P1 . will prefer it, since no other seller offers higher quality. Taking the derivative of Eq. 3 with respect to P1 and setting equal to zero easily yields the conclusion that the optimal price P1U s 1r2Ž1 q c1 .. Once s s 1 has set its price, s s 2 can determine its price using the same technique, and so on. In general, we find that PsU s 1r2Ž Psy1 q c s ., U or PsU s 1r2Ž Psy1 q c s .. Recursive substitution yields a simple closed-form expression:

3. Price dynamics for quality-sensitive buyers

s

PsU s 2ys q Assume that each buyer b has g b s 1 and qb s 0; that is, it is extremely quality-sensitive, seeking the highest-quality seller for which the price does not exceed p b . Assume that the number of buyers B `, and that p b is distributed uniformly in the inverval Ž0,1.. Furthermore, assume that every buyer has access to perfect, completely up-to-date information about the sellers’ prices and qualities. Finally, assume that each seller s’s quality Q s is immutable, so that the sellers are only free to set their prices. This allows the cost for seller s to be abbreviated as a fixed constant c s ' cŽ Q s .. Now we can compare the behavior of the system under several different assumptions about the profit-



Ý 2yj c sq1yj

Ž 4.

js1

The same analysis holds for myoptimal sellers. The highest quality seller is completely unaffected by the prices charged by its competitors. It can act as though it is the only seller in the market, compute its optimal price, and ignore the rest of the sellers because none can compete on quality. Once s s 1 has established its price, the seller with the second highest quality concedes the premium buyers to s s 1, and acts as the highest quality seller in the remaining market, and so on recursively, resulting in exactly the same equilibrium prices as are given in Eq. 4.

40

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

Fig. 2. Simulation of five myoptimal sellers. All buyers are quality-sensitive.

As an example, we now examine the behavior of a system with five sellers with fixed qualities Q1 s 1.0, Q2 s 0.9, Q3 s 0.5, Q 4 s 0.35, and Q5 s 0.25. The cost of producing a unit of quality Q is taken to be a simple linear function: cŽ Q . s 0.1 q 0.1Q. If the five sellers behave in a game-theoretic manner and the number of buyers is infinite, then the resultant prices can be computed from Eq. 4: P1 s 0.600, P2 s 0.395, P3 s 0.273, P4 s 0.204, and P5 s 0.164. Now suppose that the sellers use the myoptimal strategy. In other words, when it is a seller’s turn to re-evaluate its price, it does an exhaustive search over all possible candidate prices as follows. For each candidate price, it uses its knowledge of its competitors prices and qualities and its knowledge of the individual parameters of each of the buyers to compute the expected profit for that candidate price. ŽEquivalently, an oracle could perform this computation on the seller’s behalf.. It chooses the candidate price that maximizes its expected price, assuming that no competitor will alter its price in response. Fig. 2 illustrates a typical simulation run for a population of five myoptimal sellers and 1000 buyers. After just a few time steps, the simulated system reaches an equilibrium in which the prices are very close to the game-theoretic values: P1 s 0.627157, P2 s 0.392506, P3 s 0.266399, P4 s 0.189862, and P5 s 0.165150. The small discrepancies can be attributed to the fact that the number of buyers in the simulated system is finite rather than infinite. Computationally limited myoptimal sellers have access to the same unlimited information that myop-

timals do, but are more limited in computational capability. They differ from myoptimals only in that they do not perform an exhaustive search over all possible prices. Instead, they randomly generate a small set of candidate prices, use their perfect knowledge of all competitors and individual buyers Žor an oracle. to compute the expected profit for each candidate price, and select the best price. In our implementation, computationally limited myoptimals consider the current price and 10 other randomly generated candidate prices. With probability 0.9, the candidate prices are generated from a Gaussian distribution with standard deviation 0.02 centered about the current price. With probability 0.1, the proposed price is chosen from a uniform distribution in the interval Ž0,1.. A typical simulation run is illustrated in Fig. 3. After 5000 time steps, the equilibrium prices were Ž0.627156, 0.384965, 0.252813, 0.189860, 0.163891. — again, reasonably close to the game-theoretic values. It is useful to consider the opposite extreme, in which sellers are uninformed about their competitors and the buyer population. In this case, the sellers must use some sort of trial and error, perhaps coupled with memory andror learning. One extremely simple approach is to use the trial-and-error strategy: when it is time to re-evaluate price, with a small small-jumping probability Ž0.05., generate a new price by adding a small random increment drawn from a zero-mean Gaussian distribution with a small standard deviation Ž0.02.. Even less frequently, with some very small big-jumping probability Ž0.001.,

Fig. 3. Simulation of five computationally limited myoptimal sellers. All buyers are quality-sensitive.

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

generate a new price by drawing it from a uniform distribution in the interval Ž0,1.. If the price has just undergone a small or big jump, the profit that accrues until the next opportunity for a price adjustment is measured. The profit per unit time is compared to what it was prior to the jump. If it is higher, then the new price is retained. If it is not, then the price reverts to what it was before. A typical simulation run is shown in Fig. 4. Again, the prices tend towards an approximate equilibrium, although it is impossible for them to settle completely due to the nature of the algorithm. Averaging over the last 1000 time steps, the approximate equilibrium price vector was Ž0.6271, 0.3889, 0.2518, 0.1849, 0.1434., which is fairly close to the computed game-theoretic equilibrium. A second algorithm that can be used in situations where sellers have no direct knowledge of competitors or buyers is the derivative-following algorithm. A derivative follower starts by measuring its profitability and then perturbing its price up or down by a random amount. If, when the seller next reevaluates its price, it finds that the profit per unit time has increased, it will modify the price in the same direction as before; otherwise, it will reverse the direction of the price change. We have found it helpful to use a random step size; this avoids entrapment at ‘‘false’’ local maxima in the profit curve that exist in systems with a finite number of buyers. A typical simulation run with step size chosen uniformly between 0 and 0.02 is shown in Fig. 5. An

Fig. 4. Simulation of five sellers, each of which employs the trial-and-error pricing policy. All buyers are quality-sensitive.

41

Fig. 5. Simulation of five derivative-following sellers. All buyers are quality-sensitive.

average over the last 1000 time steps yields a price vector Ž0.6292, 0.4028, 0.2689, 0.2050, 0.1701., which is again fairly close to the computed gametheoretic value.

4. Price dynamics for price-sensitive buyers Now consider the opposite extreme, in which the buyers are completely price sensitive: provided that a certain minimal quality level qb is met, b seeks the least expensive seller. This limit is obtained by setting g b s 0 for all b. We shall again assume that p b is distributed uniformly in the interval Ž0,1.. We make the further assumption that the price ceiling and quality floor are perfectly correlated: buyers that require high quality are more tolerant of paying a higher price for that quality. This can be achieved Žfor example. by setting qb s p b . Just as we did for quality sensitive buyers, we assume that every buyer has access to perfect, completely up-to-date information about the sellers’ prices and qualities, and that each seller s’s quality Q s is immutable, so that the sellers are only free to set their prices. As before, we first compute the game-theoretic prices, and then examine the collective behavior of the system when all sellers employ the price-updating algorithms described previously. Again, we can, without loss of generality, order the sellers such that s s 1 is the seller with the highest quality, s s 2 is

42

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

Fig. 6. Simulation of five myoptimal sellers in a cyclic price war. All buyers are price-sensitive.

the seller with second-highest quality, etc. Then, as computed in the Appendix, PjU s max Q jq1 , Ž Q j q c j . r2 .

Ž 5.

Evaluating this numerically for the set of five sellers studied in the previous section, we find that the game-theoretic price vector Ž P1 , P2 , P3 , P4 , P5 . s Ž0.9, 0.545, 0.35, 0.25, 0.1875.. Fig. 6 shows the results of a typical simulation run of this system in the case where all five sellers are myoptimal. All parameters are identical to those used in the simulation represented in Fig. 2, except for the buyer parameters, which are exactly as described in the first paragraph of the current section. In contrast to what was found in Section 3, the system of myoptimal sellers does not reach the game-theoretic equilibrium price — in fact, it fails spectacularly to reach any equilibrium at all. The system regularly passes through a price vector that is extremely close to the game-theoretic value: Ž P1 , P2 , P3 , P4 , P5 . s Ž0.900, 0.523, 0.350, 0.252, 0.185. at times t s 565 q 560n, where n s 0, 1, 2, . . . However, on the next time step, the highest quality seller s s 1 realizes that it can make more profit by dropping its price from 0.900 to 0.523, the price currently charged by s s 2. Although its margin drops from 0.7 per unit to 0.323 per unit Žthe production cost is cŽ Q1 s 1. s 0.2., it steals the market formerly held by s s 2, resulting in an increase in sales volume from 0.1 B to 0.477B. However, this gain is shortlived because s s 2 immediately retaliates by settings its price just slightly below that of s s 1. Now

s s 1 is reduced back to its market share of 0.1 B, and is making much less per unit than it was at the original price of 0.900. Thus s s 1 retaliates by matching s s 2’s lowered price. The war between s s 1 and s s 2 continues, with the other three sellers staying at fixed prices that are essentially equal to the game-theoretic values. Eventually, the two warring sellers suddenly find it worthwhile to horn in on s s 3’s market. The top three sellers continue in a three-way price war, until the price becomes so depressed that s s 1 finally opts out and sets its price back up to 0.900. Once this price pressure is off, the other sellers all set their prices up to their game-theoretic values, but as soon as this occurs then s s 1 is tempted to instigate a new price war. A simulation of computationally limited myoptimal sellers, shown in Fig. 7, displays very similar behavior. The price wars are somewhat faster than in the pure myoptimal case, because, while the sellers easily find that undercutting is Žmyopically. favorable, they usually undercut by more than is absolutely necessary. There is some additional jitter introduced into the price-war period because s s 1 and the other higher-quality sellers may take a little longer than pure myoptimals to realize that they should opt out of a price war. As shown in Fig. 8, derivative followers quickly gravitate towards the game-theoretic prices, and do not engage in price-war behavior. During the interval from time 10,000 to time 50,000, the average prices are measured to be Ž0.89556, 0.53141, 0.35784, 0.25377, 0.18556., and tend to stay within approximately 0.03 of these values.

Fig. 7. Simulation of five computationally limited myoptimal sellers in a series of price wars. All buyers are price-sensitive.

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

Fig. 8. Simulation of five derivative followers that reach price equilibrium, computed via game theory. All buyers are price-sensitive.

43

Fig. 9. Simulation of five sellers employing trial-and-error pricing strategy. All buyers are price-sensitive.

when an incredibly simplistic pricing strategy is used. It might be tempting to conclude at this point that myoptimal and nearly myoptimal sellers are too clever for their own good, and that the individual ignorance of the derivative followers is responsible for overall societal bliss Žat least on the part of the sellers, not necessarily the consumers!. However, this is wrong on at least two counts. First, even if individual ignorance could be shown to lead to good societal behavior, this would not necessarily be a useful result because in an open, massively distributed agent economy we are very unlikely to be able to legislate an agent’s degree of intelligence. In other experiments, we have found that a single myoptimal agent introduced into a society of derivative followers can take tremendous advantage of its fellow agents. Thus, there is every incentive to create an intelligent agent rather than a stupid one. Second, it is untrue that simplistic strategies lead to stable behavior, as we are about to see. Fig. 9 illustrates a typical simulation run with five sellers employing the trial-and-error pricing strategy. Despite a large amount of jitter due to the sellers’ continual random explorations, two longer-scale trends are evident: roughly metastable periods, during which the prices are roughly equal to the gametheoretic values, and price-war episodes Žsee in particular the period between time 32,500 through time 40,000.. This example shows that price wars are not an artifact of having an unrealistic amount of knowledge and computational power; they can occur even

5. Topology and dynamics In Section 3, all of the pricing strategies converged towards the game-theoretic equilibrium price vector, regardless of their sophistication or naivete. In Section 4, we only made a few changes to the buyers, and found that large-amplitude price wars were possible unless the sellers were derivative followers, in which case the game-theoretic analysis held. How can this behavior be explained? As has been discussed in w4,6,7x, the profit landscape is a useful construct for understanding price-

Fig. 10. Profit landscape for seller 1 in two-seller market with quality-sensitive buyers. The sellers’ qualities are Q1 s1.0, Q2 s 0.9.

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

44

war dynamics. A seller’s profit landscape is its expected profit as a function of all of the sellers’ prices Žand any other parameters they may control., assuming that buyers can react instantly to any changes in the sellers’ parameters. Cyclical price wars are possible when profit landscapes contain multiple peaks and sharp cliffs. A typical pair of profit landscapes for a two-seller system with a population of buyers as defined in Section 3 is illustrated in Figs. 10 and 11. Analysis confirms that, for buyers of this type, profit landscapes are quite generally single-peaked and devoid of cliffs. For the buyer population defined in Section 4, the landscapes have the following analytic form for two sellers:

P 1 Ž P1 , P2 .

°Ž Q y P . Ž P y c . ~ s ¢Ž Q y Q . Ž P y c . 1

1

1

1

1

2

1

1

if 0 F P1 F P2 or if P1 ) Q 2 if P2 - P1 - Q2

Ž 6. P 2 Ž P1 , P2 . s

½

Ž Q 2 y P2 . Ž P2 y c 2 . 0

if 0 F P2 - P1 . if P2 G P1

Ž 7.

Fig. 12 shows an example of the profit landscape for seller 1, given Q1 s 1.0, Q 2 s 0.9. Note the sharp

Fig. 12. Seller market segments. Quality and price boundaries are indicated by solid lines, and labeled on the left and right sides of the figure, respectively. Seller prices are indicated by dashed lines, and are labeled inside the rectangle representing each segment.

cliff at P1 s P2 and the two peaks, features that were shown to give rise to price wars in Ref. w5x. To see how this gives rise to a price war, we can introduce the function P1U Ž P2 ., the value of P1 that optimizes P Ž P1 , P2 ., for each possible P2 , and the analogous function P2U Ž P1 .. These functions can be expressed analytically as:

P1U Ž P2 .

°

if 0 F P2 - Q1 y Q2 q c1 1 if Q1 y Q2 q c1 F P2 F Ž Q1 q c1 . 2 1 if P2 ) Ž Q1 q c1 . 2

Q2

~P

s

2

1

¢Ž 2

Q1 q c1 .

Ž 8.

P2U Ž P1 .

°c

0 F P1 F c 2

2

~P y e

s

if c 2 F P1 F

1

1

Fig. 11. Profit landscape for seller 2 in two-seller market with quality-sensitive buyers. The sellers’ qualities are Q1 s1.0, Q2 s 0.9.

¢2 Ž Q q c . 2

2

if P1 )

1 2

1 2

Ž Q2 q c2 .

.

Ž Q2 q c2 . Ž 9.

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

A simple graphical construction involving these two functions yields the price dynamics, starting from any initial price vector Ž P1 , P2 ., as illustrated in Fig. 13. Now we are in a position to understand the dynamical behavior observed in Sections 3 and 4. In Section 3, the profit landscape only contained one peak, and no cliffs. Any reasonably decent pricing strategy should eventually find its way to the top of this peak, although the rates at which they do vary considerably, from instant, in the case of the myopic sellers, to very slowly for the trial-and-error strategists. In Section 4, the five-dimensional profit landscape is multi-peaked and full of cliffs. The derivative-following algorithm only does a local search. Therefore, once it finds its way to the top of a peak, it can only jitter around on the top of that peak, and has no way to find other peaks. In our case, the derivative followers found their way to the gametheoretic peak. In fact, there is a more optimal peak Žin the myopic sense. for seller s s 1, but in order to discover it the seller would have to make a large discontinuous jump. All of the other pricing strategies, including the very naive trial-and-error strategy, permits large jumps. Although the trial-and-error strategy only permits large jumps on rare occasions, eventually a large random jump will take the system from the game-theoretic peak to a location somewhere near a more Žmyopically. optimal one, triggering a price war.

Fig. 13. Profit landscape for seller 1 in two-seller market with price-sensitive buyers. The sellers’ qualities are Q1 s1.0, Q2 s 0.9.

45

6. Conclusions In this paper, we investigated the dynamical behavior of a market consisting of simple automated sellers and buyers of a vertically differentiated product or service. We introduced a simple family of buyer utility functions that allowed for tradeoffs between price and quality, and studied two different populations of such buyers. The first population was extremely sensitive to quality, while the second was extremely sensitive to price. For each of these populations, we explored the dynamic collective behavior resulting when the sellers employed five different price-setting strategies ranging widely from perfect knowledge and unlimited computational power to almost zero knowledge and capability. For the quality-sensitive buyer population, all pricing strategies eventually led to the same price equilibrium. However, for the price-sensitive population, we found that most pricing strategies led to large-amplitude cyclical price wars. It is possible to explain these price war dynamics Žand their absence in the case of the derivative-following strategy. as resulting from the underlying topology of the profit landscape, a concept that was introduced in earlier papers w4,7,6x. Preliminary explorations indicate that multipeaked landscapes and price-war dynamics can occur in cases more general than were reported here. We have observed these phenomena in hybrid populations of buyers with 0 - g b s 1, and in which qb and p b are not strictly correlated. In these cases, the nature of the price war is slightly different: a seller offering a higher quality can ‘‘undercut’’ a lowerquality seller even by offering its product at a higher price. Price wars consist of general downward trends in the sellers’ prices, with what appear to be roughly constant non-zero gaps between the prices. Another fruitful avenue for further research is to explore the effect of inhomogeneous pricing strategies. In preliminary work along these lines, we have watched a single myoptimal take advantage of four derivative followers. Finally, we expect the dynamics to get considerably more interesting when we permit sellers to vary their quality and their price simultaneously in an effort to maximize their profit. Similar work has been done in horizontally differentiated markets w1,3x,

46

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

but very little has been done in understanding the price and quality equilibria in vertically differentiated markets. Previous work on an information filtering model w4–7x has revealed the existence of very complex price and niche wars, in which the sellers in the economy all attempt to grab the same niche at the same price, leaving a large segment of the buyer population unsatisfied. It will be interesting to see whether sellers in a vertically differentiated market will attempt to fight over some perceived optimal quality level or quality setting, leaving other quality levels abandoned. Work is currently being done in looking at supplier price and quality strategies in a market of M sellers, where each seller could either have the same cost function Žproduction function. or they could have different cost functions.

Appendix A. Computation of the price-sensitive equilibrium We compute here the game-theoretic equilibrium price vector in the case where the buyers are all purely price sensitive. Let the S sellers be ordered in the following fashion: Q1 ) Q2 ) Q 3 ) . . . ) Q S , where Q1 G qmax . We assume that the cost to produce a unit of quality Q is given by c j s C Ž Q j ., which is a monotonically increasing function of quality. In addition, we assume that there is a monotonic functional relationship p b s f Ž qb .between a buyer b’s price ceiling p b and its quality floor qb Ži.e., these parameters are perfectly correlated.. First, note that, if all sellers act selfishly in their best interests, then the components of the equilibrium price vector, if it exists, will be ordered in just the same way as the qualities: P1U ) P2U ) P3U . . . ) PSU . This can be seen from the following argument. Suppose the prices are not so ordered. Then there exist at least two sellers i and j for whom Q j ) Q i but PjU F PiU , i.e., a higher quality seller is undercutting a lower quality seller in price. If this were to happen, the lower quality seller would sell nothing because any consumer would gladly pay a lower price to obtain a higher quality item. In such a situation, the lower quality seller could increase its

Fig. 14. Graphical construction of price war for two myopic sellers, Q1 s1.0, Q2 s 0.9.

profit from zero to some positive value by undercutting its higher-quality competitor.2 Thus, the supposed equilibrium would not be an equilibrium at all! By contradiction, we can conclude that any equilibrium must satisfy the above price ordering. Due to the correlated orderings of seller quality and price, the market undergoes a natural segmentation, such that all buyers within a given segment j will either be served by seller j Žif j’s price is acceptable., or will opt out of the market entirely. As shown in Fig. 14, market segment j consists of all buyers b for whom Q jq1 - qb - Q j . This can be understood as follows. For a buyer with a quality floor in this range, seller j is the lowest quality seller that meets the quality requirements, and since the sellers’ prices and qualities have the same rank ordering, seller j is also the lowest-priced seller that meets the buyer’s requirements. The boundaries of market segment j can also be expressed on a price scale by using the assumed functional relationship between a buyer’s price ceiling and quality floor. As indicated at the right-hand side of Fig. 14, the lower price boundary of the segment j is defined as Pˆj '

2 Note that the lower-quality seller can always prevail over the higher-quality seller in a price war, because it can always reduce the price to just below its opponent’s cost per unit, since its production costs are lower according to the assumed monotonic increase of production cost with quality.

J. Sairamesh, J.O. Kephartr Decision Support Systems 28 (2000) 35–47

f Ž Q jq1 ., and the upper price boundary is Pˆjy1 ' f Ž Q j .. Now we are prepared to compute seller j’s optimal price PjU . First, note that the optimal price must lie in the range Pˆj F PjU F Pˆjy1. By setting its price at the lower boundary, seller j will capture all buyers within its segment, so there is no benefit to setting the price lower than this. If it sets its price at, or above the upper boundary, it will capture none of the buyers in its segment. Note that if the production cost c j exceeds the upper price boundary Pˆjy1 , then seller j cannot make a positive profit under any circumstances, and it will opt out of the market. In what follows, we shall assume that the production costs are not so high as to prevent any of the sellers from entering the market. In order to compute an exact value for PjU , we make the simplifying assumption that the quality floor and price ceiling parameters of the buyer population are distributed uniformly between ranges w qmin , qmax x and w pmin , pmax x, respectively. Then seller j’s profit as a function of its price Pj is simply proportional to:

Ž Pj y c j . ž Pˆjy1 y Pj / .

Ž 10 .

This quadratic function of Pj is maximized at the value Ž1r2.Ž Pˆjy1 q c j .. If this price is between the lower and upper boundaries, then it will be the optimal price for seller j. However, if the maximum of the quadratic fails to occur within these boundaries, then the true maximum within the segment must occur at one of the price boundaries. In fact, the lower boundary Pˆj is the only option, because at the upper boundary the number of buyers served Žand therefore the profit. is zero. A little thought shows that these two cases can be expressed as a single equation: PjU s max Pˆj , Pˆjy1 q c j r2

ž

/

Ž 11 .

which holds for j s 1,2, . . . ,S, provided that we introduce a fictitious seller S q 1 with quality QSq 1 s 0. In Section 4, we set pmin s qmin s 0 and pmax s qmax s 1. In this case, the function f that associates

47

buyers’ price ceilings and quality floors is just the identity, and Pˆj s Q jq1. Thus, we obtain: PjU s max Q jq1 , Ž Q j q c j . r2

Ž 12 .

References w1x Simon P. Anderson, Andre de Palma, J.F. Thisse, Discrete Choice Theory of Product Differentiation, MIT Press, Cambridge, MA. w2x J.J. Gabszewicz, A. Shaked, J. Sutton, J.F. Thisse, Segmenting the market: the monopolist’s optimal product mix, Journal of Economic Theory 39 Ž1986. 273–289. w3x J.J. Gabszewicz, J.F. Thisse, Price competition, quality, and income disparities, Journal of Economic Theory 20 Ž1979. 340–359. w4x J. Kephart et al., Dynamics of an information filtering economy, in: Proceedings of CIA ’98, Paris,1998. w5x J.O. Kephart, J.E. Hanson, Spontaneous specialization in a free-market economy of agents, in: Proceedings of the Artificial Societies and Computational Markets workshop at Agents 98, MinneapolisrSt. Paul,1998. w6x J.O. Kephart, J.E. Hanson, J. Sairamesh, Price and niche wars in a free-market economy of software agents, Artificial Life Journal 4 Ž1. Ž1998. 1–23. w7x J.O. Kephart, J.E. Hanson, J. Sairamesh, Price-war dynamics in a free-market economy of software agents, in: Proceedings of Artificial Life VI, UCLA, MIT Press, 1998. w8x J.K. Mackie-Mason, H.R. Varian, Pricing the internet, in: Second International Conference on Telecommunication Systems Modelling and Analysis, Nashville, TN, 1994, pp. 378–393, March. w9x J. Rosenschein, G. Zlotkin, Rules of Encounter, MIT Press, Cambridge, MA, 1994. w10x J. Sairamesh, D. Ferguson and Y. Yemini, An approach to pricing, optimal allocation and quality of service provisioning in high speed packet networks, Proceedings of the INFOCOM’95. w11x A. Shaked, J. Sutton, Relaxing price competition through product differentiation, Review of Economic Studies Ž1982. 3–23. w12x A. Shaked, J. Sutton, Natural oligopolies, Econometrica 51 Ž5. Ž1983. September. w13x A. Shaked, J. Sutton, Multiproduct firms and market structure, RAND Journal of Economics 21 Ž1. Ž1990. Spring. w14x O. Shy, Industrial Organization: Theory and Applications, MIT Press, Cambridge, MA, 1996. w15x J. Tirole, The Theory of Industrial Organization, MIT Press, Cambridge, MA, 1995. w16x H. Varian, Differential pricing and efficiency, First Monday Journal Ž1998. .