E-Sim Optimal Equipment Selection - Revision history

Zhua00 at 14:51, 18 January 2015

2015-01-18T14:51:11Z

Zhua00: /* Results */

2015-01-15T12:52:45Z

‎Results

Zhua00: /* Conclusion */

2015-01-14T22:38:51Z

‎Conclusion

Zhua00: /* Results */

2015-01-14T22:34:33Z

‎Results

Zhua00: /* Results */

2015-01-14T22:26:21Z

‎Results

Zhua00: /* Results */

2015-01-14T22:10:06Z

‎Results

Show changes

Zhua00: /* Model */

2015-01-14T22:02:02Z

‎Model

Zhua00: /* Results */

2015-01-14T21:32:05Z

‎Results

Show changes

Zhua00 at 20:23, 14 January 2015

2015-01-14T20:23:52Z

Zhua00: /* Method */

2015-01-14T14:18:08Z

‎Method

← Older revision		Revision as of 14:51, 18 January 2015
Line 1:		Line 1:
		+	*'''Project name''': E-Sim Optimal Equipment Selection
		+	*'''Class''': 4IT495 Simulation of Systems (WS 2014/2015)
		+	*'''Author''': Andriy Zhubryd
		+	*'''Model type''': Monte-Carlo Simulation
		+	*'''Software used:''' Microsoft Excel
		+
	=Introduction=		=Introduction=
	[http://www.e-sim.org E-Sim] is free strategic world simulation. It uses the Earth, real-life countries with their current borders as the strategic map. Player can become a citizen of any country available and take an active part in its development. Currently, 58 countries are available in 2 servers ‘primera’ and ‘secura’. New countries are introduced to the game as soon as the significant number of its real-life citizens start playing the game. Czech Republic is represented in the ‘primera’ server only and, unfortunately, is completely conquered by Poland. Slovakia is more lucky – it’s represented only on ‘secura’ server and is currently successfully occupying Austria and Germany. Also, there’s special server ‘suna’ where only Africa is represented and all players are citizens of African countries. Few days ago new server ‘oriental’ was open – Far East countries only. Each country uses their native currency, but also unified currency ‘gold’ is used in the game.		[http://www.e-sim.org E-Sim] is free strategic world simulation. It uses the Earth, real-life countries with their current borders as the strategic map. Player can become a citizen of any country available and take an active part in its development. Currently, 58 countries are available in 2 servers ‘primera’ and ‘secura’. New countries are introduced to the game as soon as the significant number of its real-life citizens start playing the game. Czech Republic is represented in the ‘primera’ server only and, unfortunately, is completely conquered by Poland. Slovakia is more lucky – it’s represented only on ‘secura’ server and is currently successfully occupying Austria and Germany. Also, there’s special server ‘suna’ where only Africa is represented and all players are citizens of African countries. Few days ago new server ‘oriental’ was open – Far East countries only. Each country uses their native currency, but also unified currency ‘gold’ is used in the game.

@@ Line 581: / Line 581: @@
 |- style='text-align: center'
 | style='background: #FFFFFF' | Increase damage
-| style='background: #83E6ED' | 5,00%
+| style='background: #EDE683' | 5,00%
-| style='background: #84E9F7' | 4,80%
+| style='background: #F7E984' | 4,80%
-| style='background: #84EBFF' | 4,50%
+| style='background: #FFEB84' | 4,50%
-| style='background: #82E5FE' | 4,30%
+| style='background: #FEE582' | 4,30%
-| style='background: #81E0FE' | 4,20%
+| style='background: #FEE081' | 4,20%
-| style='background: #81DBFE' | 4,00%
+| style='background: #FEDB81' | 4,00%
-| style='background: #80D7FD' | 3,80%
+| style='background: #FDD780' | 3,80%
 |- style='text-align: center'
 | style='background: #FFFFFF' | Increase max damage
-| style='background: #81DAC4' | 6,00%
+| style='background: #C4DA81' | 6,00%
-| style='background: #82DED2' | 5,70%
+| style='background: #D2DE82' | 5,70%
-| style='background: #83E2DE' | 5,40%
+| style='background: #DEE283' | 5,40%
-| style='background: #83E5E9' | 5,10%
+| style='background: #E9E583' | 5,10%
-| style='background: #84E8F3' | 4,80%
+| style='background: #F3E884' | 4,80%
-| style='background: #84EBFD' | 4,60%
+| style='background: #FDEB84' | 4,60%
-| style='background: #83E7FE' | 4,40%
+| style='background: #FEE783' | 4,40%
 |- style='text-align: center'
 | style='background: #FFFFFF' | Miss
 | style='background: #7DC67D' | 7,70%
-| style='background: #81D9BF' | 6,10%
+| style='background: #BFD981' | 6,10%
-| style='background: #6B69F8' | 0,00%
+| style='background: #FFFFFF' | 0,00%
-| style='background: #6B69F8' | 0,00%
+| style='background: #FFFFFF' | 0,00%
-| style='background: #6B69F8' | 0,00%
+| style='background: #FFFFFF' | 0,00%
-| style='background: #6B69F8' | 0,00%
+| style='background: #FFFFFF' | 0,00%
-| style='background: #6B69F8' | 0,00%
+| style='background: #FFFFFF' | 0,00%
 |- style='text-align: center'
 | style='background: #FFFFFF' | Critical
-| style='background: #83E8FE' | 4,40%
+| style='background: #FEE883' | 4,40%
-| style='background: #82E2FE' | 4,30%
+| style='background: #FEE282' | 4,30%
-| style='background: #81DDFE' | 4,10%
+| style='background: #FEDD81' | 4,10%
-| style='background: #80D9FE' | 3,90%
+| style='background: #FED980' | 3,90%
-| style='background: #7FD4FD' | 3,80%
+| style='background: #FDD47F' | 3,80%
-| style='background: #7FD1FD' | 3,60%
+| style='background: #FDD17F' | 3,60%
-| style='background: #7ECDFD' | 3,50%
+| style='background: #FDCD7E' | 3,50%
 |- style='text-align: center'
 | style='background: #FFFFFF' | Avoid
-| style='background: #82DFD6' | 5,60%
+| style='background: #D6DF82' | 5,60%
-| style='background: #81DCC8' | 5,90%
+| style='background: #C8DC81' | 5,90%
-| style='background: #80D7B9' | 6,30%
+| style='background: #B9D780' | 6,30%
-| style='background: #7FD2A8' | 6,70%
+| style='background: #A8D27F' | 6,70%
-| style='background: #7ECD95' | 7,10%
+| style='background: #95CD7E' | 7,10%
-| style='background: #7DC67E' | 7,70%
+| style='background: #7EC67D' | 7,70%
-| style='background: #7BBE63' | 8,30%
+| style='background: #63BE7B' | 8,30%
 |}

← Older revision		Revision as of 22:38, 14 January 2015
Line 632:		Line 632:

	=Conclusion=		=Conclusion=
		+
		+	In any simulation, any model or optimization we always omit some aspect, some part of the reality. Here we try to maximize damage, but we neglect the fact that one of the properties increases costs of one-day full fight.
		+
		+	Chance to avoid damage allows player to hit again, but for bonus hits it requires weapons as well. Unfortunately, this ‘expensive’ property turned out to be the most efficient. If we use that strategy, our expenses on weapon will increase by 67%: q1 fight will cost 12-13 gold and q5 – around 40 gold. I showed average salary and prize from ‘Battle Hero’ medal, so you can understand that this is very high price and players tend not to choose avoid property. Moreover, avoid increases time needed to deal the full damage, which slightly decreases the efficiency of your fight.
		+
		+	Practically every player has miss chance covered – it’s intuitive decision, but it turned out to be the most efficient. As players try not to use avoid property, next one in line of the most efficient is increase of maximum damage. And there’s good empirical prove that it’s efficient because players with the most cumulative damage in game have 7-8 appearances of increase of maximum damage property (2 appearances of course go to the reduce miss chance property).
		+	So if we take into account the cost of the fight, our optimal equipment set is the same as in the best soldiers of the game, which means our results are empirically proven. Although this set gives around 90% of damage provided by the avoid set, money and time play important role here.
		+
		+	Overall, we can say that Monte-Carlo simulation was successful and result from it can be used by players when they consider forming their set of equipment.

	=Code=		=Code=

@@ Line 568: / Line 568: @@
 Using this table of marginal utility, we can choose the most efficient equipment set to maximize expected damage.
-{| class='wikitable sortable'
+{| class='wikitable'
 |+ Marginal utility of properties
 |- style='text-align: center'

@@ Line 568: / Line 568: @@
 Using this table of marginal utility, we can choose the most efficient equipment set to maximize expected damage.
-{| class='wikitable'
+{| class='wikitable sortable'
 |+ Marginal utility of properties
 |- style='text-align: center'
@@ Line 580: / Line 580: @@
 ! width='50px' | 7
 |- style='text-align: center'
-| Increase damage
+| style='background: #FFFFFF' | Increase damage
-| 5,00%
+| style='background: #83E6ED' | 5,00%
-| 4,80%
+| style='background: #84E9F7' | 4,80%
-| 4,50%
+| style='background: #84EBFF' | 4,50%
-| 4,30%
+| style='background: #82E5FE' | 4,30%
-| 4,20%
+| style='background: #81E0FE' | 4,20%
-| 4,00%
+| style='background: #81DBFE' | 4,00%
-| 3,80%
+| style='background: #80D7FD' | 3,80%
 |- style='text-align: center'
-| Increase max damage
+| style='background: #FFFFFF' | Increase max damage
-| 6,00%
+| style='background: #81DAC4' | 6,00%
-| 5,70%
+| style='background: #82DED2' | 5,70%
-| 5,40%
+| style='background: #83E2DE' | 5,40%
-| 5,10%
+| style='background: #83E5E9' | 5,10%
-| 4,80%
+| style='background: #84E8F3' | 4,80%
-| 4,60%
+| style='background: #84EBFD' | 4,60%
-| 4,40%
+| style='background: #83E7FE' | 4,40%
 |- style='text-align: center'
-| Miss
+| style='background: #FFFFFF' | Miss
-| 7,70%
+| style='background: #7DC67D' | 7,70%
-| 6,10%
+| style='background: #81D9BF' | 6,10%
-| 0,00%
+| style='background: #6B69F8' | 0,00%
-| 0,00%
+| style='background: #6B69F8' | 0,00%
-| 0,00%
+| style='background: #6B69F8' | 0,00%
-| 0,00%
+| style='background: #6B69F8' | 0,00%
-| 0,00%
+| style='background: #6B69F8' | 0,00%
 |- style='text-align: center'
-| Critical
+| style='background: #FFFFFF' | Critical
-| 4,40%
+| style='background: #83E8FE' | 4,40%
-| 4,30%
+| style='background: #82E2FE' | 4,30%
-| 4,10%
+| style='background: #81DDFE' | 4,10%
-| 3,90%
+| style='background: #80D9FE' | 3,90%
-| 3,80%
+| style='background: #7FD4FD' | 3,80%
-| 3,60%
+| style='background: #7FD1FD' | 3,60%
-| 3,50%
+| style='background: #7ECDFD' | 3,50%
 |- style='text-align: center'
-| Avoid
+| style='background: #FFFFFF' | Avoid
-| 5,60%
+| style='background: #82DFD6' | 5,60%
-| 5,90%
+| style='background: #81DCC8' | 5,90%
-| 6,30%
+| style='background: #80D7B9' | 6,30%
-| 6,70%
+| style='background: #7FD2A8' | 6,70%
-| 7,10%
+| style='background: #7ECD95' | 7,10%
-| 7,70%
+| style='background: #7DC67E' | 7,70%
-| 8,30%
+| style='background: #7BBE63' | 8,30%
 |}

← Older revision		Revision as of 22:02, 14 January 2015
Line 54:		Line 54:
	This algorithm is repeated for every possible equipment set 200 times – simulation of 124 400 one-day full fights.		This algorithm is repeated for every possible equipment set 200 times – simulation of 124 400 one-day full fights.

		+	----
		+
		+	Another way to find the best equipment set is the use of mathematical expected values: means of distributions. Expected damage is calculated as Basic damage, modified with bonuses coefficients:
		+	<math>Expected Damage = Basic Damage \times Miss \times Avoid \times Critical \times Increase Damage \times Increase Max Damage</math>
		+
		+	With equipment sets we can influence all variable except ''Basic Damage''. We should find formulas for calculation of the average value of those variables to optimize the ''Expected Damage'':
		+
		+	<math>Miss = 1-p_{miss}</math>
		+
		+	<math>Critical = 1+p_{crit}</math>
		+
		+	''Avoid'' can be described as the geometric distribution so its average will be the following:
		+
		+	<math>Avoid = {1 \over {1 - p_{avoid}}</math>
		+
		+	Calculations of multiplier for ''Increase Damage'' and ''Increase Max Damage'' show why second property is always more efficient:
		+
		+	<math>Increase Damage = 1 + bonus_{IncDam}</math>
		+
		+	<math>Increase Max Damage = {{0.8 + 1.2 \times (1 + bonus_{IncMaxDam})} \over 2} = 1 + 0.6 \times bonus_{IncMaxDam}</math>
		+
		+	<math>bonus_{IncMaxDam} = 2 \times bonus_{IncDam} \Rightarrow </math>
		+
		+	<math>Increase Max Damage = 1 + 0.6 \times 2 \times bonus_{IncDam} = 1 + 1.2 \times bonus_{IncDam} > 1 + bonus_{IncDam} = Increase Damage</math>
		+
		+
		+	----
		+
		+	The last on the list of our analysis is marginal utility approach. This approach will consider how adding one more property to equipment set will change damage comparing to the value before adding property.
		+	Let’s illustrate it on the chance of avoid example. Starting value of avoid is 5% and every additional property adds on average 5%. So with 0 properties we have 5%, with one it increases to 10%, with 2 to 15% etc. Let’s calculate multipliers and marginal utility:
		+
		+	<math>Avoid_0={1 \over {1 - 0.05}} = 1.052 </math>
		+
		+	<math>Avoid_1={1 \over {1 - 0.1}} = 1.111 </math>
		+
		+	<math>Avoid_2={1 \over {1 - 0.15}} = 1.176 </math>
		+
		+	<math>MarUtil_1={{Avoid_1 - Avoid_0} \over Avoid_0} = 5.60 \% </math>
		+
		+	<math>MarUtil_2={{Avoid_2 - Avoid_1} \over Avoid_1} = 5.85 \% </math>
		+
		+	Using this table of marginal utility, we can choose the most efficient equipment set to maximize expected damage.

	=Results=		=Results=

@@ Line 12: / Line 12: @@
 =Problem definition=
 Let’s look closer at the military module of E-Sim. Battle for any region consists of 2-hour rounds. To win the battle one side should win 8 rounds. During the round both sides deal some damage and side with more damage in the end of 2-hour interval wins the round. Here comes the first rule of battle: damage, dealt in the very last minutes of the round is more valuable that in the beginning of the round. On average player can fire all their damage in 1.5-2 minutes, so the last 2 minutes of the round are the most intense. Important detail, which later resulted in the drastic changes of military module, is that the best fighter (with the most damage dealt) of the round (on each of the sides) is winning ‘Battle Hero’ medal and gets paid 5 gold (this sum will later be compared with costs of weapons and to explain strategy of players).
 Damage dealt by the individual depends on 2 characteristics: strength and rank. Strength is gain every day during the training so it solely depends on how many days player was actively playing this game. It doesn’t depend on how much money player can afford to spend. Rank is being gained through fighting: it depends only on the cumulated damage player have done during his whole ‘life’. So this characteristic depends how actively player fights and how much money he spends on the weapons. Rank is quantified as some coefficient and multiplied by strength – this forms the basic hit value.
 Real battle damage will be modified with different bonuses: weapon bonus, military unit order bonus, location bonus. Experienced fighters always try to use all bonuses: they flight to specific region to gain the location bonus, they set military unit order on that battle. The most significant bonus is weapon bonus where most of the money are spent. Game has weapons of 5 quality levels (q1,q2,…,q5 notation; q5 – the best). If you fight without weapons you get -50% of your basic hit, with q1 weapons it’s +20% and with q5 weapons bonus is +100%.
 Full hit with q1 weapons costs around 7-8 gold, with q5 – 25 gold, average pay from work is 2 gold, so you can imagine how much you should work to fight with q5 – own stocks, companies, trade.
 To sum up, players could easily and precisely calculate their damage in the battle. This was comfortable, but some players exploited this in the bad way to get a lot of money so admin was forced to change hit calculation.
 I would like to explain you how precise calculation of damage was exploited. As I mentioned earlier, in every round ‘Battle Hero’ medal with 5 gold prize is granted for players with the highest damage on each side. If few players (for example 10) get the same highest amount of damage on one side – 10 medals will be granted and everyone of 10 will get 5 gold each. Generally, anyone can take part in battle so competition is too high to make deal with everyone and take ‘group Battle Hero’. But there is very special kind of battle – Civil War – where only citizens of the country involved can fight. This was exploited by one small country (Malaysia, which had the population of about 60 people) – in the chat they were coordinating their damage and a lot of people (up to 10 in one round) got the ‘Battle Hero’ medal and 5 gold. It became a real gold mine for the small group of people. Civil Wars in Malaysia became very frequent and there was no way to stop it.
 To destroy this opportunity admin introduced a lot of changes to the military module and made it random: players couldn’t precisely calculate their damage. For example, basic hit of 1000 damage became an uniformly distributed value between 800 and 1200 damage – on the average it was the same, but you couldn’t predict you exact damage.
 With randomization of basic hit value, admin also introduced new parameters usually available in MMORPG games: change of miss (zero damage), critical strike (double damage) and chance to avoid damage (deal damage, but does not spend hit). These parameters make hit value even more volatile and unpredictable.
 To influence these parameters admin created equipment pieces. 5 different slots were available for equipment: body armor, helmet, googles, weapon upgrade and offhand (later this number was increased to 8, but with another properties – economical – so we don’t consider them in damage simulations). There are 5 levels of quality (later level q6 was created, but it’s too expensive and rare to consider in simulation) of equipment, which determine interval in which values of bonuses are determined. Each piece has 2 bonuses, which can be of different kind. There are 7 kinds of military bonuses from equipment. 2 of them are proved to be not very efficient for developed players, so they were removed from the simulation. The rest 5 bonuses and their intervals for q5 items (q5 is the optimal equipment set for developed players) are:
@@ Line 25: / Line 29: @@
 *Reduced miss chance (6-7.5%)
 *Chance to avoid damage (4-6%)
-Every player has the same starting probabilities of miss, critical hit and chance to avoid damage. They are 12.5% for miss and you can decrease it to 0; 12.5% for critical hit and can be increased till 40%; 5% chance to avoid damage and can be increased till 40% with equipment. These restrictions and starting values mean that there’s no need of acquiring 3 parameters which decrease miss chance because 2 properties of reduction of miss chance will cover from 12% to 15%, which in most cases will be higher than starting 12.5%. Restriction with critical hit chance suppose that on average there’s no need of getting more than 6 properties for increasing critical hit: parameter will be between 36.5% and 48.5%, which is in most cases higher than 40%, so it will be rounded down to 40%. For change of avoid parameter logical maximum is 7 properties. There is no upper limit for increasing damage and maximum damage.
 =Method=
@@ Line 33: / Line 38: @@
 =Model=
 =Results=

← Older revision		Revision as of 14:18, 14 January 2015
Line 28:		Line 28:

	=Method=		=Method=
		+	To test what equipment set should perform better Monte-Carlo simulation will be used in MS Excel. Through numerous repetitions of fights in any equipment set possible average result can give an image how player should select equipment set.
		+
		+	Also, expected damage of every equipment set will be calculated and compared with Monte-Carlo simulation result. The last method of this research will be marginal utility approach: how single equipment property on average influences total outcome.

	=Model=		=Model=