Community Perceptions of Weapon Balance in U33

3 months ago

Hey everybody, MeatShield back at it again with some number crunching and data analysis! Brace yourself, this is going to be another LONG post.

Last Tuesday (March 2nd), I posted a survey in r/DeepRockGalactic asking people to rate all 302 weapon Mods and Overclocks in terms of how balanced they are. Not how much they like them, or which ones they think are the best, but if the option is balanced. After 7 days, a total of 296 people submitted responses that rated at least 1 Mod or Overclock. I've already published an Infographic showing the high-level results and interesting factoids about the survey results, and this is going to be the first of two blog posts that expand on the data analysis behind that Infographic. This first part is primarily going to consist of objective analysis of the data itself, and the next blog post (currently planned for this Friday) will be a more subjective interpretation of the data. Hopefully you all find this interesting!

If you don't care about how the survey was designed or my analysis of the data, you can skip all the way to the bottom to see the average balance scores of all 302 Mods and Overclocks according to the survey results.

Methodology

Goals of this project

First and foremost, I wanted to collect a moderate-size dataset about how the DRG community perceives the current weapon balance. Any time weapon balance gets discussed, much of it comes down to different opinions of people in the discussion. My hope is that by collecting enough responses to get a meaningful average rating of every Mod/OC, it will be possible to start making meaningful balance suggestions. I wanted to start at the lowest level of balance (the Mods and Overclocks inside each weapon) and identify what things need "micro" balancing. After that's done, it should be a lot easier to do "macro" balancing between the weapons and classes.

Here are some of the things I'm most interested in gathering data about from the survey:

  • Directly use the results to measure the perceived balance of Mods and Overclocks
  • Directly use the results to identify how the balance scores are distributed (preferably would be a Normal Distribution)
  • Indirectly use the results to gauge the perceived "micro balance" of each weapon
  • Indirectly use the results to gauge how much people care about each weapon's Mods/OCs

Designing the survey

Right from the start, I chose to abide by a few self-imposed rules when creating the survey:

  • It must be open to all DRG players, regardless of how much they play the game. Everyone's opinion matters, not just veterans -- I refuse to be exclusionary.
  • It must not require a Google account to complete. I don't want people to be turned away by having to reveal personal information about themselves (email address, potentially real name).

The first choice that I made was that I wanted this survey to be Quantitative, not Qualitative. Having hundreds of people type up mini essays with their thoughts about 302 Mods/OCs would mean a massive amount of data for me to sort through and anaylze at the end. By making all the questions multiple-choice with a uniform, predefined scale, I was able to expedite both taking the survey as well as analyzing the results afterwards. Additionally, multiple-choice questions are incredibly fast to answer, as opposed to filling out lots of short-answer text fields.

The second choice made was to exclude any questions about the weapons themselves. My reasoning was that by letting people start by rating the weapon itself, most of their ratings for the following Mods/OCs would be skewed towards the rating they gave the overall weapon (a form of confirmation bias). Not only that, but by letting them rate the weapons directly, I was worried that those questions would become "which weapon do you prefer using" instead of "how balanced is the weapon".

The third choice was to make every Mod/OC question optional. Not only was that a practical choice to get more people to actually finish and submit the survey, it was also a subtle way to identify the weapons, Mods, and Overclocks that the participants actually care about. If people only answered a dozen or so of the questions, I can infer that they care enough about those options to give them a rating. That's just as telling of a result as if they had rated all 302 options, but in a different manner -- more on this later in Meta Results.

The fourth major choice I made while creating the survey was to intentionally not tell survey-takers what each Mod/Overclock does. This was done for a few reasons:

  • Sometimes the written explanation of how something works is more confusing than helpful unless the player already understands the game mechanics that are being affected (Breach Cutter's Overclock "Inferno" is a great example of this counter-intuitive behavior). I didn't want people who were newer to the game to be confused by having tons of new/hidden mechanics thrown at them each question, and rather just be able to take the survey at face value.
  • This survey wasn't designed to measure how balanced the Mods/OCs actually are -- this was designed to measure the community's perceptions of balance. It is often the case that if a Mod or Overclock is moderately strong but perceived to be weak, its pickrate will still be low just from people telling each other that it's bad. Some of the top examples are GK2's T5.B "Battle Cool" and Revolver's T2.B "Floating Barrel". I was worried that giving a fully-detailed explanation of how everything works under the hood might skew perceptions and mess up the data.
  • I wanted people to come to terms with their own knowledge of the game, and the limits thereof. If they don't know what a Mod/OC does off the top of their head, I would rather have them look it up themselves and be comfortable with their understanding of how it works before giving it a balance rating.

So, once the survey had been designed, I set about creating the 1-5 scale that everyone would use. I wanted a system that was able to identify things that were both too weak and too strong, so something as simple as 1 being "bad" and 5 being "good" was out. I eventually settled on this scale:

  1. This mod/OC suffers from a fatal design flaw -- it should be either moved to a different tier, redesigned, or replaced with a different option.
  2. The design is sound, but it needs some numerical buffs to be usable.
  3. It's well-balanced in design, numerical values, and location.
  4. The design is sound but it needs some numerical nerfs so that it doesn't outcompete its neighbors anymore.
  5. This mod/OC is "broken/overpowered/must-pick at this tier" and needs to be either redesigned or moved to a different location.

Feedback from comments

I read every single comment on the reddit thread, including the ones criticizing the survey. Here's a high-level summary of the 196 comments at the time of writing this post:

Regarding the survey itself

  • People strongly desired to have Qualitative answers somewhere. Suggestions ranged from having one long-answer field at the end of every weapon to having every mod/OC get its own short-answer field. In general, there was some dissatisfaction at being constricted to the 1-5 scale without being able to personalize or explain their answers.
  • People disliked having to look up Mods/OCs on their own, and would have much rather had me tell them what each option did in the questions themselves. As I outlined above, it was an intentional choice not to add that information rather than an oversight. That said, it seems that the survey would have been received more positively if I had added the information so I'm not sure if I made the right call or not.
  • The length of the survey was daunting to several people. There were concerns that people would burn out before reaching the end, which would lead to incomplete data for Scout's weapons. There was a suggestion to randomize the order of weapons each time the survey is taken so that any potential burnout wouldn't be clustered on the same questions. Another suggestion was to split this into 16 different surveys (one per weapon) spread out across a short period of time.
  • Beyond the 1-5 scale, there should be an option for "I haven't tried this", and a checkbox that indicates the Mod/OC's score is affected by an issue with the weapon rather than the Mod/OC itself.
  • One person asked if the survey could include Equipment mods and grenades, too.
  • [Criticism]: Without the context of demographic things like players' skill, hazard levels, and what relative system they're using to make the 1-5 judgement, the results of the survey won't be meaningful.
  • [Criticism]: By not adding questions about ranking the classes or ranking the weapons in each slot, the results of the survey will be an incomplete picture of the game's balance.
  • [Criticism]: The survey is bloated by having a question for every Mod/OC, and should have focused on known problematic weapons/builds. Qualitative answers to identify why something is unbalanced would have been better than quantitative answers to identify what is unbalanced. As such, not only are the results bloated, they will also be diluted amongst the rest of the Mods/OCs that aren't a problem. The survey addresses neither inter-weapon balance nor inter-class balance, and as such glosses over the core issues of imbalance in the game right now. By not gathering demographic data about what Hazard Level the players play most often, or if they play DD vs EDD, the results are useless. "It completely misses the point."
  • [Criticism]: Not allowing people to rank classes or rate weapons as a whole was an obvious oversight. Without demogrpahic data of players' hazard levels, the results will be muddied. Ranking everything on a 1-5 scale is wrong; it would have been better to let people rank Mod tiers and Overclock groups from worst-to-best. "It's pretty terribly made."
  • [Criticism]: Rating a Mod/OC in a vacuum is worthless; the value of a Mod can change wildly depending on which Overclock you equip. "The survey is worthless, unfortunately."

Unrelated to the survey

  • The most upvoted comment on the thread was from someone who started taking the survey but then realized that they hadn't experimented with other builds in a long time. As a result of this survey, they decided to start experimenting again to try to get a feel for the weapons' balance. I'm happy that this survey had a positive effect on at least one person (and potentailly a few dozen of the people that upvoted that comment).
  • This website is starting to become recognized as a major source of information for this type of information, alongside the Wiki.
  • A few people thought I was a developer at GSG -- sorry to disappoint. I'm just a player who's very passionate about this game.
  • On the other hand, a few people had no clue that I even existed before this survey was posted.
  • One person said that they follow this blog -- hi u/idiotwitch!
  • There were a lot of comments on what balance changes people want implemented in U34 & U35.

Potential future surveys

I'm on the fence about adding Mod/OC descriptions to each question in the future. On one hand, it was the second-most requested addition, and one of the top things pointed out as a failing of the survey. On the other hand, I'm still worried about confusing people with over-complicated explanations of some under-the-hood mechanics that they may not even be aware of, or influencing people's perceptions of Mods/OCs by listing every single effect. At the time of writing this blog post, I'm leaning towards adding the descriptions to future surveys.

I am definitely planning on adding one long-answer text field at the end of every weapon page so that people have a much-requested outlet for their explanations and justifications. In addition, I'll probably add the "I haven't used this" option to the 1-5 multiple choice and "problem exists outside this mod" checkbox.

At the time of writing, I don't plan to add questions about inter-class or inter-weapon balance to future surveys. There's already an abundance of ways to collect that data, between posts on the subreddit, loadouts submitted to this website, word-of-mouth from other players, and my own observations. This survey was designed to gather information on the Mods and Overclocks beyond just pickrate, and that's exactly what it did.

I don't think people would be happy if I were to post 16+ survey links at once, and it would make it harder for me to aggregate the data at the end. As such I'm currently planning to keep it as one long survey for all weapons. I'm open to the idea of randomzing weapon order; the only thing giving me pause is that if people want to give specific feedback on a specific weapon, having them all in order is extremely useful.

The last thing I'm going to address is the request to collect demographic data about players' preferred Hazard level, hours played, DD vs EDD, player rank, promotions for each class, etc: I'm going to stick to my guns and say "no". I firmly believe that the point of doing community surveys like this is to get everyone's opinion and value it equally. I don't care if you've just finished the "Conquer Hoxxes" Assignment or if you have more hours played than ArcticEcho himself, you're part of the DRG community and as such I want to hear your opinion on these matters. If I wanted to only get data from veteran players or people who play Haz5+, I would just ask people on my friends list or in any of the Discord servers that I frequent. Frankly, I'm a little disappointed that some people wanted this type of thing to be elitist. That's not the spirit of DRG, and not very Rock and Stone.

Meta Results

This section is a meta-analysis about how the questions were answered, rather than the answers themselves. Like I alluded to earlier, by making every question optional I can see which Mods/OCs people care enough to provide ratings for. If someone only provides ratings for a primary weapon and secondary weapon of the same class, I can infer that those two weapons are probably the only ones that the player uses and that they play that class significantly more than the others. Similarly if they rate only a dozen Mods/OCs, it can be inferred that those are the Mods/OCs that the person cares most about balancing. Alternatively, not submitting a rating on a Mod/OC could indicate that they haven't tried it enough to get a feel for how balanced it is.

From an orthogonal perspective, I can see how many people voted for a Mod/OC and infer how strongly people care about that option in particular. If something is voted on by 85% of responses, it's safe to conclude that people care more about that option than something that was only voted on by 67% of the responses.

With all of that in mind, here's a breakdown of how people answered the questions:

Average number of questions answered per person

Answered 300 - 302 questions: 137
Answered 200 - 299 questions: 59
Answered 100 - 199 questions: 49
Answered 1 - 99 questions: 51
Average number answered: 225.37

Average number of responses per weapon

CRSPR Flamethrower 242.37
Cryo Cannon 216.05
Subata 120 231.78
Experimental Plasma Charger 203.3
"Warthog" Auto 210 238.94
"Stubby" Voltaic SMG 218.72
Deepcore 40MM PGL 232.42
Breach Cutter 222.74
"Lead Storm" Powered Minigun 226.71
"Thunderhead" Heavy Autocannon 218.4
"Bulldog" Heavy Revolver 223.56
BRT7 Burst Fire Gun 204.75
Deepcore GK2 221.9
M1000 Classic 215.89
Jury-Rigged Boomstick 217.53
Zhukov NUK17 200.53

While it's pretty obvious that most survey responses included the Flamethrower because it's the first page, it's somewhat gratifying to see that there was only a nominal amount of burnout. In fact: EPC, BRT, and Zhukovs are all around the same number of responses, whereas GK2, M1000, and Boomstick all had comparable numbers of responses to Cryo Cannon, SMG, Breach Cutter, Minigun, Autocannon, and Revolver.

Most and least voted-on Mods/OCs

For this section, I took the count of how many people submitted a rating for each Mod/OC, and divided it by the average number of ratings for that weapon (see the table right above this section). By doing so, this lets me easily find any Mod/OC that received a significantly higher amount of ratings than its weapon's average.

Most voted-on Mods/OCs

  1. PGL OC "Fat Boy"
  2. Boomstick OC "Special Powder"
  3. EPC T5.B "Thin Containment Field"
  4. Autocannon OC "Big Bertha"
  5. PGL OC "Hyper Propellant"
  6. Minigun OC "Lead Storm"
  7. Breach Cutter OC "Return to Sender"
  8. Autocannon OC "Carpet Bomber"
  9. SMG OC "Turret EM Discharge"
  10. M1000 OC "Hipster"
  11. Flamethrower T1.A "High Capacity Tanks"
  12. BRT OC "Lead Spray"
  13. SMG OC "Turret Arc"
  14. PGL OC "RJ250 Compound"
  15. Zhukovs OC "Cryo Minelets"
  16. Cryo Cannon OC "Perfectly Tuned Cooler"
  17. Shotgun T5.A "Turret Whip"
  18. Shotgun OC "Magnetic Pellet Alignment"
  19. Revolver OC "Elephant Rounds"
  20. SMG OC "EM Refire Booster"

Least voted-on Mods/OCs

  1. Minigun OC "Exhaust Vectoring"
  2. Breach Cutter OC "Stronger Plasma Current"
  3. Boomstick OC "Compact Shells"
  4. Boomstick OC "Stuffed Shells"
  5. Minigun OC "Compact Feed Mechanism"
  6. PGL T4.C "Concussive Blast"
  7. GK2 OC "Compact Ammo"
  8. Flamethrower T4.A "It Burns!"
  9. Flamethrower OC "Lighter Tanks"
  10. Boomstick T3.A "Stun Duration"
  11. Revolver T2.B "Floating Barrel"
  12. Autocannon T4.A "Hardened Rounds"
  13. PGL T1.A "Fragmentary Shell"
  14. PGL T2.B "Larger Payload"
  15. BRT OC "Composite Casings"
  16. M1000 T4.A "Super Blowthrough Rounds"
  17. GK2 OC "Gas Rerouting"
  18. EPC T3.B "Crystal Capacitors"
  19. EPC T4.B "High Density Battery"
  20. Subata OC "Chain Hit"

Statistical Analysis

Normal Distribution: achieved!

I am quite pleased to report that using the 1-5 scale as outlined in the Methodology section provided results that were easily turned into a Normal Distribution. For anyone that hasn't taken a Statistics and Probability class, that means that there's a mountain of data points all grouped together in the middle, and there are fewer and fewer data points the further away you get from the middle. This is exactly the type of data I was hoping this survey would generate! For anyone who cares, the Mean of the Mods/OCs' scores is 2.863581535 and the Standard Deviation is 0.39831432. Here's a plot that overlays a Histogram of the 302 Mods/OCs with the Normal Distribution bell curve generated by the data:

Outliers (beyond the 2nd Standard Deviation)

For the non-statisticians reading this blog post, there's a bit of "rule" regarding Normal Distributions: 68.27% of the data should be within one Standard Deviation of the Mean, 27.18% should be between one and two Standard Deviations away from Mean, and the last 4.55% of the data should be outside two Standard Deviations. Using the Mean and Standard Deviation listed above, 69.205% of the 302 Mods/OCs live within 1 Std. Dev., 25.828% between 1-2 Std. Devs., and the last 4.967% are outside 2 Std. Devs. In this case, I'm choosing to highlight the 15 Mods/OCs that fall outside of two Standard Deviations from Mean as the "outliers" most desperately in need of a balance change in Update 34, according to the survey results.

Above [Mean + 2 * Std Dev]

Mod/OC Average Rating (desc)
EPC T5.B "Thin Containment Field" 4.0833
Minigun T5.B "Cold as the Grave" 3.7296
Autocannon OC "Carpet Bomber" 3.7048
   
   
   
   
   
   
   
   
   

 

Below [Mean - 2 * Std Dev]

Mod/OC Average Rating (asc)
SMG OC "Turret Arc" 1.7301
Breach Cutter OC "Inferno" 1.7422
Minigun T5.A "Aggressive Venting" 1.7930
BRT OC "Electro Minelets" 1.7971
GK2 OC "Electrifying Reload" 1.7974
Breach Cutter OC "Roll Control" 1.9156
M1000 OC "Supercooling Chamber" 1.9589
Revolver OC "Homebrew Powder" 2.0000
Breach Cutter T5.A "Explosive Goodbye" 2.0090
Boomstick OC "Shaped Shells" 2.0509
Minigun OC "Bullet Hell" 2.0517
Revolver OC "Chain Hit" 2.0628

 

Ranking the Weapons, Mods, and OCs in terms of how balanced they are

Weapons

By taking the absoloute value of [3 - Rating] for every Mod/OC a weapon has, summing up all of those differences, and then dividing that sum by how many Mods/OCs were counted, it's possible to reduce the "micro balance" of each weapon to just one number. According the survey, here are the 16 weapons ranked in order of having the fewest "micro balance" issues at the top to the ones most in need a balance pass at the bottom:

  Avg absolute distance from 3 Average value of all Mods/OCs
"Warthog" Auto 210 0.2157 2.980593869
Zhukov NUK17 0.2508 2.806965791
"Stubby" Voltaic SMG 0.2644 2.847631167
Subata 120 0.2700 2.818754422
"Thunderhead" Heavy Autocannon 0.2897 2.952041428
M1000 Classic 0.3019 2.786604866
CRSPR Flamethrower 0.3122 2.90118422
Cryo Cannon 0.3306 2.92799001
BRT7 Burst Fire Gun 0.3314 2.851665154
"Lead Storm" Powered Minigun 0.3322 2.87502019
"Bulldog" Heavy Revolver 0.3454 2.916062727
Jury-Rigged Boomstick 0.3473 2.869341331
Deepcore GK2 0.3568 2.785157781
Deepcore 40MM PGL 0.3743 2.84174026
Breach Cutter 0.4116 2.818825343
Experimental Plasma Charger 0.4132 2.839744932

To be clear: this ordering does not represent how balanced each weapon is on a "macro" scale (weapon-to-weapon, or class-to-class). The third column can be used to indicate the general power level indicated by the results, but that one number isn't as meaningful as seeing the individual scores of every Mod/OC in a weapon. That data is available at the very bottom of this post.

Mod Tiers

Another way to look at the data is by subtracting the lowest score in each Mod tier (or Overclock group) from the highest score, and seeing what the difference is. The closer to 0 this number is, the more balanced that group is against each other. Here's the 16 weapons ranked by the sum of all 5 Mod tiers' [high - low] scores in ascending order (top means they're well-balanced, bottom means they're not):

  1. SMG
  2. Zhukovs
  3. Subata
  4. M1000
  5. Revolver
  6. GK2
  7. Shotgun
  8. Boomstick
  9. Cryo Cannon
  10. Flamethrower
  11. Autocannon
  12. BRT
  13. Breach Cutter
  14. PGL
  15. Minigun
  16. EPC

Overclocks

Similarly, here's the 16 weapons ranked by their Overclocks' [high - low] scores in ascending order:

  1. Shotgun
  2. Zhukovs
  3. Subata
  4. Minigun
  5. M1000
  6. Cryo Cannon
  7. Flamethrower
  8. PGL
  9. BRT
  10. Autocannon
  11. EPC
  12. Revolver
  13. Boomstick
  14. GK2
  15. SMG
  16. Breach Cutter

Highest and Lowest Rated Mods/OCs

Here's the section that some of you are probably reading this blog post for: the 30 highest-rated and 30 lowest-rated Mods and Overclocks according the survey:

Highest-rated Mods & Overclocks

  1. EPC T5.B "Thin Containment Field"
  2. Minigun T5.B "Cold as the Grave"
  3. Autocannon OC "Carpet Bomber"
  4. Cryo Cannon OC "Perfectly Tuned Cooler"
  5. Flamethrower T3.B "Sticky Flame Slowdown"
  6. Revolver T3.C "Hollow-Point Bullets"
  7. Cryo Cannon T4.C "Larger Reserve Tank"
  8. Autocannon T1.C "Expanded Ammo Bags"
  9. Boomstick OC "Special Powder"
  10. Flamethrower OC "Sticky Fuel"
  11. EPC OC "Heat Pipe"
  12. Breach Cutter OC "Return to Sender"
  13. PGL OC "Hyper Propellant"
  14. Breach Cutter T2.A "Expanded Ammo Bags"
  15. Cryo Cannon T5.A "Fragile"
  16. Breach Cutter T5.C "Triple Split Line"
  17. PGL OC "Fat Boy"
  18. Revolver OC "Six Shooter"
  19. Boomstick T4.A "Super Blowthrough Rounds"
  20. Subata T4.A "Hollow-Point Bullets"
  21. GK2 OC "Bullets of Mercy"
  22. Minigun T1.C "Improved Platform Stability"
  23. BRT T4.C "Hollow-Point Bullets"
  24. PGL T2.A "Expanded Ammo Bags"
  25. Autocannon T4.B "Shrapnel Rounds"
  26. BRT T5.A "Burst Stun"
  27. Boomstick T3.C "High Capacity Shells"
  28. SMG OC "EM Refire Booster"
  29. EPC T1.B "Larger Battery"
  30. Minigun T3.C "Blowthrough Rounds"

Lowest-rated Mods & Overclocks

  1. SMG OC "Turret Arc"
  2. Breach Cutter OC "Inferno"
  3. Minigun T5.A "Aggressive Venting"
  4. BRT OC "Electro Minelets"
  5. GK2 OC "Electrifying Reload"
  6. Breach Cutter OC "Roll Control"
  7. M1000 OC "Supercooling Chamber"
  8. Revolver OC "Homebrew Powder"
  9. Breach Cutter T5.A "Explosive Goodbye"
  10. Boomstick OC "Shaped Shells"
  11. Minigun OC "Bullet Hell"
  12. Revolver OC "Chain Hit"
  13. EPC T5.A "Flying Nightmare"
  14. EPC OC "Persistent Plasma"
  15. PGL OC "RJ250 Compound"
  16. PGL T2.C "High Velocity Grenades"
  17. GK2 OC "Homebrew Powder"
  18. PGL T4.A "Homebrew Explosive"
  19. Subata OC "Homebrew Powder"
  20. Flamethrower OC "Compact Feed Valves"
  21. Boomstick T5.A "Auto Reload"
  22. M1000 T4.C "Hardened Rounds"
  23. Subata OC "Tranquilizer Rounds"
  24. SMG OC "Turret EM Discharge"
  25. Flamethrower T4.A "It Burns!"
  26. BRT OC "Micro Flechettes"
  27. Boomstick OC "Double Barrel"
  28. Breach Cutter T3.B "Improved Case Ejector"
  29. Subata OC "Chain Hit"
  30. M1000 OC "Electrocuting Focus Shots"

Conclusions and Observations

Because this post is already excessively long, I'm choosing to confine my comments in this section to be primarily objective assessments of the data itself. I'm already planning to write a second post with my subjective interpretation of the results, and I hope to get that published sometime on Friday.

Take the weapons to the gym, because players want them to get buff(ed)

One of the goals I have for DRG's weapon balance is to get most Mods/OCs to have scores that fall within the 2.7 - 3.3 range, and nothing would be less than 2.4 or higher than 3.6. Using those arbitrary ranges:

  • 44 Mods/OCs have a score less than 2.4
  • 50 have a score between 2.4 - 2.7
  • 177 are well-balanced are have a score between 2.7 - 3.3
  • 27 have a score between 3.3 - 3.6
  • 4 have a score greater than 3.6

It's pretty easy to see that right now, the DRG community wants a LOT of buffs in U34. Almost one third of all 302 Mods/OCs fall below 2.7, yet only one tenth are above 3.3. The fact that the average of all 302 Mods/OCs is only 2.86 (instead of the desired 3) is pretty telling on its own.

Expanding the scope from the granular Mods/OCs level and looking at the weapons overall: GK2, M1000, Zhukovs, Subata, and Breach Cutter are the 5 weapons with the most number of Mods and OCs that people want buffed.

This data mirrors a lot of the opinions already held by the community

As a scientist, it's always exciting to get data from an experiment that subverts my expectations -- but that wasn't the case for this survey. The top 30 and bottom 30 are veritable "who's who" lists of Mods and Overclocks that people have already identified as unbalanced. So, although this survey didn't provide any "new" information, at the very least it provided concrete numbers to assign to each of the problematic upgrades. Most importantly: we can use these results formed by a consensus of almost 300 players as the foundation upon which we form our weapon balance discussions until Update 34 arrives.

I'm hopeful that this data can be used to definitively answer "what needs to be changed", and let us move onto "how do we change it?"

Misc. Results

This section is dedicated to the first page of the survey, where I gathered a little information unrelated to the Mods/OCs. I asked people to enter their usernames so I would be able to identify if anyone submitted the survey twice, evaluate their own skill levels on each class, and at the end of the page there was an optional short answer field at the bottom with the prompt "Rock and Stone!".

Plot of responses received vs time

Self-reported skill levels of each class

Distribution of responses to "Rock and Stone!" optional question

Raw Data

This section will list the 302 average "balance ratings" for every weapon Mod and Overclock. I'm choosing not to disclose the number of votes for each mod/OC in this blog post, but if you're interested in seeing that data feel free to get in contact with me on the DRG Community Tools Discord server.

Driller

CRSPR Flamethrower Cryo Cannon
High Capacity Tanks: 3.039840637 High Pressure Ejector: 3.174796748  
Unfiltered Fuel: 3.239669421 Triple Filtered Fuel: 2.591666667 Sticky Flame Duration: 3.004065041
Oversized Valves: 2.521008403 Sticky Flame Slowdown: 3.557377049 More Fuel: 3.159836066
"It Burns!": 2.258474576 Sticky Flame Duration: 3.078838174 More Fuel: 3.182572614
Heat Radiance: 2.67768595 Targets Explode: 3.110204082  
  • Lighter Tanks: 2.953389831
  • Sticky Additive: 2.900826446
  • Compact Feed Valves: 2.218487395
  • Fuel Stream Diffuser: 2.617647059
  • Face Melter: 2.356275304
  • Sticky Fuel: 3.47983871
Larger Pressure Chamber: 2.730232558 Faster Turbine Spinup: 3.0 Stronger Cooling Unit: 3.296296296
Larger Reserve Tank: 3.203703704 Overclocked Ejection Turbine: 3.070093458 Bypassed Integrity Check: 2.316037736
Improved Pump: 2.812206573 Increased Flow Volume: 3.106976744  
Hard Mixture: 2.633802817 Supercooling Mixture: 3.135514019 Larger Reserve Tank: 3.528037383
Fragile: 3.418604651 Cold Radiance: 3.073732719  
  • Improved Thermal Efficiency: 2.802752294
  • Perfectly Tuned Cooler: 3.623318386
  • Flow Rate Expansion: 2.375586854
  • Ice Spear: 2.536363636
  • Ice Storm: 2.509090909
  • Snowball: 2.459459459
Subata 120 Experimental Plasma Charger
Improved Alignment: 2.852813853 High Capacity Magazine: 2.991452991 Quickfire Ejector: 2.754310345
Expanded Ammo Bags: 3.165217391 Increased Caliber Rounds: 2.785407725  
Improved Propellant: 2.668122271 Recoil Compensator: 2.728448276 Expanded Ammo Bags: 3.103896104
Hollow-Point Bullets: 3.385964912 High Velocity Rounds: 3.013100437  
Volatile Bullets: 3.021186441 Mactera Toxin-Coating: 2.676470588  
  • Chain Hit: 2.27753304
  • Homebrew Powder: 2.203463203
  • Oversized Magazine: 2.934497817
  • Automatic Fire: 3.109704641
  • Explosive Reload: 2.813852814
  • Tranquilizer Rounds: 2.252136752
Increased Particle Density: 2.895522388 Larger Battery: 3.326732673 Higher Charged Plasma Energy: 2.685
Expanded Plasma Splash: 2.746268657 Overcharged Plasma Accelerator: 2.975247525 Reactive Shockwave: 2.675
Improved Charge Efficiency: 3.282178218 Crystal Capacitors: 3.085427136 Tweaked Radiator: 2.626865672
Heat Shield: 2.407960199 High Density Battery: 3.246231156  
Flying Nightmare: 2.082926829 Thin Containment Field: 4.083333333 Plasma Burn: 2.468899522
  • Energy Rerouting: 3.034482759
  • Magnetic Cooling Unit: 2.517241379
  • Heat Pipe: 3.470873786
  • Heavy Hitter: 2.743961353
  • Overcharger: 2.352941176
  • Persistent Plasma: 2.087804878

 

Engineer

"Warthog" Auto 210 "Stubby" Voltaic SMG
Supercharged Feed Mechanism: 3.164556962 Overstuffed Magazine: 2.89787234  
Expanded Ammo Bags: 3.255230126 Loaded Shells: 3.302521008 Choke: 2.663865546
Recoil Dampener: 2.565400844 Quickfire Ejector: 2.869747899 High Capacity Magazine: 3.054621849
Tungsten Coated Buckshot: 2.666666667 Bigger Pellets: 3.296610169  
Turret Whip: 2.536585366 Miner Adjustments: 3.29338843  
  • Stunner: 2.936170213
  • Light-Weight Magazines: 3.041666667
  • Magnetic Pellet Alignment: 3.256097561
  • Cycle Overload: 2.864978903
  • Mini Shells: 3.004115226
Increased Caliber Rounds: 2.912442396 Upgraded Capacitors: 3.073059361 Expanded Ammo Bags: 3.087557604
High Capacity Magazine: 2.732718894 Recoil Compensator: 3.03255814 Improved Gas System: 2.843317972
High Velocity Rounds: 3.018604651 Expanded Ammo Bags: 3.24537037  
Hollow-Point Bullets: 3.12962963

Conductive Bullets: 3.09259259

 
Magazine Capacity Tweak: 2.903669725 Electric Arc: 2.913242009  
  • Super-Slim Rounds: 2.628440367
  • Well Oiled Machine: 2.619266055
  • EM Refire Booster: 3.328888889
  • Light-Weight Rounds: 2.71040724
  • Turret Arc: 1.730088496
  • Turret EM Discharge: 2.255506608
Deepcore 40mm PGL Breach Cutter
Fragmentary Shell: 2.925110132 Extra Ammo: 3.284482759 HE Compound: 2.780701754
Expanded Ammo Bags: 3.347826087 Larger Payload: 3.061674009 High Velocity Grenades: 2.135371179
Incendiary Compound: 2.396551724 Pressure Wave: 3.135371179  
Homebrew Explosive: 2.181818182 Nails + Tape: 3.220779221 Concussive Blast: 2.769911504
Proximity Trigger: 2.309322034 Spiky Grenade: 3.097457627  
  • Clean Sweep: 3.065789474
  • Pack Rat: 2.944444444
  • Compact Rounds: 2.3930131
  • RJ250 Compound: 2.104166667
  • Fat Boy: 3.411290323
  • Hyper Propellant: 3.427983539
Prolonged Power Generation: 3.253393665 High Capacity Magazine: 2.918918919  
Expanded Ammo Bags: 3.426008969 Condensed Plasma: 2.936936937 Loosened Node Cohesion: 2.760180995
Quick Deploy: 3.193693694 Improved Case Ejector: 2.272321429  
Armor Breaking: 3.080717489 Disruptive Frequency Tuning: 3.14479638  
Explosive Goodbye: 2.009009009 Plasma Trail: 3.027027027 Triple Split Line: 3.415178571
  • Light-Weight Cases: 3.204545455
  • Roll Control: 1.915555556
  • Stronger Plasma Current: 2.790697674
  • Return to Sender: 3.443965517
  • High Voltage Crossover: 2.415525114
  • Spinning Death: 2.6069869
  • Inferno: 1.742222222

 

Gunner

"Lead Storm" Powered Minigun "Thunderhead" Heavy Autocannon
Magnetic Refrigeration: 2.491150442 Improved Motor: 2.924444444 Improved Platform Stability: 3.359649123
Oversized Drum: 3.27753304 High Velocity Rounds: 3.168888889  
Hardened Rounds: 2.862222222 Stun Duration: 2.529147982 Blowthrough Rounds: 3.31441048
Variable Chamber Pressure: 3.0969163 Lighter Barrel Assembly: 3.075221239 Magnetic Bearings: 2.425438596
Aggressive Venting: 1.792951542 Cold As The Grave: 3.729613734 Hot Bullets: 2.726086957
  • "A Little More Oomph!": 3.052631579
  • Thinned Drum Walls: 2.9375
  • Burning Hell: 2.852678571
  • Compact Feed Mechanism: 2.836363636
  • Exhaust Vectoring: 2.769585253
  • Bullet Hell: 2.051724138
  • Lead Storm: 3.101265823
Increased Caliber Rounds: 2.577981651 High Capacity Magazine: 2.981651376 Expanded Ammo Bags: 3.513636364
Tighter Barrel Alignment: 2.593457944 Improved Gas System: 2.939814815 Lighter Barrel Assembly: 3.212962963
Supercharged Feed Mechanism: 2.934883721 Loaded Rounds: 3.185185185 High Velocity Rounds: 2.856481481
Hardened Rounds: 2.976525822 Shrapnel Rounds: 3.342592593  
Feedback Loop: 3.296803653 Suppressive Fire: 2.904109589 Damage Resistance at Full RoF: 2.339366516
  • Composite Drums: 2.861111111
  • Splintering Shells: 3.161290323
  • Carpet Bomber: 3.704845815
  • Combat Mobility: 2.339449541
  • Big Bertha: 2.847826087
  • Neurotoxin Payload: 2.470852018
"Bulldog" Heavy Revolver BRT7 Burst Fire Gun
Quickfire Ejector: 2.878923767 Perfect Weight Balance: 3.255605381  
Increased Caliber Rounds: 3.232876712 Floating Barrel: 2.706422018 Expanded Ammo Bags: 3.22972973
Super Blowthrough Rounds: 2.337837838 Explosive Rounds: 2.798206278

Hollow-Point Bullets: 3.540178571

Expanded Ammo Bags: 3.197309417 High Velocity Rounds: 3.207207207  
Dead-Eye: 2.973568282 Neurotoxin Coating: 3.139737991  
  • Homebrew Powder: 2.0
  • Chain Hit: 2.062780269
  • Volatile Bullets: 2.606334842
  • Six Shooter: 3.402654867
  • Elephant Rounds: 3.147826087
  • Magic Bullets: 2.771929825
High Velocity Rounds: 3.039408867 Floating Barrel: 3.131707317 Blowthrough Rounds: 2.648780488
Recoil Dampener: 2.784313725 Quickfire Ejector: 2.689655172 Disabled Safety: 3.21182266
High Capacity Magazine: 2.799019608 Increased Caliber Rounds: 3.272277228  
Hardened Rounds: 2.328358209 Expanded Ammo Bags: 3.280788177 Hollow-Point Bullets: 3.356435644
Burst Stun: 3.341346154 Longer Burst: 2.629807692  
  • Composite Casings: 3.055
  • Full Chamber Seal: 2.62254902
  • Compact Mags: 2.931372549
  • Experimental Rounds: 2.710144928
  • Electro Minelets: 1.797101449
  • Micro Flechettes: 2.261904762
  • Lead Spray: 3.141509434

 

Scout

Deepcore GK2 M1000 Classic
Gyro Stabilisation: 2.683035714 Supercharged Feed Mechanism: 3.099547511  
Increased Caliber Rounds: 2.900900901 Expanded Ammo Bags: 3.291479821  
Floating Barrel: 2.686098655 Improved Propellant: 2.659192825 High Capacity Magazine: 2.851351351
Hollow-Point Bullets: 3.252252252

Hardened Rounds: 2.538116592

Improved Gas System: 2.778280543
Battle Frenzy: 2.878923767 Battle Cool: 2.4375 Stun: 3.139013453
  • Compact Ammo: 2.717592593
  • Gas Rerouting: 2.728110599
  • Homebrew Powder: 2.172727273
  • Overclocked Firing Mechanism: 2.45412844
  • Bullets of Mercy: 3.36199095
  • AI Stability Engine: 3.275555556
  • Electrifying Reload: 1.797356828
Expanded Ammo Bags: 3.162037037 Increased Caliber Rounds: 3.028169014  
Fast-Charging Coils: 3.107476636 Better Weight Balance: 2.851162791  
Killer Focus: 3.009302326 Extended Clip: 2.985915493  
Super Blowthrough Rounds: 2.805687204 Hollow-Point Bullets: 3.241860465 Hardened Rounds: 2.23255814
Hitting Where it Hurts: 3.160550459 Precision Terror: 2.476851852 Killing Machine: 2.766055046
  • Hoverclock: 2.958715596
  • Minimal Clips: 3.087557604
  • Active Stability System: 2.704225352
  • Hipster: 2.334821429
  • Electrocuting Focus Shots: 2.287037037
  • Supercooling Chamber: 1.95890411
Jury-Rigged Boomstick Zhukov NUK17
Expanded Ammo Bags: 3.182648402 Double-sized Buckshot: 3.115207373  
Double Trigger: 2.884792627 Quickfire Ejector: 3.106976744  
Stun Duration: 2.41509434 Expanded Ammo Bags: 3.178899083 High Capacity Shells: 3.331797235
Super Blowthrough Rounds: 3.399082569 Tungsten Coated Buckshot: 2.562790698 Improved Blast Wave: 2.527522936
Auto Reload: 2.22972973 Fear the Boomstick: 2.648401826 White Phosphorus Shells: 3.02293578
  • Compact Shells: 2.943127962
  • Double Barrel: 2.268181818
  • Special Powder: 3.495689655
  • Stuffed Shells: 2.928909953
  • Shaped Shells: 2.050925926
  • Jumbo Shells: 3.224770642
Expanded Ammo Bags: 3.179104478 High Velocity Rounds: 2.601010101  
High Capacity Magazine: 2.707070707 Supercharged Feed Mechanism: 2.712121212 Quickfire Ejector: 2.959798995
Increased Caliber Rounds: 2.654822335 Better Weight Balance: 3.070707071  
Blowthrough Rounds: 2.944723618 Hollow-Point Bullets: 3.045 Expanded Ammo Bags: 3.195979899
Conductive Bullets: 2.640394089 Get In, Get Out: 2.910891089  
  • Minimal Magazines: 2.694581281
  • Custom Casings: 2.381909548
  • Cryo Minelets: 2.743961353
  • Embedded Detonators: 2.951219512
  • Gas Recycling: 2.325123153