Human Biases Reflected As Computer Biases

Bias: prejudice in favor of or against a thing, person, or group

What is “computer bias”?

The existence of prejudiced outcomes in the decisions or predictions made by computer systems/algorithms. Bias can be implemented into algorithms because of human biases being intentionally inserted or because of the data utilized being biased.

Explicit Data: Information directly provided by user.

Implicit Data: Infomration that can inferred from explicit data.

Based on either explicit/implicit data that has been used to train an algorithm, whether intentionally introduced or during the process of training data generation, bias can be created.

A notable example of this is seen in Netflix, where there are is a human factor that drives bias: Netflix exclusives are placed ahead (a show that is a Netflix exclusive means that users will be more likely to stay with Netflix). The bias in this case is Netflix’s prioritzation towards Netflix-produced shows.

Hack 1:

What is another example of a human bias being implemented into an algorithm?

Answer: amazon products

Reducing Bias

Programmers should take action to reduce bias in algorithms used for computing innovations as a way of combating existing human biases. Softwares need to be unbiased, consider all everything, and reject human bias.

Things to consider when developing programs:

  • What are potential sources of bias?
  • Is your program enhancing or intentionally excluding?
  • Are you receiving feedback from a widespread group of people?
  • How could people who differ from you use your developments?

Hack 2:

What is another way a programmer can reduce bias in their softwares?

Answer: Establish clear criteria and a structured evaluation process.

Types of Bias in Software Development

Biases can be embedded at all levels of software development.

It can be intentional or unintentional. Some software development are made for a certain market and ensure that people of certain places or demographics can use them easily. However, this doesn’t mean that they are trying to exclude.

Examples:

Intentional:

  • Games could be geared towards a certain age range (Talking Tom vs Valorant)
    • Game concepts
    • Music
    • Visuals

  • WeChat and KakaoTalk
    • Almost everyone in China uses WeChat
    • KakaoTalk is the Korean version

Unintentional:

  • Social media, Facebook vs. instagram

Hack 3:

What are some other examples of intentional and/or unintentional bias in innovations (games, social media, technology, etc.)?

Answer: a person may like one shirt more than two others when given a choice because the shirt they picked is also their favorite color.

Homework

Question 1:

Define “computer bias” in your own words and explain how it can result from intentional or unintentional factors in software development. Give a brief example of this. Explain how programmers can actively work to reduce bias in their algorithms?

Answer: Computer bias refers to the presence of unfair or discriminatory outcomes in software systems, which can arise from intentional or unintentional factors during development. Intentional bias occurs when developers consciously incorporate prejudiced criteria or discriminatory rules into the software, while unintentional bias stems from sources like biased training data, flawed algorithms, or the omission of relevant variables. For example, a facial recognition system trained predominantly on data from lighter-skinned individuals may exhibit bias by misidentifying or underrepresenting people with darker skin tones. Programmers can actively work to reduce bias by carefully selecting diverse and representative training data, evaluating algorithm performance across different demographic groups, involving diverse teams in the development process, conducting regular audits and testing, and implementing transparency mechanisms to promote fairness and accountability. These practices help programmers create algorithms that are more equitable and less biased.

Question 2:

Briefly describe the two types of bias in software development and provide examples from the gaming industry and social media platforms. How might biases in software design affect user engagement and experiences?

Answer: Bias in software development can take two forms: intentional bias and unintentional bias. Intentional bias occurs when developers purposefully incorporate discriminatory criteria or rules into the software, such as games that perpetuate harmful stereotypes or social media platforms that prioritize content based on biased ideologies. Unintentional bias arises from factors like biased training data or flawed algorithms, leading to unintended consequences such as limited representation in character customization options or the inadvertent amplification of hate speech. These biases in software design can greatly impact user engagement and experiences by causing feelings of exclusion, offense, or unequal treatment, fostering echo chambers, and undermining the overall inclusivity and fairness of digital platforms.