What we can learn from the most popular AI scandals


With AI front and centre in our collective consciousness, it’s no surprise that it has also had its fair share of controversy. AI scandals are not that numerous (yet), but they are impactful. So, today we’ll look at some famous AI scandals and what we can learn from them.

Popular AI scandals

Since the 2010s, controversial news stories relating to AI systems and their use have popped up. Here are some of the most memorable and worrisome:

• Facebook's news feed
In 2014, Facebook conducted a controversial experiment where it manipulated the content displayed in users' news feeds. The goal was to study the emotional impact this adjustment could have on its users. Naturally, the study sparked ethical concerns about informed consent and the potential for emotional manipulation. And all this was done without any of the users being aware they were part of a test.

• IBM photo-scraping
In 2019, it was discovered that IBM was using 1 million images of real human faces from Flickr's mixed-use public and private photo-sharing website to train their face recognition. Users didn’t give their informed consent to have their data used in this way. And it has highlighted some ethical concerns around how big data trains their models.

• Google Nightingale
While Google’s motive might be noble - to improve patient outcomes - the idea that they have access to millions and millions of complete patient medical records from the UK and USA should worry you. Patients weren’t informed at the time that their data was being sent to Google as part of Project Nightingale and the information wasn’t anonymised. That means there are staffers at Google with access to fully identifiable medical information who aren’t trained medical professionals.

• Amazon hiring
In 2018, Amazon made an AI recruiting tool to help them sort through and locate top candidates. It was put into widespread use and graded resumes on a star system, just like Amazon reviews. But, like many systems trained on flawed data that have human biases, it began to show favouritism towards male candidates. It started downgrading female resumes based on female-centric characteristics like ‘women’s chess club champion’. As a result, Amazon had to abandon the project.

• Lethal Autonomous Weapons (LAWs)
It will come as no surprise that some countries like the USA and Russia like the idea of using AI for military applications. And in 2018, the UN met to talk about Lethal Autonomous Weapons or LAWs. There’s a 2018 documentary that explores these issues and famous voices like Elon Musk and Steven Hawking have banded together to sound the alarm about AI that has no governance against hurting humans.

• Self-driving car accidents
You’re likely to have heard of the multiple incidents involving self-driving cars, both in test and real-life scenarios. According to KNR Legal, “In 2022, Automakers reported approximately 400 crashes of vehicles with partially automated driver-assist systems to the NHTSA. 273 of these accidents involved Teslas (the most common vehicle with self-driving capability), 70% of which used the Autopilot beta at the time. Out of the 98 self-driving crashes with injuries, 11 resulted in serious injuries. Five incidents involving Teslas were fatal.”

While that’s less than the road traffic accidents caused by human drivers, it’s still too much to gain confidence in such systems.

• Cambridge Analytica
In 2018, we all learned that a 3rd-party firm had been given access to the personal data of approximately 87 million Facebook users back in 2014. All without their consent. And this company, Cambridge Analytica, used the data to influence politics and manipulate public opinion. As a result, there’s a $725m class-action lawsuit currently underway against Meta.

• Deepfakes
The growing trend of using faked video footage of celebrities or influencers to sell products is ubiquitous on websites like TikTok and YouTube. But, there’s also concern over body autonomy, child protection and personal rights as now this technology is being used to create adult material too. In the Netflix series ‘Black Mirror’ this concept is explored further in the episode “Joan Is Awful’ where a random ‘Streamberry’ user realises they’ve signed away the movie rights to their day-to-day life when they registered for the service. Calamity ensues.

• Tay, the Twitter Bot
In 2016, Microsoft launched a fun little AI personality for users to interact with on Twitter called Tay. She was designed to learn and grow while talking with people online. But it went sour quickly. Built to interact with 18-24-year-olds, the coders at Microsoft didn’t really think about what the bot might learn. Within hours, the bot was racist and offensive, prompting Microsoft to take it offline forever.

• AI-generated art and copyrights
The emergence of AI-generated art has led to debates about copyright and ownership. There are arguments on all sides. Some say that AI does make new pieces and that work should be protected and others insist that since AI cannot have experiences, all work should be owned by the human artists that inspired it. Further still, some argue that the prompt engineers are the real artists, simply using a tool to make art like a pen - and that they should own the copyright.


Learning from the most popular AI scandals

The most important takeaway is that we still have a lot of work to do in this space. The ethics, laws and application of AI are still being decided. And we can use scandals as a rubric for how we want our future to look.

Will we have killer robots or should AI always be used for good? How should humans be treated and what can AI own? While we might not have all the answers just now, we can learn from these controversies and use them to create policies and legislation that protect everyone. For now, the approach is clear: we should only use AI to uphold the highest standards of good for humans at all times.

Interested in ethically using AI in your own business to get ahead of the marketplace? We can help. We empower your sales teams to deliver above and beyond forecasts with smart, AI-supported tools.


Künstliche Intelligenz im Vertrieb | Qymatix News

AI in sales gains momentum: Qymatix Experts Fully Booked in November

Karlsruhe, 07.12.2023. The topic "Artificial Intelligence in Sales" is becoming more and more popular! In the last few weeks alone, Lucas Pedretti, CEO of Qymatix Solutions GmbH, has been a guest speaker at four exciting events:

Read more

Intelligente Preisgestaltung | Predictive Pricing Wholesale

Intelligent, Predictive Pricing: the Key to B2B Wholesale Success


Digitalisation is a blessing and a curse, an opportunity, and a threat. Nearly 900 German wholesale companies took part in a recent study by Roland Berger and the German Wholesale, Foreign Trade and Services Association (BGA). Almost all of them, 94%, believe that digitalisation is driving change in their sector. Two-thirds are aware of the challenges it poses.

In particular, the companies surveyed see themselves threatened by digital platforms when it comes to pricing (62%).

Read more

Zahlen über Künstliche Intelligenz in B2B-Unternehmen

Artificial Intelligence in German B2B Companies - What do the Figures tell us?

Especially since the launch of ChatGPT on November 30, 2022, the topic of artificial intelligence (AI) in Germany has experienced another substantial boost. But what do the numbers say?

In this article, we look at the current usage of AI in German B2B companies, with a particular focus on B2B wholesale. We also look at what companies already using AI are reporting: What are their experiences?

Finally, we look at surveys that explore the assessment of the future importance of AI for B2B companies.

Let's get started!

Read more

Zukunftstrends im B2B-Grosshandel

B2B Wholesale Future Trends 2024

Across B2B wholesale future trends 2024, you’ll see a few key themes: technology, personalisation and change.

Some are accelerations of global movements, while others are specific to the B2B space. We’ll break down what you can expect in 2024 and where these movements are coming from in this quick, 5-minute read.

Read more

Umsatzrentabilität im Großhandel steigern

Return on sales in B2B Wholesale – What is it and how to increase it?

"It is not because things are difficult that we do not dare. It is because we do not dare that they are difficult." Lucius Annaeus Seneca, c.4 BC-c.65 AD.

Some of Germany's biggest B2B wholesalers have doubled their Return on Sales (ROS) after Corona, while others are struggling. Take, for example, the Würth Group, one of the biggest. Its Electrical Wholesale unit was particularly successful in 2022, reporting a growth of 25.0 per cent.

Is it hard to increase ROS? If Würth could, why not you? In B2B wholesale distribution, sales managers and executives must increase their return on sales (ROS) to remain competitive and profitable.
Read more

Optimizing AI Efficiency

Optimizing AI Efficiency: Effective Use of Data via Qymatix Cloud Connector


As businesses increasingly leverage artificial intelligence (AI) to streamline operations, optimize decision-making, and gain insights, the role of data as the lifeblood of AI has become indisputable. Data acts as the foundation upon which AI models are built, providing the raw materials necessary for AI to learn, adapt, and evolve.

However, manually handling and extracting data for AI can be time-consuming, costly, and fraught with errors. This is where the Qymatix cloud connector comes into play.

Read more

Was sind Algorithmen

What are Algorithms - Easily Explained


Algorithms - the word gets tossed around today for everything from your basic Instagram feed recommendations to complex interfaces like ChatGPT. But what are algorithms? Are they just for computers? How do they help you?

In today’s article, we’ll explain what algorithms are and give some examples of how you can benefit from this ubiquitous but often-misunderstood technology.
Read more

How to set more realistic targets using predictive analytics

How to Set More-Realistic Sales Targets using Historical Data

How to set more-realistic sales targets using historical data and Predictive Analytics.

To replace the legendary Jack Welch as CEO, the General Electric (GE) Board had selected Jeffrey Immelt in November 2000. As he took the reins, Immelt set an ambitious sales target: “We believe that GE can grow two to three times faster than world gross domestic product, which translates to about 8 per cent sustained sales growth.”

To give you some perspective, the industrial segment of GE had grown 4 per cent historically.

Likewise, on December 4, 2003, Rockwell Automation announced that its board of directors had elected Keith Nosbusch as president and chief executive officer.

Read more

KI gegen den Fachkräftemangel im Großhandel

How can AI help with labour shortage in B2B wholesale and manufacturing?

The importance of predictive sales software to address the skills shortage in Germany's specialist wholesale sector.

The shortage of skilled workers in Germany has reached alarming proportions and is particularly affecting the specialist wholesale trade. Sales managers and directors of specialist wholesalers in Germany are under great pressure as they face an acute shortage of skilled workers.

Read more