a new theory of life

Big Data and Machine Learning – a glass only half full

An article written by Mitch De Felice from CIO – “Big Data and Machine Learning – is the glass half empty?” which appeared also on Bloomberg for Enterprise have made some great points on why big data is having a difficult time delivering on the promise of rich discoveries. The author opened the topic of Artificial Intelligence by saying –

Today, the focus is on machine learning and statistical algorithms.

To understand the significance of today’s Ai focus it is important to know what Ai was. As the author pointed out- AI is different today from 20 years ago. He said:

AI 20 years ago was focused on what is known as logic based AI or Knowledge Representation (KR).

However, back in the early 90s, the tools and frameworks to make KR successful had never materialised until recently. A plain wiki definition on KR is the following –

Knowledge representation and reasoning (KR) is the field of artificial intelligence (AI) dedicated to representing information about the world in a form that a computer system can utilize to solve complex tasks such as diagnosing a medical condition or having a dialog in a natural language.

Examples of knowledge representation formalisms include semantic nets, systems architecture, Frames, Rules, and ontologies. Examples of automated reasoning engines include inference engines, theorem provers, and classifiers.

Knowing what Ai was 20 years ago, the next question becomes – what Ai is now?  Do we have the tools and frameworks to make KR successful today?

Big data and machine learning could provide some tools and frameworks to make KR successful – at least in part. The author illustrated the capabilities of Ai from data usage perspective – highlighting the role of big data and machine learning in making KR successful –

Fig. 1  Capabilities of AI in context by data types

From a practitioner’s perspective, most machine learning we do are supervised machine learning which has existed, according to the author, since the 1950s. 🙂

You might wonder – what exactly is Supervised / Unsupervised Machine Learning? A quick internet search returned in a PDF tutorial by Zoubin Ghahramani from Gatsby Computational Neuroscience Unit, University College London, UK, a total of

Four Types of machine learning

If you are interested to go deeper on unsupervised learning, please check out the tutorial linked above.

Jumping back to the CIO/Bloomberg article, the greatest challenge facing Ai today is probably the Cognitive Computing that links Knowledge Representation and Machine Learning. The lack of understanding of concepts by machines is hindering their ability to perform Logic Reasoning and thus Cognitive Computing.

On the machine learning side, there is a limited “knowledge” that unsupervised learning (eg. clustering and dimensionality reduction) can deliver – as the author has put it –

The best big data can offer is the ability to classify, falling short on being able to provide any contextualization capabilities, which is the real value to the business.

So the outlook of handling unstructured data explosion and developing successful Ai solution looks daunting

The reality is that technology is shifting faster than leadership can understand what threats it poses. Large bureaucratic companies that simply adopt the big data paradigm will struggle to keep up with explosion of unstructured data and data streams that has caused the role and value of information to drastically change.

One thing I can predict here is – by the time when cognitive computing fully materialise, the only thing humans could do against machines might just be – Pulling the Plug. 🙂

Exit mobile version