A non-profit organisation shares how it is benefitting communities across LatAm using Kedro

Jo Stichbury, Technical Writer, Yetunde Dada, Principal Product Manager, QuantumBlack; Lais Carvalho — Developer Advocate

Image for post
Image for post

This conversation with Carlos Gimenez, founder of Open Data Science LatAm (ODESLA), is part of a global series to understand how Kedro is used around the world.

Carlos Gimenez is a pioneer for data science best-practices. He recognised how Kedro could benefit his teams soon after it was open sourced; and, introduced Kedro while he was at Naranja X and to his own organisation, Open Data Science LatAm (ODESLA).

Kedro is an open source Python framework that helps Data Scientists create reproducible, maintainable and modular data science code. Kedro is built upon a collective knowledge gathered by QuantumBlack, whose teams routinely deliver real-world machine learning applications as part of McKinsey. In this article, we won’t explain further what Kedro is, but you can read our introductory article to find out more, and find links to other articles and podcasts in our documentation. …


’Twas the night before the holidays began and all through the house…there was much excitement because the elves in QuantumBlack Labs released a new version of Kedro.

Image for post
Image for post
“Top View Photography of Blackboard Between Baubles” (with edit) by Giftpundits.com License

This article explains what’s new in Kedro 0.17.0 and Kedro-Viz 3.8.0, how to unwrap them and what to expect. Don’t forget to read the manual before operation. Batteries not included.

First things first.

What is Kedro?

Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code. It borrows concepts (like modularity, separation of concerns and versioning) from software engineering and applies them to machine-learning code.

At QuantumBlack, we routinely deliver real-world machine learning applications as a part of our work. We created Kedro to build upon the knowledge and experience we had gathered. …


Katherine Shenton, Head of Marketing, QuantumBlack

Image for post
Image for post

This weekend marks the start of the Neural Information Processing Systems (NeurIPS) Conference. In any other year, the QuantumBlack team would be travelling to the event to take part in a week of lectures, workshops and tutorials. However, 2020 has posed its challenges and so we will be among the thousands joining this year’s virtual edition.

This is the first time the conference will be solely digital — however we are confident this will only make the event more accessible than ever before. With thousands of practitioners expected to log on from around the world, it is fitting that this year’s theme focuses on how the global Machine Learning (ML) industry is adapting in the face of intense disruption — and asks what 2021 has in store. …


Jo Stichbury, Technical Writer, QuantumBlack; Yetunde Dada, Principal Product Manager, QuantumBlack; Lais Carvalho, Developer Advocate

Our conversation with Element AI is part of a global series to understand how Kedro is perceived around the world. For more on how Element AI is using AI to change enterprise operations, check out their website. And to find out about how the company is using AI for innovation and collaboration, check out this blogpost.

Image for post
Image for post

Element AI is an artificial intelligence solutions provider that uses cutting-edge research to help businesses produce accessible and operational solutions. …


Tom Essl, Junior Principal UX Designer, QuantumBlack

Image for post
Image for post

“Any sufficiently advanced technology is indistinguishable from magic.” This famous quote from science fiction author Arthur C. Clarke will likely resonate with many involved in product design, where beginning a project can often resemble conjuring something out of nothing.

We frequently find ourselves attempting to define a product vision based on abstract thoughts that exist only in our heads, and this can make it difficult to determine which part of the process to initially focus on. …


Vishnu Kamalnath, Expert Associate Partner, QuantumBlack and Brian McCarthy, Partner, McKinsey & Company

Image for post
Image for post

In recent years AI technologies have become increasingly influential in how organisations operate, creating significant cost savings and improving customer experience. Simply put, a greater number of business decisions are being made in industries around the world today by some form of AI.

While progress has been rapid, AI systems have significant vulnerabilities that could completely throw them off balance. Failure to handle these could lead to serious financial loss, as well as ethical and reputational issues for the organisations involved.

As businesses continue to deploy AI to automate, it is imperative they recognise the potential vulnerabilities involved and have detection and safe-guarding practices in place to protect their models. …


Dan Feldman, Design Director, McKinsey, Sydney; Maksud Ibrahimov, Jr Principal Data Scientist, QuantumBlack, Melbourne; Justin Hevey, Expert Designer, McKinsey, Sydney; Cris Cunha, Analytics Expert Associate Partner, QuantumBlack, Perth and James Deighton, Partner, McKinsey, Melbourne

Image for post
Image for post

This is the second of our three-part series, Exploring The Intersection Of Design & Advanced Analytics. In this article, we will take a deeper look at how effective collaboration between designers and data scientists can unlock greater value in advanced analytics (AA) projects.

As we referenced in our previous article, failure in advanced analytics projects occur for a host of reasons including technical issues, misalignment with business priorities, and insufficient user adoption. While technical feasibility and business viability failures are less prevalent than they were a few short years ago, the disconnect between the analytic solutions proposed and their up-take by end users represents the latest bottleneck for many advanced analytics projects. …


Tom Goldenberg, Junior Principal and Brendan Joyce, Junior Principal, QuantumBlack

Image for post
Image for post

It is often assumed that an organisation’s data infrastructure is its most crucial asset when developing advanced analytics interventions. While access to high quality data is often valuable and helps analytics teams to hit the ground running, in our experience the real engine for change is the mindset and enthusiasm of an organisation. To illustrate this point, this article explores QuantumBlack’s recent work in the airline freight industry.

This project offered an exciting opportunity to deliver measurable commercial value in a sector that had been relatively untouched by analytics. This presented obstacles for the team — but the organisation we worked with were engaged and eager to embrace the benefits that modelling would bring to the industry. …


Waylon Walker explains the challenges data scientists face when their machine-learning code moves into production, and how Kedro is changing that.

Lais Carvalho — Developer Advocate, Jo Stichbury — Technical Writer, Yetunde Dada — Principal Product Manager

Image for post
Image for post
Photo by Christina Morillo

Our conversation with Waylon Walker forms the first part of an ongoing series about Kedro and understanding how it is used around the world.

Almost two years ago, Waylon Walker, created a framework to streamline the process of creating data and machine-learning pipelines. He did not set out to design a framework, but after working on many small-to-medium sized data projects a framework had formed. …


Authors: Roxana Pamfil, Data Science Consultant, QuantumBlack and Nisara Sriwattanaworachai, Senior Data Scientist, QuantumBlack

Image for post
Image for post

Over the last couple of years, an emerging hot topic in the data science community has been pushing models beyond correlations to instead encode causal relationships. This led us to launching CausalNex, an open source library that leverages Bayesian Networks to uncover structural relationships in data, learn complex distributions, and observe the effect of potential interventions.

Until recently, CausalNex has been limited to static (i.i.d.) data. With many of our projects operating in settings that change over time, we realised the need to adapt the methodology behind CausalNex to also work for temporal data. …

About

QuantumBlack, a McKinsey company

An advanced analytics firm operating at the intersection of strategy, technology and design. www.quantumblack.com @quantumblack

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store