The recent uptick in Generative AI (GenAI) and Large Language Models (LLMs) has been all over the news, but apps like ChatGPT and Bard are only scratching the surface of what this technology can do. To fully understand the potential, you need to understand the concept of embeddings, the language…

This article describes Vizro, a new Python package that helps users visualize data from their AI models. — Vizro was open-sourced earlier this week with the goal of enabling teams of data practitioners to communicate via visual analytics, without needing scarce, front-end engineering or design talent. Data is core to decision making. However, interpreting it can be painful. Often the best way to explore, analyse and communicate data is with visualizations and dashboards. This has become easier with the recently growing number of high-quality Python visualization libraries, but a certain level of software engineering and visual…

Understanding and unlocking the potential of streaming analytics with Kedro — As a data practitioner, there are scenarios in which working with real-time data streams is essential to delivering timely insights. Unlike batch analytics, which involves processing large volumes of data in predefined batches, streaming analytics processes real-time data as it arrives, offering immediate insights and enabling real-time decision-making. Streaming data…

For both new and experienced data practitioners, managing data is not a trivial matter. Organizations increasingly rely on efficient data collection, storage, and access so cross-functional teams can use it effectively, across the business. The management of these vast quantities of data residing in a central data lake can be…

Kedro is an open-source Python toolbox that applies software engineering principles to data science code, making it easier to transition from prototype to production. Created by QuantumBlack, AI by McKinsey, it was open-sourced in 2019, and donated to the Linux Foundation in 2021. Kedro is constantly being improved and in…

The recruitment and retention of women in tech is key to the sector’s growth. That’s according to a recent McKinsey report, which proposes that doubling the number of women in the tech workforce by 2027 could close the talent gap it currently faces and increase its economic output. …

Our team has shared the most effective ways to keep data safe, including key techniques such as tokenisation, suppression and cryptographic encryption. Data-driven solutions help organisations make better decisions, improve efficiency, create better experiences for customers and ultimately bring in more revenue. But the growth of big data is outpacing…

There’s never been a more exciting time to work in data. As artificial intelligence (AI) and machine learning (ML) continue to evolve, the potential of what can be achieved appears to be near limitless. Innovations in AI will continue to be some of the most transformative technologies impacting how we…

We’ve added datasets and documentation enhancements to the recent 0.18.4 release of Kedro — Jo Stichbury, Technical Writer, QuantumBlack Labs Since its inception there have been some major milestones in the lifetime of Kedro. From being open-sourced in 2019, to being donated to the Linux Foundation. Kedro is constantly being developed and the latest release, made in December 2022, brings a raft of changes…