Kubric, a scalable dataset generator, is the python framework that is used for generating photo-realistic computer-generated images and videos. The main advantage of this python tool is that it helps in creating datasets very cheaply, and gives us full control over them. In this article we will go through the Introduction of Kubric, then we will see what is the need of this framework. We will also try to understand its working mechanism. The major points to be discussed in this article are listed below. 

After several groundbreaking NLP, computer vision libraries and frameworks, Google has released another framework named Kubric. On 07 Mar 2022 Google researchers Klaus Greff, Francois Belletti, Lucas Beyer released their research paper on Kubric: A scalable dataset generator.

It is an open-source Python framework that allows you to create photo-realistic scenes by combining the functions of PyBullet and Blender. PyBullet is the Python module that is used for creating physics simulations, and Blender is used for rendering. These generated data are referred to as Synthetic data. These synthetic datasets provide high-quality labels for various image tasks such as object detection, segmentation, classification etc. 

The below image shows the scene generated by Kubric along with some of the automatically generated annotations.

There are many synthetic datasets available on the internet such as ScanNet, SYNTHIA etc, but they do not contain all possible annotations for all image tasks (instance and semantic segmentation masks, optical flow) but Kubric generates the images with annotations and supports different viewing angles and lighting conditions. For generating synthetic datasets there are also pipelines available like Blender and Unity3D, these pipelines fulfil the lighting and different viewing angles limitations, but for creating additional annotation they need in-depth knowledge of the underlying rendering engine.

The architecture of Kubric is given below.

Kubric is a high-level python library that fuses the functionality of PyBullet and Blender. We see a blue box named Worker, the main component of Kubric that is responsible for creating synthetic data. Like in web scraping the code which extracts data from the website we call it Crawler or Spider, In the same way the code which is responsible for generating synthetic data we call it as Worker. 

Now, In the figure Assets are loaded from the external source in order to create a scene by the worker, PyBullet creates physics simulation, Blender renders the frames, and finally, images, annotations layers and other metadata are exported.

Kubric workflow is very simple, just write the worker script that creates a single scene. In order to create a full dataset, you have to run a worker script many times. After this, collect the generated dataset.

The most important question is why we need this data generator framework. As we know machine learning and artificial intelligence how much we rely on data. As it is mentioned in the research paper:

“Data is the driving force of machine learning”

Data is necessary but, How about good data?. Good data is the key to the performance of a machine learning system than the anatomy of models and training details. But collecting, annotating, and cleaning real data at a large scale is a laborious and expensive job and frequently raises privacy, fairness of use and legal concerns. To handle these concerns Google introduces Kubric, with this tool we can generate data very cheaply, automate the ground-truth annotation, give full control over the data, and reduce the bias, privacy and licensing problems.

A Worker is the main component of Kubric as we discussed above. So each worker sets up a Scene object, which keeps track of global settings like resolution, the number of frames to render, gravity, a Camera, and all the objects, including lights, material, animations etc. are called Assets. When we put the Asset into the Scene, it creates corresponding objects of different views, as we discuss above PyBullet creates the physics simulation and bpy module for using the Blender functionality, Blender is a powerful 3-D graphics renderer. Below the image is the output of the Worker. A simple environment with a floor, pointing light, a perspective camera and 8 KuBasic objects placed on the floor with velocity. It’s an animation video but we put the still image.

In this article, We learned about Kubric, from its definition to its architecture and we get to know why this framework is necessary. We could also understand how it addresses the problems of creating the real dataset, and how easily Kubric tackles those problems.

Conference, Virtual Microsoft DataNext 22nd Mar

Workshop, Virtual Getting started with Intel® Optimisation for PyTorch 25th Mar

Conference, in-person (Bangalore) Rising 2022 | Women in AI Conference 8th Apr

Conference, Virtual Data Engineering Summit 2022 30th Apr

Conference, in-person (Bangalore) MachineCon 2022 24th Jun

Conference, in-person (Bangalore) Cypher 2022 21-23rd Sep

Stay Connected with a larger ecosystem of data science and ML Professionals

Discover special offers, top stories, upcoming events, and more.

TPOT is an open-source package for optimizing machine learning programs. We can also consider this tool as an automated machine learning tool using which we can automatically get a high performing model for data modelling.

Colossal-AI is such a powerful system that can perform complicated distributed training and give an easy way to set up different types of parallelism.

Folding-in-time concepts have already been successfully developed for related machine-learning methods called reservoir computing.

You can use resources like Machine Learning Subreddit and Deep Learning Subreddit to enrich your understanding.

According to the CSET report on Mapping India’s AI Potential, AI-related patent applications grew tenfold from 2012 to 2018.

The prophet is a toolkit or library for time series analysis that is available to us as an open-source. Utilizing this toolkit we can perform time series analysis and forecasting very easily and fast. This toolkit has various features that can make our time series analysis procedure accurate and efficient.

Reverie’s Voice Suite supports English and 10 Indian languages.

As per Gartner, supervised learning will continue to be the most popular type of machine learning in 2022.

Stochastic gradient descent is also a method of optimization. The objective function which needs to be optimised comes with suitable smoothness properties and this suitable smoothness makes the stochastic gradient descent different from the gradient descent.

FEDOT is a framework that supports automated machine learning modelling and is available to us as open-source. Using this framework we can customise the pipeline of machine learning modelling procedures.

Stay up to date with our latest news, receive exclusive deals, and more.

© Analytics India Magazine Pvt Ltd 2022