Let's use bitbake commands from python!

First of all

I'm working on building a custom linux build using yocto.
In this job, I often get requests like

• I need a list of files that inherit from a specific bbclass (like core-image.bbclass).
• I need to list the variables (e.g. PE, PV, PR) with all packages
• I need to list the bbappend files for a specific package (e.g. gcc).

Isn't that a pain in the ass? I don't want to grep, and I don't want to build because it takes too long...

Let's use Bitbake from python.

It's a pain in the ass I think, so let's investigate how to do something about it. First of all, the build mechanism by bitbake command is roughly like this.

This Tinfoil is a little bit complicated, so it's not easy to use. The actual code is here. On the other hand, IF between server_client is defined somewhat nicely here. Considering these circumstances, it seems like I should do like below.

If I make this bbclient in python, it will be easy to use from language server and so on.

What I made

Based on the results of the study so far, the bbclient I made is shown in below.

https://pypi.org/project/bbclient/

I've also prepared some documentation.

• IF Specifications
• Concrete use case

What you can do

There are so many IFs that I can't show you all of them, but for now, let's try to implement the use case I mentioned at the beginning of this article.
First of all, the way to initialize the bbclient instance is shown in below.

import bbclient # Initialize bbclient instance project_path: str = "/PATH/TO/POKY" init_command: str = ". oe-init-build-env" client: BBClient = BBClient(project_path, init_command) # launch server server_adder: str = "localhost" server_port: int = 8081 client.start_server(server_adder, server_port) # set event filter ui_handler: int = client.get_uihandler_num() client.set_event_mask(ui_handler, logging.DEBUG, {}, ["*"]) # paser recipes and create caches ret = client.parse_files() client.wait_done_async() 

You can use this client to implement each of the following use cases.

I need a list of recipe files that inherit a specific bbclass (like core-image.bbclass).

ret: List[GetRecipeInheritsResult] = client.get_recipe_inherits() recipes_inherit = [i for i in ret if "/PATH/TO/core-image.bbclass" in i.inherit_file_paths] for i in recipes_inherit: print(i.recipe_file_path) 

I need you to list the variables (e.g. PE, PV, PR) with all packages

ret: List[GetRecipesResult] = client.get_recipes() for i in ret: data_store_index: int = client.parse_recipe_file(i.recipe_files) pe: Any = client.data_store_connector_cmd(data_store_index, "getVar", "PE") pv: Any = client.data_store_connector_cmd(data_store_index, "getVar", "PE") pr: Any = client.data_store_connector_cmd(data_store_index, "getVar", "PE") print(pe, pv, pr) 

I need you to list the bbappend files for a specific package (e.g. gcc).

ret: List[str] = client.find_best_provider("gcc") target_recipe_file_path: str = ret[3] ret: List[str] = client.get_file_appends(target_recipe_file_path) print(ret) 

You can also build images from this client and generate dependency taskdepends files.

Finally

If you would like to try it, please use it!