`ia9dZddlmZddlZddlZddlZddlZddlZddlm Z  dddZ ddZ e dkrej e dSdS)aUtility script to embed CUBIN data into existing object files. This script takes an object file containing C++ code that uses TVM_FFI_EMBED_CUBIN and embeds the CUBIN binary data directly into it, creating a new combined object file. Usage: python -m tvm_ffi.utils.embed_cubin --output-obj new_obj.o --input-obj old_obj.o --cubin my-cubin.cubin --name my_module The output object file will contain both: - The original C++ code from input-obj - The embedded CUBIN data with symbols: __tvm_ffi__cubin_ __tvm_ffi__cubin__end These symbols are accessed in C++ code using: TVM_FFI_EMBED_CUBIN(my_module); ) annotationsN)PathF cubin_pathrinput_obj_pathoutput_obj_pathnamestrverboseboolreturnNonec |std||std||r~td|d|jdtd|d|jdtd|td|t j5}t|}|d |d z }|| |d |d z }d ddddt|t|j g} |rFtdtdd | td|tj| t|dd} | jdkrg| jd} | jd} t'd| jdd | d| d| |r1| jr*td| jd|r1| jr*td | jdd!d"d#d$d%t|g} |r4td&tdd | tj| dd'} | jdkrg| jd} | jd} t'd(| jdd | d| d| |r1| jr*td| jd|r1| jr*td | jd|d |d)z }d!d*d+d,d-|d.|d,d-|d/|d0t|t|g }|r4td1tdd |tj|dd'} | jdkrg| jd} | jd} t'd2| jdd |d| d| |r1| jr*td| jd|r1| jr*td | jdd ddt|t|t|g}|r4td3tdd |tj|dd'} | jdkrg| jd} | jd} t'd4| jdd |d| d| |r1| jr*td| jd|r1| jr*td | jdd!d5d6|d5d6|d0t|g}|r4td7tdd |tj|dd'} | jdkrg| jd} | jd} t'd8| jdd |d| d| |r1| jr*td| jd|r1| jr*td | jdd9d9d9n #1swxYwY|r~td:|td;td<|j td=td>|d?td>|d@tdAd9Sd9S)BuEmbed a CUBIN file into an existing object file. This function takes a CUBIN binary file and merges it into an existing object file that contains C++ code using TVM_FFI_EMBED_CUBIN. The result is a new object file containing both the original code and the embedded CUBIN data. The process involves: 1. Creating an intermediate CUBIN object file using `ld -r -b binary` 2. Adding `.note.GNU-stack` section to CUBIN object for security 3. Using `objcopy` to rename symbols to the format expected by TVM-FFI: - _binary__start → __tvm_ffi__cubin_ - _binary__end → __tvm_ffi__cubin__end 4. Using `ld -r` (relocatable link) to merge the CUBIN object with the input object 5. Localizing the symbols to prevent conflicts when multiple object files use the same name Parameters ---------- cubin_path : Path Path to the input CUBIN file. input_obj_path : Path Path to the existing object file containing C++ code with TVM_FFI_EMBED_CUBIN. output_obj_path : Path Path to the output object file (will contain both code and CUBIN data). name : str Name used in the TVM_FFI_EMBED_CUBIN macro (e.g., "my_module"). This name must match the name used in the C++ code. verbose : bool, optional If True, print detailed command output. Default is False. Raises ------ FileNotFoundError If the input CUBIN file or input object file does not exist. RuntimeError If `ld` or `objcopy` commands fail. Examples -------- In Python, ```python embed_cubin( Path("kernel.cubin"), Path("old.o"), Path("new.o"), "my_kernels", ) ``` Then in C++ code, ```C++ TVM_FFI_EMBED_CUBIN(my_kernels); auto kernel = TVM_FFI_EMBED_CUBIN_GET_KERNEL(my_kernels, "kernel_name"); ``` (in the source that was compiled to old.o). zCUBIN file not found: zInput object file not found: z Input CUBIN: z (z bytes)zInput object: zOutput object: z Symbol name: embedded_z.cubincubin_z.oldz-rz-bbinaryz-oz. [Step 1/4] Creating CUBIN object file with ldz Command:  zWorking directory: TF)cwdcapture_outputcheckrzutf-8zld (binary) failed with status z Command: z stdout: z stderr: zstdout: zstderr: objcopyz --add-sectionz.note.GNU-stack=/dev/nullz--set-section-flagsz.note.GNU-stack=noload,readonlyz< [Step 1.5/4] Adding .note.GNU-stack section to CUBIN object)rrz/objcopy (add stack section) failed with status z _renamed.oz--rename-sectionz/.data=.rodata,alloc,load,readonly,data,contentsz--redefine-sym_binary_embedded_z_cubin_start=__tvm_ffi__cubin_z_cubin_end=__tvm_ffi__cubin__endz/ [Step 2/4] Renaming CUBIN symbols with objcopyzobjcopy failed with status z6 [Step 3/4] Merging objects with ld (relocatable link)zld (merge) failed with status z--localize-symbol__tvm_ffi__cubin_z$ [Step 4/4] Localizing CUBIN symbolsz.objcopy (localize symbols) failed with status Nu0 ✓ Successfully created combined object file: z Contains:z - Original code from z- - Embedded CUBIN data with local symbols:z __tvm_ffi__cubin_z (local)z _end (local)z4 - .note.GNU-stack section (non-executable stack))existsFileNotFoundErrorprintstatst_sizetempfileTemporaryDirectoryr write_bytes read_bytesr rjoin subprocessrun returncodestderrdecodestdout RuntimeError)rrrrr tmpdirtmp_path temp_cubin cubin_obj ld_binary_cmdresultr(r*objcopy_stack_cmdcubin_obj_renamed objcopy_cmd ld_merge_cmdobjcopy_localize_cmds m/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/tvm_ffi/utils/embed_cubin.py embed_cubinr82si D     G E E EFFF  " "R P P PQQQ& NjNNJOO,=,=,ENNNOOO W~WW1D1D1F1F1NWWWXXX 111222 $d$$%%%  $ & &e>&<< 8D 8 8 88 z446677700000 tT8T3y>>3zK_K_`  4 C D D D 7chh}5577 8 8 8 222 3 3 3 3x==QU]bccc   ! !]))'22F]))'22F$&2C$$HH]33$$!$$"$$   >v} > v} > v} > v} > v} > v} > v} > v} > chh';<<>> ? ? ? 4TQVWWW   ! !]))'22F]))'22F$AR$$HH%9::$$!$$"$$   >v} > v} > e>e>e>e>e>e>e>e>e>e>e>e>e>e>NF S/SSTTT m ?.*=??@@@ =>>> 8$888999 <$<<<=== DEEEEEFFs [%___intc|tjddtjd}|dtddd |d tddd |d tddd |dtddd |dddd|} t |j}t |j }t |j }|j ddt||||j|j|jst!d|dS#t"$r)}t!d|t$jYd}~dSd}~wt($r)}t!d|t$jYd}~dSd}~wt*$r<}t!d|t$jt-jYd}~dSd}~wwxYw) z-Main entry point for the embed_cubin utility.z#python -m tvm_ffi.utils.embed_cubinzNEmbed CUBIN data into existing object files that use TVM_FFI_EMBED_CUBIN macroa Examples: # Basic usage python -m tvm_ffi.utils.embed_cubin \ --output-obj new.o \ --input-obj old.o \ --cubin kernel.cubin \ --name my_kernels # With verbose output python -m tvm_ffi.utils.embed_cubin \ --output-obj new.o \ --input-obj old.o \ --cubin kernel.cubin \ --name my_kernels \ --verbose Workflow: 1. Compile C++ code that uses TVM_FFI_EMBED_CUBIN to create old.o 2. Compile CUDA kernel to CUBIN (e.g., using nvcc or NVRTC) 3. Use this tool to merge them into new.o 4. Link new.o into your final shared library Usage in C++ code (source compiled to old.o): TVM_FFI_EMBED_CUBIN(my_kernels); auto kernel = TVM_FFI_EMBED_CUBIN_GET_KERNEL(my_kernels, "kernel_name"); Requirements: - GNU binutils (ld and objcopy) must be available in PATH - Linux/Unix platform (Windows uses different embedding mechanisms) )prog descriptionformatter_classepilogz --output-objTPATHz%Output object file path (e.g., new.o))typerequiredmetavarhelpz --input-objzIInput object file path containing TVM_FFI_EMBED_CUBIN usage (e.g., old.o)z--cubinz*Input CUBIN file path (e.g., kernel.cubin)z--nameNAMEz9Name used in TVM_FFI_EMBED_CUBIN macro (e.g., my_kernels)z-vz --verbose store_truezPrint detailed command output)actionrC)parentsexist_oku ✓ Created rzError: )fileNzUnexpected error: )argparseArgumentParserRawDescriptionHelpFormatter add_argumentr parse_argsrcubinresolve input_obj output_objparentmkdirr8rr rrsysr(r+ Exception traceback print_exc)parserargsrrres r7mainr_2s  $ 2d < ###FJ   4    X    9    H    ,      D$*%%--// dn--5577t//7799 $$TD$AAAJDLYYY| 4 222 3 3 3q  mmm#*----qqqqq  mmm#*----qqqqq  &1&&SZ8888qqqqqs1 CF H;G H;G22 H;?1H66H;__main__)F) rrrrrrrr r r r r )r r9)__doc__ __future__rrMr%rXr rZpathlibrr8r___name__exitr7rhs$,#"""""  }F}F}F}F}F@hhhhV z CHTTVVrg