}t|¡}Wdƒn1s&wYtd|›�¡|S)z!Load configuration from YAML filezConfiguration file not found: Úrzutf-8)ÚencodingNzLoaded configuration from: )rÚexistsÚFileNotFoundErrorÚopenÚyamlÚ safe_loadÚloggerÚinfo)r r
Zconfig_fileÚfrr
r
rÚload_yaml_configsÿzConfigManager.load_yaml_configÚyaml_configÚcli_argscCs4|¡}|¡D]\}}|dur||||¡q|S)z4Merge YAML configuration with command-line argumentsN)ÚcopyÚitemsÚ_set_nested_value)r rrÚ
|||d<dS)zMSet a nested value in config using dot notation (e.g., 'training.batch_size')Ú.Néÿÿÿÿ)Úsplit)r rr r!ÚkeysÚcurrentÚkr
r
rr's
zConfigManager._set_nested_valueNÚdefaultcCs>|d¡}|}|D]}t|tƒr||vr||}q |S|S)z1Get a nested value from config using dot notationr#)r%Ú
isinstanceÚdict)r rr r)r&r'r(r
r
rÚget_config_value3s
zConfigManager.get_config_valueú Pipeline with YAML configurationÚdescriptioncCs0tj|d�}|jdtdd�|jdddgdd �|jd
tdd�|jdtd
d�|jdgd¢dd �|jdtdd�|jdtdd�|jdtdd�|jdtdd�|jdtdd�|jdtdd�|jdtdd�|jdtd d�|jd!td"d�|jd#td$d�|jd%gd&¢d'd �|jd(gd)¢d*d �|S)+z6Create argument parser that supports YAML config files)r.z--configzPath to YAML configuration file)ÚtypeÚhelpz
--data-sourceZhuggingfaceZcustomzData source)Úchoicesr0z--dataset-namezHuggingFace dataset namez--data-pathzPath to custom data filez
--data-format)ZjsonlZcsvÚjsonzData formatz
--input-fieldzInput field namez
--label-fieldzLabel field namez
--max-sampleszMaximum samples to processz--output-dirzOutput directoryz--model-namez
Model namez--max-lengthzMaximum sequence lengthz--num-epochszNumber of epochsz--batch-sizez
Batch sizez--learning-ratez
Learning ratez--model-pathzPath to saved modelz--device)ÚautoÚcudaÚcpuZDevicez--log-level)ÚDEBUGÚINFOZWARNINGZERRORz Log level)ÚargparseÚArgumentParserÚadd_argumentÚstrÚintÚfloat)r r.Úparserr
r
rÚcreate_argparser_with_yaml@s&z(ConfigManager.create_argparser_with_yamlcCsFi}|r ||¡}|pi}dd„|¡Dƒ}|||¡}td¡|S)z-Load YAML config and merge with CLI argumentscSsi|]\}}|dur||“qSrr
