Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

webui内服务调用问题以及不使用webui如何开启GPT微调的多卡训练 #1924

Open
MCXCC303 opened this issue Jan 6, 2025 · 5 comments
Open

webui内服务调用问题以及不使用webui如何开启GPT微调的多卡训练 #1924

MCXCC303 opened this issue Jan 6, 2025 · 5 comments

Comments

@MCXCC303
Copy link

MCXCC303 commented Jan 6, 2025

我用的服务器开webui去启动其他服务会出现一些小问题（相当于没法用webui），远程通过webui启动UVR5服务、训练微调模型等时会出现以下报错：

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/type_adapter.py", line 271, in _init_core_attrs
    self.core_schema = _getattr_no_parents(self._type, '__pydantic_core_schema__')
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/type_adapter.py", line 55, in _getattr_no_parents
    raise AttributeError(attribute)
AttributeError: __pydantic_core_schema__

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/applications.py", line 113, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/gradio/route_utils.py", line 686, in __call__
    await self.simple_response(scope, receive, send, request_headers=headers)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/gradio/route_utils.py", line 702, in simple_response
    await self.app(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/routing.py", line 291, in app
    solved_result = await solve_dependencies(
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/dependencies/utils.py", line 666, in solve_dependencies
    ) = await request_body_to_args(  # body_params checked above
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/dependencies/utils.py", line 891, in request_body_to_args
    fields_to_extract = get_cached_model_fields(first_field.type_)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/_compat.py", line 659, in get_cached_model_fields
    return get_model_fields(model)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/_compat.py", line 285, in get_model_fields
    return [
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/_compat.py", line 286, in <listcomp>
    ModelField(field_info=field_info, name=name)
  File "<string>", line 6, in __init__
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/fastapi/_compat.py", line 111, in __post_init__
    self._type_adapter: TypeAdapter[Any] = TypeAdapter(
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/type_adapter.py", line 228, in __init__
    self._init_core_attrs(
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/type_adapter.py", line 290, in _init_core_attrs
    core_schema = schema_generator.generate_schema(self._type)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 610, in generate_schema
    schema = self._generate_schema_inner(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 863, in _generate_schema_inner
    return self._annotated_schema(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 1977, in _annotated_schema
    schema = self._apply_annotations(source_type, annotations)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 2056, in _apply_annotations
    schema = get_inner_schema(source_type)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_schema_generation_shared.py", line 84, in __call__
    schema = self._handler(source_type)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 2131, in new_handler
    schema = metadata_get_schema(source, get_inner_schema)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 2127, in <lambda>
    lambda source, handler: handler(source)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_schema_generation_shared.py", line 84, in __call__
    schema = self._handler(source_type)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 2037, in inner_handler
    schema = self._generate_schema_inner(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 884, in _generate_schema_inner
    return self.match_type(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 986, in match_type
    return self._match_generic_type(obj, origin)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 1014, in _match_generic_type
    return self._union_schema(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 1325, in _union_schema
    choices.append(self.generate_schema(arg))
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 610, in generate_schema
    schema = self._generate_schema_inner(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 884, in _generate_schema_inner
    return self.match_type(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 995, in match_type
    return self._unknown_type_schema(obj)
  File "/public/home/luod/.conda/envs/GPTSV39/lib/python3.9/site-packages/pydantic/_internal/_generate_schema.py", line 513, in _unknown_type_schema
    raise PydanticSchemaGenerationError(
pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set `arbitrary_types_allowed=True` in the model_config to ignore this error or implement `__get_pydantic_core_schema__` on your type to fully support it.

If you got this error by calling handler(<some type>) within `__get_pydantic_core_schema__` then you likely need to call `handler.generate_schema(<some type>)` since we do not call `__get_pydantic_core_schema__` on `<some type>` otherwise to avoid infinite recursion.

For further information visit https://errors.pydantic.dev/2.10/u/schema-for-unknown-type

但是直接用配置文件运行s1_train.py和s2_train.py是可以正常训练的

s2_train.py的配置文件tmp_s2.json里面改gpu_numbers字段可以开启SoVITS的多卡训练，但是在tmp_s1.yaml没找到类似的字段，用本地的配置文件上传去运行也只使用了一张卡

同时希望指南里面能附带一些不使用webui的使用方法
@XXXXRT666
Copy link
Contributor

pydantic和fastapi还有pydantic-core全删了，升级gradio到5.0以前的较新版

@zgwsdmw
Copy link

zgwsdmw commented Jan 9, 2025

pydantic和fastapi还有pydantic-core全删了，升级gradio到5.0以前的较新版

可是但是这样就会提示缺少库，
ModuleNotFoundError: No module named 'pydantic'
ModuleNotFoundError: No module named 'fastapi'

@zgwsdmw
Copy link

zgwsdmw commented Jan 9, 2025

可否提供一下你的不使用webui的方法，我直接运行s2_train.py遇到了一些麻烦

@XXXXRT666
Copy link
Contributor

升级gradio会自动装库

@zgwsdmw
Copy link

zgwsdmw commented Jan 11, 2025

Reference in

感谢解答！太感谢了！我折腾两天了！大救星！不过还有一点，如果还有人有类似的问题得下4.44.1，我之前下了4.40.0，4.24.0都会报错

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@zgwsdmw @MCXCC303 @XXXXRT666