Skip to content
live PRIMARY PRODUCT / MODEL ADAPTATION & ASSET OPERATIONS

LoRA & TTS Studio · Model adaptation workstation

Organize material cleaning, LoRA/TTS training, remote tasks, real-time logs and product reflow into a traceable model asset production workflow

belong to the system Level 1 Products · Model Adaptation & Asset Operations · Local materials and pod configurations enter preprocessing and quality reports. After manual confirmation, they are transferred to remote training through Hugging Face, and the model and test results are returned to the local (see Four-layer engineering chain)·Latest verification: 2026-09

01 / demo display

demo · screenshots · architecture snippets

The demo directly uses the interface structure and visual system of the current Studio SPA; training, testing, subcontracting, queue and dubbing pages can all be switched, and real SSH, keys, material paths, character pictures and remote execution codes are not included in the public package.

Open the complete Demo on a separate page ↗

02 / Position in the system

Training closed loop from data quality to asset return

The training task starts from the local image gallery and pod configuration, and then goes through preprocessing, quality reporting, manual confirmation, Hugging Face file transfer, remote training, queue and log, and then flows the model and test results back to the local.

Task records connect material versions, prototypes, parameter profiles, remote runs and final products. LoRA enters fixed sample test images, TTS enters export and synthesis audition, and the results are then handed over to Local Chat or other multi-modal scenarios for verification.

03 / Key judgments

Automatic scoring narrows the scope, and manual review determines the training data

Real film development verification found that a single sharpness score will rank pictures with eyes covered, side faces, and unbalanced compositions at the top. The workflow was therefore changed to a multi-metric gate of face detection, sharpness, face size, angle, perceptual deduplication and occlusion, and the candidates and quality reports were handed over to manual review.

On the desktop side, Edge app-mode hosts the work surface, FastAPI organizes preprocessing, task and asset interfaces; remote pods perform training, SSE returns progress and logs, and Hugging Face is responsible for data and model transfer. The tool only carries the process, and the quality conclusion is given by fixed samples, manual review and final audition.

Reading, form filling, quality preview and log inspection can be executed directly; operations that generate fees, change remote resources or delete data enter the confirm gate and continue after confirmation by the user.

04 / Current implementation

LoRA already has a complete product chain, and TTS is marked according to the smoke boundary.

ALoRA data quality

Face detection, clarity, face size, angle, perceived deduplication and occlusion form a previewable quality report, and manual review is retained after multi-index gates.

BRemote tasks and asset return

The pod GPU performs training, the queue saves the task sequence, SSE returns progress and logs, and the data and model are transferred through Hugging Face and returned to the local asset directory.

CStyle-Bert-VITS2

The independent training environment isolates image and voice dependencies, and the work surface covers progress, export and synthesis audition; the current public evidence only reaches real WAV smoke, and does not include full voice line production that is as mature as LoRA.

DRun confirmation gate

Browsing and analysis are kept frictionless; high-impact operations such as charges, remote resource changes, and data deletion must be confirmed by the user before execution.

05 / maintenance

What is the follow-up maintenance?

01

Reduce manual operations after exceptions - more stable recovery prompts and optional rescheduling for pod disconnection, OOM and network jitter compensation.

02

Simplify parameter confirmation — let the agent provide hyperparameter candidates, and the user decides on the confirm-gate.

03

Organize commonly used profiles - Precipitate differences in common parameters between SDXL and Flux into reusable configurations.

04

Shorten the reflow of results - reduce the need for manual processing when training products are tested in Local Chat scenarios.

05

Supplementary lightweight comparative evaluation - automatically eliminate fixed samples of baseline and trained LoRA, retaining manual final review.

06 / Iteration log

Version evolution·Problem driven

The following are the key iteration nodes of the training pipeline from manual adjustment of single-machine parameters to remote pod dual environment + remote file transfer channel stability. The structure of each record: What problems were encountered → What ideas were used to solve them. All versions are not listed, only nodes with engineering decision-making significance are listed.

2026-06-05

Fine signature + manual review. Problem: High scores in multi-dimensional automatic scoring are still mixed with covered eyes/profiles/faces, and the original labels of the data set are also dirty. Solution: Automatic scoring → top candidates → manual review to keep clean exemplars, scalar vectors as true values, and discard the original labels of the data set.

2026-06-05

Multi-dimensional data screening. Problem: Single indicator (sharpness) cannot capture composition/expression/diversity in film selection, and 80% of high scores are false positives. Solution: Segmentation model to calculate occlusion + hash deduplication + angle soft gate + perceptual deduplication, real-time dynamic weighting, low memory machine limit concurrency explosion prevention.

2026-06-04

The pod basic environment is unified. Problem: The bare image lacks common libraries, and multiple bootstrap scripts drift separately. Solution: The unified baseline script automatically completes dependencies, and the channel dynamically pulls versions, which is compatible with multiple generations of pods.

2026-06-02

TTS training environment isolation. Problem: The deep learning library version required by the TTS framework conflicts with image training, and the port is occupied by the default service. Solution: The independent virtual environment is not shared with the main environment, port offset is used to avoid conflicts, and the entire environment is installed on the local disk.

2026-06-02

LoRA dim dimension empirical fallback. Problem: The textbook route believes that the higher the dimension, the more details can be contained, so adjust it to dim 64. Solution: Use the same seed and prompt to evaluate 10 pictures, dim 32 full is inversely proportional to dim 64, which is closer to me, and the high capacity can learn noise in small data sets. Rewind dim ≤ 32, and the control variable is evaluated as a rule.

2026-06-01

Automatic image verification panel after training. Problem: After training, you can only manually pull the weights to run the local image for verification, and the feedback link is too long. Solution: Add an API endpoint to directly drive the remote image verification, use the transit channel to export the image, and the front-end skeleton loading experience.

2026-06-01

Hugging Face relay replaces SFTP direct transmission. Problem: The single thread of the original direct transmission protocol crushes the bandwidth (14 times slower), the marking tool is loaded into the main environment and pollutes the deep learning library, and the root disk 17 GB is full of logs. Solution: Data/models/logs are uniformly transferred through Hugging Face, the marking tool isolates the virtual environment, and the cache directory is diverted to avoid root disk explosion.

2026-05-31

The training and graph verification co-locate in the same pod. Problem: The deep learning library versions of the training framework and the graph verification framework conflict, and GPU memory contention. Solution: Isolate the virtual environment with independent site packages, model paths point to the same directory, and multi-layer smoke passes.

2026-05-31

Multi-base model hyperparameter profile. Problem: The optimal learning rate, noise, and SNR coefficient of different base models (SDXL / Flux / RealVisXL, etc.) vary greatly, and manual switching is prone to errors. Solution: The built-in realistic mode switch links a set of hyperparameters with one click, and the real machine's video memory usage is stable and does not overflow.

The above nodes involve training pipeline stability, hyperparameter control strategy, data cleaning system and remote environment consistency. The complete iteration is far more than this.

System/Module