Fine-Tuning GPT-4o-mini on Your Own Data: A Practical Guide

Create a fine-tuning job:

job = client.fine_tuning.jobs.create(
    training_file=file.id,
    model="gpt-4o-mini-2024-07-18",
    hyperparameters={
        "n_epochs": 3,  # 2-4 epochs is usually optimal
    }
)
print(f"Job ID: {job.id}")
print(f"Status: {job.status}")

Monitor progress:

import time

while True:
    job = client.fine_tuning.jobs.retrieve(job.id)
    print(f"Status: {job.status}")
    if job.status in ["succeeded", "failed", "cancelled"]:
        break
    time.sleep(60)

if job.status == "succeeded":
    print(f"Model: {job.fine_tuned_model}")

Training typically takes 10-30 minutes for 50-100 examples.

Once training completes, use your model like any other OpenAI model:

response = client.chat.completions.create(
    model=job.fine_tuned_model,  # ft:gpt-4o-mini-2024-07-18:your-org::xxx
    messages=[
        {"role": "system", "content": "You are a legal document summarizer."},
        {"role": "user", "content": "Summarize this clause: ..."}
    ]
)
print(response.choices[0].message.content)

Fine-tuned gpt-4o-mini costs $0.30 per million input tokens and $1.20 per million output tokens — about 2x the base model price, but you'll typically use fewer tokens because you need shorter prompts.

After fine-tuning dozens of models, here's what actually makes a difference:

• 1. Quality > quantity — 50 perfect examples beat 500 sloppy ones
• 2. Be consistent — same system prompt, same output format in every example
• 3. Include negative examples — show the model what NOT to do
• 4. Start with 3 epochs — more epochs can cause overfitting on small datasets
• 5. Test against base model — run the same 20 test cases on both models to measure improvement
• 6. Iterate — add examples where the fine-tuned model fails, then retrain

Fine-tuning is not a one-shot process. The best models go through 3-5 iterations of training data refinement.