Long-Term Analysis of Langfuse LLM Traces with ClickHouse
A verification log on normalizing Langfuse Observations and Scores into ClickHouse, then using SQL to inspect model-level cost, prompt-version quality trends, and retry-driven cost increases.
Tag
A verification log on normalizing Langfuse Observations and Scores into ClickHouse, then using SQL to inspect model-level cost, prompt-version quality trends, and retry-driven cost increases.
A verification article on sending a generate, evaluate, feedback, and regenerate loop to Langfuse so the improvement path can be traced by attempt, not just by final output.
A validation note on sending a failed Eve weather-tool eval to Langfuse, comparing the failed run with a revised run, and improving the evaluation criteria.
Testing the Langfuse Assistant public beta against existing Sakana Fugu observations and ground truth calculated through the Public API.
A hands-on report instrumenting Sakana Fugu's OpenAI-compatible API with Langfuse, measuring how latency, token consumption, and TTFT change across Level 1–3 tasks.
I subscribed to Sakana Fugu to understand its nature as an OpenAI-compatible API and to plan how to observe its black-box cooperative reasoning from the outside.
An experiment log where I redact Flue 1.0 Beta observe events before sending them to Langfuse, tracking the issue triage workflow's runId, model, and results.
A hands-on comparison of two ways to send Eve tool-calling executions to Langfuse as trace/span/generation data.
A practical experiment that aggregates Langfuse traces in a Cloudflare Worker and sends only token, cost, and latency anomalies to Slack.
Manually checking traces every day is unsustainable. A personal GenAIOps plan to aggregate Langfuse failures, token spikes, and low-score outputs into a single Slack morning briefing.