- Role
- Built the dashboard and alerting
- Context
- Generative AI from AWS Bedrock rolled out to all employees, with access restricted behind a VPN
- Stack
- AWS Bedrock, databases, a dashboard, Slack
The problem
Bedrock charges by token. Once the whole company has access, spend depends on how each person uses it, and nobody can see that until the bill arrives. Access sat behind a VPN to keep prompts and company data on the private network, but that said nothing about cost.
What I built
- A dashboard that reads token usage from the databases and calculates each user's cost.
- A weekly budget per user.
- A Slack alert that goes to a user who exceeds their weekly budget.
Why it matters
Spend becomes visible while it is happening, not at the end of the month. People hear about overuse straight away, in the tool they already use, and the team can adjust budgets from real usage data instead of guesses.