Customer Service

Choosing a support assistant's next actions on a customer's turn.

A customer is actively asking for support. What should the assistant do next?

Input
The conversationevery turn so far, from both sides
The customer recordwho they are and what they have contacted us about before
The accountsubscription, recent charges, refunds and card status
A pending proposalwhatever the assistant last offered and is waiting on
Output any that apply, sometimes none
SAYREFUNDFREEZE CARDSET INTENTHAND OFFFLAG FOR REVIEWCLOSE
Lens
Customer Service: accuracy against cost and time
TypeSafeOpenAIAnthropicFireworksworkflowprompt
frontier: nothing is both cheaper and more accurate
10%30%50%70%90%$0.0001$0.001$0.01$0.1$1cost per case, USD (log)accuracyhaiku 4.5 · workflow · 55.4% · $0.0074 · 8.8 shaiku 4.5haiku 4.5 · prompt · 19.9% · $0.0459 · 7.6 shaiku 4.5opus 5 · workflow · 72.4% · $0.0579 · 16.6 sopus 5opus 5 · prompt · 66.0% · $0.3710 · 42.2 sopus 5sonnet 5 · workflow · 69.3% · $0.0264 · 14.3 ssonnet 5sonnet 5 · prompt · 61.6% · $0.2085 · 96.7 ssonnet 5DS v4 flash · workflow · 76.8% · $0.0029 · 34.6 sDS v4 flash · prompt · 65.8% · $0.0139 · 93.9 sDS v4 flashDS v4 pro · workflow · 76.1% · $0.0232 · 58.6 sDS v4 proDS v4 pro · prompt · 65.8% · $0.0898 · 134.9 sDS v4 proluna · workflow · 71.4% · $0.0013 · 8.8 slunaluna · prompt · 56.9% · $0.0094 · 19.2 slunasol · workflow · 78.3% · $0.0323 · 10.1 ssol · prompt · 69.0% · $0.2303 · 24.9 ssolterra · workflow · 72.7% · $0.0111 · 6.0 sterraterra · prompt · 64.4% · $0.0894 · 16.3 sterraJev · workflow · 76.0% · $0.0001 · 0.4 sDS v4 flashsolJev

The workflow

1
Intent, frustration and risk flags

Eleven readings of the conversation at once: what the customer wants and how they want it resolved, how frustrated they sound, how urgent it is, and flags such as unauthorized activity, a legal threat, or a request for a person.

2
Consent, fraud, money, retention

Four follow-ups, plus a tie-break when two intents are close. Each runs only when the first reading calls for it, with the records it needs attached: the pending proposal, the ledger and card status, the refund or fee on file, the subscription.

3
Check the assistant's claims

The assistant's own messages are compared with the record: did it tell the customer a refund had gone through, or that the card was frozen, when neither had happened?

4
Safety first, then the issue at hand

Nine sections run top to bottom: safety, the assistant's claims, a pending proposal, handing off, closing, then the issue itself. The first rule that applies in a section emits its actions; when none applies, the next section runs.

One customer turnthe conversation so far ·the customer record · whatis on the account · anypending proposalWhat is going on?Eleven readings of the conversation:reads the conversation, the customer record and a summary of theaccountwhat the customer's issue is, out of eight kindswhat they want: money back, a fix, an explanation, aperson, or unsaidhow frustrated they are, from calm to hostilehow time-critical it is, from none to emergencythey report a charge or login they did not makethey threaten legal or regulatory actionthey threaten a chargeback, a public post, or the pressthey ask for a persona full card number, PIN, password or SSN is in the textthey say the issue is resolvedthey say the company or assistant got something wrongwhich follow-upsdoes triage callfor?every one whosecondition holds;often nonea proposal is pendingConsent:the proposal and the reply only; earlier turns removedhow they answer the proposal: accept, decline, oruncleartheir yes asks for different termsunauthorized activity isin play (P ≥ 0.30, or itleads the intents)Fraud:adds the ledger entry and the card statuswhether they still have the cardthey now recognize the charge as their ownsomeone with access to the card made itthey report other activity they do not recognizelogin codes, a changed email, an unknown devicewhat they describe matches the ledger entrymoney is on the table (P ≥0.20 or a money intentleads) and a claim or feeis on fileMoney:adds the claim or fee on file, and the orderwhy they want money back, out of six reasonsthe amount they ask for against the amount on filethey say they were already refunded or creditedthey offer photos, receipts, tracking or a confirmationfinancial hardship, from none to a crisiscancelling is in play (P ≥0.15 with an activesubscription, or it leads)Retention:adds the subscription recordhow likely they are to leave, from no sign to decidedwhy they want to cancel, out of five reasonsthey would stay if something were offered or fixedthe two leading intentsare within 0.25 of eachotherIntent, two ways:the customer's own turns onlywhich of the two leading intents fits betternone of themcode then re-splits the intent between the two options,and folds each message's claims into one probabilitythe fraud ormoney node ran,and theassistant hasspokenyesIntegrity, per new assistant message:reads the assistant's numbered messages and the recordthe message says a refund was already issuedthe message says the card is already securednoevery answer, merged, goes to the policySafety, checked before anything elsecredentials exposedREDACTREDACTSAY warn not to share credentialsSAY warn not to share credentialslegal or regulatory threatHAND OFF complianceHAND OFF complianceFLAG legal threatFLAG legal threatSAY handoff noticeSAY handoff noticechargeback or public threat (the turn continues)FLAG public complaint threatFLAG public complaint threatWhat the assistant claimed, against the recordclaimed a refund the record does not showFLAG agent errorFLAG agent errorHAND OFF supervisorHAND OFF supervisorSAY apologize and correctSAY apologize and correctclaimed the card was secured while it is activeFLAG agent errorFLAG agent errorHAND OFF securityHAND OFF securitySAY apologize and correctSAY apologize and correctAnswering a pending proposalaccepted, but on different termsSAY ask desired outcomeSAY ask desired outcomefreeze acceptedFREEZE CARDFREEZE CARDCLEAR PENDINGCLEAR PENDINGSAY confirm card frozenSAY confirm card frozenHAND OFF securityHAND OFF securityfreeze declinedCLEAR PENDINGCLEAR PENDINGSAY acknowledge no freezeSAY acknowledge no freezeHAND OFF securityHAND OFF securityrefund accepted, smallREFUNDREFUNDCLEAR PENDINGCLEAR PENDINGSAY confirm refund issuedSAY confirm refund issuedRESOLVEDRESOLVEDrefund accepted, largeCLEAR PENDINGCLEAR PENDINGHAND OFF refundsHAND OFF refundsSAY explain refund under reviewSAY explain refund under reviewrefund declinedCLEAR PENDINGCLEAR PENDINGSAY ask desired outcomeSAY ask desired outcomecancellation acceptedCANCELCANCELCLEAR PENDINGCLEAR PENDINGSAY confirm cancellationSAY confirm cancellationRESOLVEDRESOLVEDcancellation declinedCLEAR PENDINGCLEAR PENDINGSAY closing acknowledgementSAY closing acknowledgementdispute acceptedOPEN DISPUTEOPEN DISPUTECLEAR PENDINGCLEAR PENDINGSAY confirm dispute openedSAY confirm dispute openedHAND OFF securityHAND OFF securitydispute declinedCLEAR PENDINGCLEAR PENDINGSAY ask desired outcomeSAY ask desired outcomehardship referral acceptedCLEAR PENDINGCLEAR PENDINGHAND OFF hardshipHAND OFF hardshipSAY handoff noticeSAY handoff noticehardship referral declinedCLEAR PENDINGCLEAR PENDINGSAY explain charge or policySAY explain charge or policyHanding off to a personasks for a personHAND OFF generalHAND OFF generalSAY handoff noticeSAY handoff noticehostileHAND OFF supervisorHAND OFF supervisorFLAG abusive customerFLAG abusive customerSAY handoff noticeSAY handoff noticeangryHAND OFF supervisorHAND OFF supervisorSAY handoff noticeSAY handoff noticealleges an errorFLAG agent errorFLAG agent errorHAND OFF supervisorHAND OFF supervisorSAY apologize and correctSAY apologize and correctClosingresolvedRESOLVEDRESOLVEDCLOSECLOSESAY closing acknowledgementSAY closing acknowledgementno rule fired yetRecording the intentintent unclearSAY ask clarify issueSAY ask clarify issueintent clear (the turn continues)SET INTENTSET INTENTUnauthorized activity: the investigation treeexplained after allSAY explain charge or policySAY explain charge or policycard lost or stolenPENDING freeze cardPENDING freeze cardPRIORITY urgentPRIORITY urgentSAY propose card freezeSAY propose card freezeaccount takeoverPENDING freeze cardPENDING freeze cardPRIORITY urgentPRIORITY urgentHAND OFF securityHAND OFF securitySAY propose card freezeSAY propose card freezepossession not statedSAY ask card in possessionSAY ask card in possessioncard in hand, details do not matchSAY ask charge detailsSAY ask charge detailscard in hand, card-present chargePENDING freeze cardPENDING freeze cardPRIORITY highPRIORITY highSAY propose card freezeSAY propose card freezecard in hand, remote chargePENDING freeze cardPENDING freeze cardPRIORITY highPRIORITY highSAY propose card freezeSAY propose card freezecard in hand, nothing on fileSAY ask charge detailsSAY ask charge detailscard already frozenHAND OFF securityHAND OFF securitySAY handoff noticeSAY handoff noticeMoney backhardshipPENDING hardship referralPENDING hardship referralSAY offer hardship optionsSAY offer hardship optionsalready compensatedSAY explain charge or policySAY explain charge or policyasks for more than the recordHAND OFF refundsHAND OFF refundsSAY explain refund under reviewSAY explain refund under reviewno reason yetSAY ask refund reasonSAY ask refund reasonpropose a small refundPENDING issue refundPENDING issue refundSAY propose refundSAY propose refundrefund needs a personHAND OFF refundsHAND OFF refundsSAY explain refund under reviewSAY explain refund under reviewnot eligibleSAY explain refund not eligibleSAY explain refund not eligiblenothing on fileSAY ask charge detailsSAY ask charge detailsOther issueslocked outSAY account recovery stepsSAY account recovery stepscard declined, strandedPRIORITY urgentPRIORITY urgentHAND OFF generalHAND OFF generalSAY handoff noticeSAY handoff noticecard declinedSAY explain charge or policySAY explain charge or policywants to cancelPENDING cancel subscriptionPENDING cancel subscriptionSAY propose cancellationSAY propose cancellationthinking of cancellingSAY ask cancellation reasonSAY ask cancellation reasonwhere is my orderSAY provide order statusSAY provide order statuswhich orderSAY ask order detailsSAY ask order detailsgeneralSAY explain charge or policySAY explain charge or policyfallbackSAY ask clarify issueSAY ask clarify issueeach dot is one action the rule emits,in its family's colour; hover to name it1INTENT, FRUSTRATION AND RISK FLAGS2CONSENT, FRAUD, MONEY, RETENTION3CHECK THE ASSISTANT'S CLAIMS4SAFETY FIRST, THEN THE ISSUE AT HAND: SECTIONS RUN TOP TO BOTTOM, AND THE FIRST RULE THAT APPLIES IN A SECTION EMITS ITS ACTIONS
One customer turnthe conversation so far ·the customer record · whatis on the account · anypending proposalWhat is going on?Eleven readings of the conversation:reads the conversation, the customer record and a summary of theaccountwhat the customer's issue is, out of eight kindswhat they want: money back, a fix, an explanation, aperson, or unsaidhow frustrated they are, from calm to hostilehow time-critical it is, from none to emergencythey report a charge or login they did not makethey threaten legal or regulatory actionthey threaten a chargeback, a public post, or the pressthey ask for a persona full card number, PIN, password or SSN is in the textthey say the issue is resolvedthey say the company or assistant got something wrongwhich follow-upsdoes triage callfor?every one whosecondition holds;often nonea proposal is pendingConsent:the proposal and the reply only; earlier turns removedhow they answer the proposal: accept, decline, oruncleartheir yes asks for different termsunauthorized activity isin play (P ≥ 0.30, or itleads the intents)Fraud:adds the ledger entry and the card statuswhether they still have the cardthey now recognize the charge as their ownsomeone with access to the card made itthey report other activity they do not recognizelogin codes, a changed email, an unknown devicewhat they describe matches the ledger entrymoney is on the table (P ≥0.20 or a money intentleads) and a claim or feeis on fileMoney:adds the claim or fee on file, and the orderwhy they want money back, out of six reasonsthe amount they ask for against the amount on filethey say they were already refunded or creditedthey offer photos, receipts, tracking or a confirmationfinancial hardship, from none to a crisiscancelling is in play (P ≥0.15 with an activesubscription, or it leads)Retention:adds the subscription recordhow likely they are to leave, from no sign to decidedwhy they want to cancel, out of five reasonsthey would stay if something were offered or fixedthe two leading intentsare within 0.25 of eachotherIntent, two ways:the customer's own turns onlywhich of the two leading intents fits betternone of themcode then re-splits the intent between the two options,and folds each message's claims into one probabilitythe fraud ormoney node ran,and theassistant hasspokenyesIntegrity, per new assistant message:reads the assistant's numbered messages and the recordthe message says a refund was already issuedthe message says the card is already securednoevery answer, merged, goes to the policySafety, checked before anything elsecredentials exposedREDACTREDACTSAY warn not to share credentialsSAY warn not to share credentialslegal or regulatory threatHAND OFF complianceHAND OFF complianceFLAG legal threatFLAG legal threatSAY handoff noticeSAY handoff noticechargeback or public threat (the turn continues)FLAG public complaint threatFLAG public complaint threatWhat the assistant claimed, against the recordclaimed a refund the record does not showFLAG agent errorFLAG agent errorHAND OFF supervisorHAND OFF supervisorSAY apologize and correctSAY apologize and correctclaimed the card was secured while it is activeFLAG agent errorFLAG agent errorHAND OFF securityHAND OFF securitySAY apologize and correctSAY apologize and correctno rule fired yetAnswering a pending proposalaccepted, but on different termsSAY ask desired outcomeSAY ask desired outcomefreeze acceptedFREEZE CARDFREEZE CARDCLEAR PENDINGCLEAR PENDINGSAY confirm card frozenSAY confirm card frozenHAND OFF securityHAND OFF securityfreeze declinedCLEAR PENDINGCLEAR PENDINGSAY acknowledge no freezeSAY acknowledge no freezeHAND OFF securityHAND OFF securityrefund accepted, smallREFUNDREFUNDCLEAR PENDINGCLEAR PENDINGSAY confirm refund issuedSAY confirm refund issuedRESOLVEDRESOLVEDrefund accepted, largeCLEAR PENDINGCLEAR PENDINGHAND OFF refundsHAND OFF refundsSAY explain refund under reviewSAY explain refund under reviewrefund declinedCLEAR PENDINGCLEAR PENDINGSAY ask desired outcomeSAY ask desired outcomecancellation acceptedCANCELCANCELCLEAR PENDINGCLEAR PENDINGSAY confirm cancellationSAY confirm cancellationRESOLVEDRESOLVEDcancellation declinedCLEAR PENDINGCLEAR PENDINGSAY closing acknowledgementSAY closing acknowledgementdispute acceptedOPEN DISPUTEOPEN DISPUTECLEAR PENDINGCLEAR PENDINGSAY confirm dispute openedSAY confirm dispute openedHAND OFF securityHAND OFF securitydispute declinedCLEAR PENDINGCLEAR PENDINGSAY ask desired outcomeSAY ask desired outcomehardship referral acceptedCLEAR PENDINGCLEAR PENDINGHAND OFF hardshipHAND OFF hardshipSAY handoff noticeSAY handoff noticehardship referral declinedCLEAR PENDINGCLEAR PENDINGSAY explain charge or policySAY explain charge or policyHanding off to a personasks for a personHAND OFF generalHAND OFF generalSAY handoff noticeSAY handoff noticehostileHAND OFF supervisorHAND OFF supervisorFLAG abusive customerFLAG abusive customerSAY handoff noticeSAY handoff noticeangryHAND OFF supervisorHAND OFF supervisorSAY handoff noticeSAY handoff noticealleges an errorFLAG agent errorFLAG agent errorHAND OFF supervisorHAND OFF supervisorSAY apologize and correctSAY apologize and correctno rule fired yetClosingresolvedRESOLVEDRESOLVEDCLOSECLOSESAY closing acknowledgementSAY closing acknowledgementRecording the intentintent unclearSAY ask clarify issueSAY ask clarify issueintent clear (the turn continues)SET INTENTSET INTENTUnauthorized activity: the investigation treeexplained after allSAY explain charge or policySAY explain charge or policycard lost or stolenPENDING freeze cardPENDING freeze cardPRIORITY urgentPRIORITY urgentSAY propose card freezeSAY propose card freezeaccount takeoverPENDING freeze cardPENDING freeze cardPRIORITY urgentPRIORITY urgentHAND OFF securityHAND OFF securitySAY propose card freezeSAY propose card freezepossession not statedSAY ask card in possessionSAY ask card in possessioncard in hand, details do not matchSAY ask charge detailsSAY ask charge detailscard in hand, card-present chargePENDING freeze cardPENDING freeze cardPRIORITY highPRIORITY highSAY propose card freezeSAY propose card freezecard in hand, remote chargePENDING freeze cardPENDING freeze cardPRIORITY highPRIORITY highSAY propose card freezeSAY propose card freezecard in hand, nothing on fileSAY ask charge detailsSAY ask charge detailscard already frozenHAND OFF securityHAND OFF securitySAY handoff noticeSAY handoff noticeno rule fired yetMoney backhardshipPENDING hardship referralPENDING hardship referralSAY offer hardship optionsSAY offer hardship optionsalready compensatedSAY explain charge or policySAY explain charge or policyasks for more than the recordHAND OFF refundsHAND OFF refundsSAY explain refund under reviewSAY explain refund under reviewno reason yetSAY ask refund reasonSAY ask refund reasonpropose a small refundPENDING issue refundPENDING issue refundSAY propose refundSAY propose refundrefund needs a personHAND OFF refundsHAND OFF refundsSAY explain refund under reviewSAY explain refund under reviewnot eligibleSAY explain refund not eligibleSAY explain refund not eligiblenothing on fileSAY ask charge detailsSAY ask charge detailsOther issueslocked outSAY account recovery stepsSAY account recovery stepscard declined, strandedPRIORITY urgentPRIORITY urgentHAND OFF generalHAND OFF generalSAY handoff noticeSAY handoff noticecard declinedSAY explain charge or policySAY explain charge or policywants to cancelPENDING cancel subscriptionPENDING cancel subscriptionSAY propose cancellationSAY propose cancellationthinking of cancellingSAY ask cancellation reasonSAY ask cancellation reasonwhere is my orderSAY provide order statusSAY provide order statuswhich orderSAY ask order detailsSAY ask order detailsgeneralSAY explain charge or policySAY explain charge or policyfallbackSAY ask clarify issueSAY ask clarify issueeach dot is one action the rule emits,in its family's colour; hover to name it1INTENT, FRUSTRATION AND RISK FLAGS2CONSENT, FRAUD, MONEY, RETENTION3CHECK THE ASSISTANT'S CLAIMS4SAFETY FIRST, THEN THE ISSUE AT HAND: SECTIONS RUN TOP TO BOTTOM, AND THE FIRST RULE THAT APPLIES IN A SECTION EMITS ITS ACTIONS
ActionHand to a personDoSayRecord
QuestionsNoulScoreChoice