Texas Workforce Commission

General System Information
Baseline Model	GPT-4.o
Developer	Microsoft
Application and Description	LARRY uses a pre-trained generative model from Microsoft, and the TWC website is the main data source for the agent.

Data Sources & Usage
Base Model Supplemented with Governmental Entity Data Does the governmental entity use external knowledge sources to supplement the base model with additional entity-specific data?	Yes LARRY uses a pre-trained generative model from Microsoft, and the TWC website is the main data source for the chatbot.
System Uses Data Inputs for Training Is the AI system trained using data inputs after initial implementation?	No
Data Sharing Are the data inputs or outputs shared outside the governmental entity?	No

Privacy & Ethics Measures
Testing Did testing occur prior to deployment to evaluate accuracy, consistency, and fairness?	Yes TWC subject matter experts participated in User Acceptance Testing to ensure responses were consistent with agency expectations. Testing included content verification, accuracy validation, and accessibility testing.
Human Oversight Does a human review and monitor the outputs of the AI system?	Yes TWC staff periodically reviews the agent conversation history and make updates the source documentation as needed.
Data Retention and Deletion Are data inputs and outputs automatically deleted?	Yes LARRY retains inputs and outputs for 30 days, and they are deleted after that time.
User Feedback Are end users given a method to provide feedback or dispute the outputs?	Yes The thumbs up/down buttons allow users to quickly provide feedback on the quality or usefulness of a response. This feedback can be used to improve future responses by updating the source documentation while giving users a simple way to indicate satisfaction or flag issues.
Data Security Are security measures in place to encrypt any sensitive input data when stored or transmitted?	Yes Microsoft Copilot encrypts sensitive input data and conversations in transit using TLS and at rest using AES-256 encryption within Microsoft's secure cloud infrastructure.

AI System Facts - Larry