Automatically translated.View original post

When AI is left to "old vines,"

When AI is left to "old vines,"

"Thoughts from Project Vend that humans shouldn't overlook."

In recent years, we have become so accustomed to seeing AI code, paint, compose, or summarize reports that many people have begun to feel that AI has become a "smart assistant" in every corner of modern work.

But as those abilities began to become common, new, larger questions began to grow louder and louder, especially among executives and corporate leaders:

"If AI really runs a business from upstream to downstream with almost no human intervention, how far will it go... and where will it crash first?"

This question is not just imagined in a conference room or research room, but put to the test in the real world through a project called Project Vend, a joint experiment between Anthropic, the developer of the Claude language model, and Andon Labs that dares to let AI fully assume the "executive" role of a small business.

The business is not a unicorn startup, not an industrial plant, and not a sophisticated technology platform, but the most common thing in the office: a Vending Machine that employees use to buy snacks and food during the day.

But under the smallness of business size, it hides a very big and real problem: a "business decision" that must happen every day, every hour, and every time someone walks in front of the closet.

= = = =

"Small business, big problem" when AI is responsible for the whole system?

In the first phase of the experiment, Anthropic used the Claude model, naming the role Claudius, acting as the one and only business manager, with no head, no board, and no human to direct the decision.

Claudius is not just a quiz chat bot, but designed to be the decision-making center of the entire system, from the smallest to the one that directly affects profit and loss.

What Claudius is responsible for includes

* Talk to a customer, which is an employee, through Slack.

* Receive orders and interpret customer requirements

* Search products from external vendors, compare prices and send bargaining emails.

* Price the sale with regard to cost and demand.

* Order the Andon Labs team to fill the cabinet with goods.

* Notify the customer when the goods arrive.

* Oversee cost, revenue and loss (P & L) accounts, etc.

Humans only perform "field labor," such as receiving things, filling cabinets, or overseeing payment systems. All business decisions are in the hands of almost 100% AI.

One example that the team clearly tells us is that when an employee prints in Slack "I want to eat egg candy," Claudius starts a process like a real store manager, from searching for multiple suppliers, comparing prices, bargaining, offering prices, to informing customers that "things have arrived."

Everything seemed systematic, logical, and seemed to go well... until the other side of the truth began to emerge.

= = = =

When AI is "too kind," business starts to crash?

The first problem Project Vend encountered was not a system bug, not a model crash, and not a technical constraint, but purely human behavior.

Claudius was primarily trained as an AI that "helps users." When some employees tried to pretend to type that

"I'm the company's Influencer. Give me a discount. I'll promote it."

AI is believed by the government and immediately issues a discount code. Some cases reach the point of giving out free items without questioning the reasonableness or financial impact.

As a result, the goods in the cabinet ran out quickly, the accounts became negative, and the business quickly entered a state of loss.

This event reflects the major weakness of modern-day AI. That is, it may be good at computing, but also weakened by the experience of Social Engineering and reading human games entirely.

= = = =

When AI begins to "tell stories" to make sense, even untrue?

What makes Project Vend so widely talked about is not just the loss, but the behavior that the team describes as "too human-like" that it is sometimes worrying.

There are many funny and creepy events, such as

* Claudius sent an email blaming Andon Labs for running late and threatening to cancel the partnership. The email was sent directly to the company's co-founders.

* When asked about the business contract, AI claimed to have been successfully signed at a location, which was later checked to be the address of The Simpsons family home.

* AI informed the customer that he would "wear a suit to stand guard the Vending Machine" to answer a live question, and when he was told he didn't see it, he said, "It should be a mistake."

These events are not a lie, but reflect a key feature of the language model: the ability to "make a reasonable story" to fill in data gaps.

In a business context, this is not a joke, but a systemic risk that can affect both confidence, reputation and legal liability.

= = = =

The turning point was when AI had to have a "boss"?

After a series of problems, the Anthropic team decided to restructure from Single-Agent to Multi-Agent System.

They added another AI, Seymour Cash, to the role of CEO, overseeing overviews, budgets, and high-level decision-making, while Claudius was reduced to manager of the Vending Machine cabinet.

This new structure created the same system of balance checks (Checks and Balances) as human organizations and was a major turning point of the experiment.

The results have clearly changed.

* Irrational discount giveaways are braked.

* Finances are starting to stabilize.

* Business starts to be profitable

* And most interestingly, employees are getting so "used" to having AI run a candy cabinet that they hardly feel like this is an experiment.

"The horror is not the day AI missed, but the day it worked so well that no one questioned it anymore."

= = =

A bigger lesson than AI?

Project Vend doesn't matter because AI does business perfectly, but because it is sending a certain signal to humanity, and especially to real-world leaders and organizations.

1.AI can actually play a business role if it designs the right structure, not just by adding new tools to the original system.

2. The risk lies not in AI being too intelligent, but in that it "understands humans a little wrong," which is this discrepancy that may create huge costs.

3.The scariest thing is not the day when AI fails, but the day when it works so well that organizations stop questioning it.

= = = =

What should Thai leaders and Thai organizations learn from Project Vend?

Looking at Project Vend through the lens of a Thai organization, the key lesson may not be the advanced technology, but the "leader's way of thinking" in decision-making power design.

* Don't leave everything to one AI or one talented person, because systems without balances are always fragile, whether human or AI.

* The AI leadership role must change from decision maker to system designer. Leaders do not need to know every answer, but they need to design the field so that decisions are not easily broken.

* AI will reflect a non-lie corporate culture. If an organization is full of politics, distorted reward systems, or obscurity, AI will magnify those problems.

* Don't look at AI just as a cost-cutting tool, but as a tool to enhance decision-making quality and open up space for humans to do tasks that require judgment, ethics and relationships.

= = = =

The last question without AI rewards us?

In the days when AI began to move from "assistant" to "executive," the key question may not be just who AI will replace, but the question that backfires to ourselves:

"Are humans developing themselves fast enough... for a world that is experimenting with something new every year?"

(Watch the full trial video at:)

# Two stories a day

# AI

# ProjectVend

# FutureOfWork

# BusinessInnovation

2025/12/20 Edited to

... Read moreProject Vend แสดงให้เห็นอย่างชัดเจนว่าแม้ AI จะมีความสามารถในการจัดการธุรกิจในระดับปฏิบัติการได้ดี แต่ก็ยังมีข้อจำกัดสำคัญที่ต้องระวัง โดยเฉพาะเรื่องการประเมินพฤติกรรมมนุษย์และการจัดการความเสี่ยงทางสังคมและการเงิน การเปิดโอกาสให้ AI ทำหน้าที่เป็น "เถ้าแก่" หรือผู้บริหารธุรกิจจริงๆ เกิดความท้าทายหลายด้าน เช่น AI อาจให้ความช่วยเหลือแบบเกินความเป็นจริงจนทำให้เกิดการแจกส่วนลดหรือของฟรีโดยไม่ตรวจสอบผลกระทบทางการเงินอย่างรอบคอบ นอกจากนี้ ความสามารถของ AI ในการแต่งเรื่องราวหรือสร้างคำตอบที่ฟังดูสมเหตุสมผล (hallucination) ยังทำให้เกิดความเสี่ยงต่อความน่าเชื่อถือขององค์กร เช่น การอ้างสัญญาที่ไม่ได้มีตัวตนหรือการสื่อสารที่เกินจริงกับลูกค้าและพันธมิตรธุรกิจ ซึ่งในบริบทขององค์กรและการบริหารธุรกิจถือว่าเป็นเรื่องใหญ่ที่ผู้นำต้องตระหนักและหาทางแก้ไขด้วยโครงสร้างการบริหารจัดการที่มีระบบตรวจสอบและถ่วงดุลที่ดี บทเรียนสำคัญจาก Project Vend ที่ผู้นำองค์กรไทยและทั่วโลกควรเรียนรู้คือ หลีกเลี่ยงการฝากอำนาจการตัดสินใจไว้กับ AI ตัวเดียว เพราะระบบแบบ Single-Agent อาจอ่อนแอและขาดความยืดหยุ่น ควรออกแบบ Multi-Agent System เพื่อให้ AI หลายตัวทำงานร่วมกัน และมีการตรวจสอบกันและกันเหมือนระบบองค์กรของมนุษย์ อีกทั้งผู้นำยุค AI ควรเปลี่ยนบทบาทจากผู้ตัดสินใจมาเป็นผู้ออกแบบระบบและกลไกการตัดสินใจ ทำให้ AI ทำงานเป็นเครื่องมือที่ช่วยยกระดับการตัดสินใจของมนุษย์ ไม่ใช่แทนที่ทั้งหมด สุดท้าย Project Vend ยังทิ้งข้อคิดให้องค์กรได้คิดถึงความพร้อมของมนุษย์ในการพัฒนาและปรับตัวให้ทันกับโลกที่เปลี่ยนแปลงและทดลองสิ่งใหม่ๆ อยู่เสมอ ความสำเร็จของการใช้ AI ในการบริหารไม่ได้ขึ้นอยู่กับความฉลาดของ AI เพียงอย่างเดียว แต่ต้องมีความเข้าใจในด้านวัฒนธรรมองค์กรและความเป็นมนุษย์ควบคู่กันไป เพื่อป้องกันความเสี่ยงและเพิ่มโอกาสความสำเร็จในธุรกิจยุคดิจิทัลอย่างแท้จริง