HuaRenCa
返回论坛
日常交流

我在AI咨询中赚了35万+,但钱不在智能体,而主要在于数据管道。

rjhuantan
rjhuantan

2个月前

大家好——我想分享过去几年兼职做自动化咨询(同时还有一份朝九晚五的工作)的经验。首先,我来自云/平台工程和开发背景,曾为财富500强金融服务公司工作,所以当我看到像Claude Code(刚推出时)这样的工具与真正的最佳实践和原则结合所能产生的倍增效应时,我完全被吸引了。

需要说明的是,接下来我要讲的只是我个人的经验和关注点。

我一开始和很多人一样,瞄准小企业,试图帮助他们自动化流程和程序。那很痛苦。大多数企业只是模糊地知道什么是自动化以及自动化能做什么。那是2023年左右,ChatGPT等工具还处于早期阶段,但我发现小企业要么:

没有钱支付我当时收取的月费(3000美元/月),要么

组织不够完善,甚至无法清晰表达他们需要自动化什么,或者不理解什么是“可自动化的”。

这让我意识到,这些企业之所以小并且保持小规模,很可能是有原因的。他们没有建立帮助自己成长/扩展的系统,虽然我可以提供这方面的帮助,但如果他们自己没有意愿去做,我也无法强迫。简而言之——不要将系统强加给那些本来就没有为自己构建系统的人。

随着时间的推移,我发现自己不断获得更大但仍属于中型规模的客户(年收入500万美元以上)。想想那些家喻户晓的名字,但在较小的领域/行业。他们每一个都有同样的问题。他们想使用AI,但发现结果要么非常通用,不针对他们的业务,要么关键用例需要大量彼此沟通不畅的工具。基本上,他们没有数据足迹(摄取、存储、治理、转换等)。

我现在已经与多个行业的10多家企业合作,构建了一种AI数据平台。通过API连接到他们使用的所有核心工具和服务,定期摄取数据,标准化数据,并将其写入AWS S3,同时拥有一个数据目录,记录所有定期摄取的数据。

这不是性感的工作,但它为我们合作的所有其他自动化用例奠定了基础。熟悉他们的数据、核心服务等,使我能够以指数级速度构建自动化,因为我再也不需要构建自定义集成来获取数据,或者弄清楚数据要放在哪里。

关于流失率、广告支出、客户获取成本等问题,以前回答起来很麻烦,现在只需将Codex和Claude Code指向AWS中的数据湖,让它们自由发挥,就变得超级简单。反过来,这也导致了仪表板的快速和持续开发,因为一旦所有数据都可访问,构建仪表板就变得非常快速和容易。

直到现在,经过数月的基础平台工具和基础设施搭建,我们才开始进入真正的智能体工作。但关键在于,人们认为他们需要智能体和智能体工作,而实际上他们作为起点所寻求的只是更好地了解业务在任何给定时间正在发生的事情,以及如何连接这些数据点之间的点。

我使用的技术栈基于AWS,但并非必须如此。我使用AWS是因为我已经使用多年,并且非常擅长以成本有效的方式使用它。它还允许我几乎在一个平台上完成所有工作,这有很多集成优势。

高层次上,我使用的工具包括:

用于数据摄取的Lambdas / ECS任务

用于数据湖存储的S3

用于数据查询的Athena

用于数据编目的Glue

用于认证的Cognito + Google Workspace认证

用于日志记录和告警的CloudWatch

用于API密钥的Secrets Manager

用于托管自定义Web前端(仪表板)和驱动消费的CloudFront

用于部署的GitHub Actions + Cloudformation / CDK

我非常注重确保这是企业级的基础设施和配置,因为一个不可信的自动化最终只是AI垃圾。

对于与我合作的客户,大多数每月支付7500到15000美元的服务费,并在他们自己的AWS账户下单独支付基础设施费用。这项工作对于没有云经验的人来说并不“容易”,所以这是整个事情的一个注意事项,但它是一致的且粘性极强。客户会留住你,因为他们不断需要新的报告/功能,并且当事情出问题时你需要在那里。

我已经在很大程度上自动化了其中的许多工作,包括失败作业的自动重新配置、用于跟踪和触发失败告警的报告仪表板,以及保持事情顺利进行的运行手册,但我发现这是一个相当容易复制的模式。

这个产品最好的部分是它确实需要定制。没有现成的解决方案可以让公司直接使用。各种服务的连接器用于摄取也是可重复的。

总之,这就是我推销不那么性感的东西(如AI数据管道)以及我对此的经验。对此的需求不会消失,任何关于“只用MCP”的反对意见也表明了对何时需要确定性工作负载以及运行此类工作负载所需的基础设施缺乏理解。

希望这对大家有所帮助,并且对于那些觉得在这个领域赚钱的唯一途径是每月300美元的AI电话代理(不是贬低,只是我看到的很多情况)的人来说,这是一股清流。

我很乐意回答任何相关问题,并且我也会定期发布关于我正在为客户构建/部署的概念的教育内容。

6
11

评论 (6)

Your avatar
点击登录后即可评论
rjhuantan
rjhuantan2个月前

Hey, I put a long post above about the acquiring customers. As for the getting them to agree, I basically broke down how owning your data is one of the most important things you can do as a business and if you want to have any truly differentiated models / data advantage you need to not only own and store it but also leverage it in ways that are better than what your customers are doing.

Selling them on the concept of having a business "brain" is usually something that resonates but you have to be extremely clear that in doing that, you have to build out all the foundational stuff to support and accomplish that.

It's not for everyone or every business but I've found that most businesses didn't push back much when I framed it like that and if they did then you have a pretty good idea that they're not a data driven business and that's ok too as the solution isn't the right fit for them then.

sanqi
sanqi2个月前

This is great thank you. Do you have any recommendations on how to get some of the cloud experience you already have? Whether it’s specific to AWS or general, it would be much appreciated. Thanks in advance!

rjhuantan
rjhuantan2个月前

So I'm going to say something pretty controversial here, but hear me out.

I actually think that the right cert training courses can be super valuable for learning the cloud generally. I have really enjoyed u/AdrianCantrill courses as well as Stephane Maarek's classes for AWS. Both try and go above and beyond "just getting the cert" and try and teach you some real hands on examples to use this tech in real life.

The cert itself isn't worth the paper it's printed on in most cases. What is however worthwhile is the structure that the certs and the training courses provide to get started.

Then from there it's all about throwing yourself in the deep end and trying to find real world problems (whether they be your own, a family friends that owns a business, your partners, etc. ) and building a solution in AWS to really put your theoretical knowledge to the test to make it actually tangible.

I was saying to someone that reached out directly about AWS and wanted to call out that you shouldn't get discouraged if you feel overwhelmed with AWS / other CSPs. There are over 400 services and I've been using and building in it for 6 or 7 years now and still learn stuff constantly in it. Just because you're learning new stuff in it doesn't mean you can't use it with whatever baseline you have.

zhezhe
zhezhe2个月前

I loved reading through your post. I am curious to learn more about the types of workflow and business problems that your system solves - with concrete examples. Any case study would be great. In addition, if you are ok to share what sectors/size are your clients, how do you discover them and lastly - do your clients use other solutions on top of what you offer?

rjhuantan
rjhuantan2个月前

I'm actually in the process of publishing one. Let me see if I can get you an early preview that makes it more real. A lot of it is around reporting, automation of Ad Spend analytics, slack alerting, etc. nothing revolutionary, but all stuff that the team would spend time doing manually before.

meisan
meisan2个月前

Yep — most of the messy work is data access, not agent logic. You can build sophisticated orchestration, but if the underlying data is inconsistent or undocumented, the agent hallucinates to fill the gaps. The actual consulting win usually ends up being "get this data structured well enough for a machine to reason about it reliably."