Recommendation · MoneyOmar El Mghari recommends an auditing trick: if two errors are canceling out in a model, fix just one of the two and the model's performance will look worse, revealing that the model was wrong. When the 45% real figure replaced the AI-made-up 15%, the forecast error jumped from 1.7% to 28%, proving the original model was wrong despite its good performance.
AI Engineer · Right Answer, Wrong Reasons: AI Forecasts Costco - Hassan El Mghari & Omar El Mghari, Together AI
RecommendationA failed response must be distinguished from a failed operation before retrying an external request.
AI Engineer · Your Coding Agent Can't Undo Its Own Mistakes - Tanmay Sah & Dolly Sah
RecommendationSelf-evolution changes should be admitted only when both capability and recoverability requirements are met.
AI Engineer · Your Coding Agent Can't Undo Its Own Mistakes - Tanmay Sah & Dolly Sah
Recommendation · MoneyVinoo Ganesh gives vendors and builders a set of due-diligence questions: ask whether a tool can actually verify the numbers it produces rather than make them up; ask if you can click on a number to see its source — whether it's a calculation, an extraction, or a combination — not just after-the-fact annotation; ask whether the model actually writes pointers; ask whether the tool creates a mechanism for verifying the output; ask whether every citation source is checked; ask whether arithmetic is source checked; ask whether there is a mechanism for stopping files that reach clients or customers that they shouldn't reach; and ask what happens to a number or fact that came from nowhere and how hallucinations are handled.
AI Engineer · AI Can't Make Up a Number It Can't Look Up - Vinoo Ganesh, Kepler
Recommendation · MoneyAs a vendor or builder, ask: does the model actually write pointers? Does it actually create a mechanism for verifying the output? Is every citation source checked? Is arithmetic source checked? Do you have a mechanism for stopping files that reach clients or customers that they shouldn't reach? What happens to a number that came from nowhere, and what happens when a fact comes from nowhere? How do I actually handle these kinds of hallucinations?
AI Engineer · AI Can't Make Up a Number It Can't Look Up - Vinoo Ganesh, Kepler
Recommendation · MoneyNouha Dziri concludes that you need to allocate more agents at the software engineering stage that bottlenecks your task. On ProgramBench, extra agents pay off the most in planning: allocating more agents to planning achieves almost the same performance as the full PIV setup but at half the cost. Planning is the bottleneck because you need to figure out the binary's behavior and come up with a detailed plan of what to implement first.
AI Engineer · How to Get Frontier Coding Results at 70% Lower Cost - Nouha Dziri, Cohere
Recommendation · MoneyWhen designing a multi-agent team, you should consider organization (who leads, at which stage workers come in), communication (direct vs. report-to-lead only), team size, model selection, and stage allocation across planning, implementation, and verification. Each one changes how well the team does and how much it costs.
AI Engineer · How to Get Frontier Coding Results at 70% Lower Cost - Nouha Dziri, Cohere
Recommendation · MindRyo Lu recommends that if you take one thing away, let it not be to use one more tool, but this: next time you see a very complete answer, first give yourself some time and ask which decision in it you haven't thought about yourself.
AI Engineer · When We Can Do Anything, Do We Still Know What We Want? — Ryo Lu, ex-Cursor | AI Engineer Shanghai
Recommendation · MindRyo Lu recommends that if you are building tools, you start from three small points: make important assumptions visible, make each edit small enough to feel safe, and make handed-off work retrievable when needed.
AI Engineer · When We Can Do Anything, Do We Still Know What We Want? — Ryo Lu, ex-Cursor | AI Engineer Shanghai
Recommendation · MoneyThe narrator advises targeting keywords that people actually search for and that you can realistically rank for, rather than just publishing pages.
Ahrefs · 7 Ways to Get Website Traffic, Explained in 10 Minutes
Recommendation · MoneyThe narrator recommends starting with search, AI search, and video as your foundation, because once a page or video ranks it will keep sending free traffic for years. Get email going from day one to keep visitors coming back from all the other channels. Once that foundation is in place, add short-form video and paid ads on top as accelerators — you don't want to build everything on top of them, but they're great for reach and speed.
Ahrefs · 7 Ways to Get Website Traffic, Explained in 10 Minutes
Recommendation · MoneyAdam Nahari advises working hand-in-hand with the CFO to calculate whether the cost of the initiative at scale — including compute, tokens, and the individuals involved — is significantly lower than the impact it would generate. Many pilots die at the unit-economics stage because they don't pass this test.
AI Engineer · Your AI Pilots Won't Move the P&L. Here's What Will - Adam Nahari, Apollo
Recommendation · MoneyAdam Nahari looks for five things in a good AI use case: it moves a line the CFO recognizes; it is measurable with a baseline agreed up front, not in retrospect; the tech and data infrastructure is ready and the company owns the data; a named user — a person, not a department — wants it and can champion the initiative; and it is one of the CEO's top five priorities.
AI Engineer · Your AI Pilots Won't Move the P&L. Here's What Will - Adam Nahari, Apollo
Recommendation · MoneyAdam Nahari's rule: before putting any money at risk, ask where the CEO is — whether they have committed publicly that the initiative is a company priority. If the CEO has not publicly committed, he does not fund the initiative; the correlation with success is that strong.
AI Engineer · Your AI Pilots Won't Move the P&L. Here's What Will - Adam Nahari, Apollo
Recommendation · MoneyAdam Nahari recommends working hand-in-hand with the CFO to calculate whether an AI initiative's cost at scale — including compute, tokens, and personnel — is significantly lower than the impact it would generate.
AI Engineer · Your AI Pilots Won't Move the P&L. Here's What Will - Adam Nahari, Apollo
Recommendation · MoneyAdam Nahari's pilot discipline: before starting a pilot, write down the kill metrics that determine whether it continues or stops, and let the CFO keep score. Use a time gate — give each stage 90 days, and if no value is seen in those 90 days, stop the initiative. Use a metric gate — A/B testing at each stage relative to a baseline decided in advance. Use an adoption gate — were over 50% of crew schedulers using the tool.
AI Engineer · Your AI Pilots Won't Move the P&L. Here's What Will - Adam Nahari, Apollo
Recommendation · MoneyAdam Nahari advises: pick one or two problems, not 40, when driving an AI transformation. Start with the P&L and work your way backwards when choosing AI problems, and reimagine the entire process end-to-end rather than building on processes that may already be obsolete.
AI Engineer · Your AI Pilots Won't Move the P&L. Here's What Will - Adam Nahari, Apollo
Recommendation · MoneyMeasure time to first audio, not time to first byte, because a byte does not equal audio: popular TTS providers ship up to three quarters of a second of silence after the first byte, so a dashboard showing 210ms time-to-first-byte can still ship up to 750ms of silence. Similarly, measure time to first sentence for LLMs, not time to first token, because a TTS model needs an entire sentence before it can start speaking. Two seconds of silence after a caller asks 'did my payment go through?' is not reassuring, so measure the silence gap the caller actually hears.
AI Engineer · How to Build Voice Agents That Don't Fall Apart When You Interrupt - Jesse Hall, LiveKit
Recommendation · MoneyJesse Hall recommends using a turn detector that listens to audio as well as the transcript, so it can hear vocal inflection and wait when the caller is not actually done — for example when a payment amount is stated with a pause mid-sentence.
AI Engineer · How to Build Voice Agents That Don't Fall Apart When You Interrupt - Jesse Hall, LiveKit
Recommendation · MoneyJesse Hall advises setting the latency budget the caller hears before anything else, and measuring time to first audio and time to first sentence — not time to first token — as the key metrics, including measuring the silence gap the caller actually hears.
AI Engineer · How to Build Voice Agents That Don't Fall Apart When You Interrupt - Jesse Hall, LiveKit