Let's say you want to update and test your web app with a CMS regularly and you want to automate this:
Do you prefer n8n like workflows or AI workflows where you describe your issue in detail with specific steps?
Commit
257d1b6
It depends on the technology the app is built with. But I use Laravel Dusk for this kind of thing.
And if you need to build something like that:
- Update to minor version
- ⬎Test critical paths with test suite
- if test fails -> AI Fix ⬏
- Create Branch
- Commit Change
- Open a PR
Github Actions + Claude Code (or codex, or devin, etc, etc).
- Use a trigger that detects a minor release.
- Create a branch and update the packages.
- Run your test suite.
(this is all a simple script of gh Action)
- If you detect a failure, call the AI to pass it the error (or…
So you would not just use an AI Prompt:
"Update all packages to latest minor version, after that run the test suite with npm run test. If we have failing tests fix them and rerun the test suite. If you are done create a branch, commit it and open a PR so I can review"?
But…
Not necessarily. That approach is great for local environments, but for CI/CD… I wouldn’t recommend it.
When using agents in automated pipelines, it’s important to separate the deterministic from the probabilistic.
What’s already 100% deterministic doesn’t need an LLM. Running…
Okey got it! I agree in every point. Thank you for the detailed answer :)
commit 257d1b6