fix: CI improvements - allow_failure for manual jobs
Merge latest development fixes to main:
- Add allow_failure to manual jobs to prevent pipeline blocking
- Replace release-cli with API calls to bypass catalog validation
- Ensure templates directory exists in generate:docs job
These fixes prevent manual jobs from blocking the merge pipeline.