Skip to content

Adding a command to generate the complete archived recipe history for a repository #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 17, 2021

Conversation

weaverryan
Copy link
Contributor

Accompanies symfony/flex#845

I've tested this locally - it works wonderfully. It takes, on my machine, 4-5 minutes to get the complete history of symfony/recipes. Contrib should take around 1.5x-2x that length of time.

Copy link
Contributor

@nicolas-grekas nicolas-grekas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

@nicolas-grekas nicolas-grekas merged commit 2792e3c into symfony-tools:main Dec 17, 2021
@weaverryan weaverryan deleted the generate-archived branch December 17, 2021 17:21
while (true) {
// most arguments to the command do not matter for us and so are hardcoded
$process = Process::fromShellCommandline(
sprintf('git ls-tree HEAD */*/* | php %s/run generate:flex-endpoint symfony/recipes master flex/main $OUTPUT_DIR', realpath(__DIR__.'/../')),
Copy link
Contributor

@aivus aivus Dec 27, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@weaverryan it means we stick to symfony/recipes here.

I guess we should pass repository name and branch here from workflows in the same way as here:

https://github.com/symfony/recipes/blob/8130145858802557df0633c4e940e46a4695796b/.github/workflows/callable-qa.yml#L63

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh, ok.

based on the comment above in the code they don't matter

fabpot added a commit to symfony/flex that referenced this pull request Jan 19, 2022
This PR was squashed before being merged into the 1.x branch.

Discussion
----------

Merge-powered recipe update system

Hi!

tl;dr; Updating recipes was a pain. Now its easy: the new `recipes:update` command performs a smart "patch" to your project of what actually changed in the recipe.

[![asciicast](https://asciinema.org/a/456707.svg)](https://asciinema.org/a/456707)

If you run simply `composer recipes:update`, then it will ask you what to update, from a list of only the out-dated recipes (thanks to @shadowc for the idea!):

<img width="696" alt="Screen Shot 2021-12-17 at 11 18 09 AM" src="https://user-images.githubusercontent.com/121003/146575617-8ca7c6c8-1897-4fb4-be33-cdd5bf6894c0.png">

As you can see, if there are conflicts, you fix them like normal git conflicts. In addition to the unit tests, I've tried this on a fairly out-dated project and it worked *brilliantly*. This was NOT possible until @nicolas-grekas open sourced the Flex server - so a HUGE thanks 🎆

### How It Works

A) Whenever `symfony/recipes` (or contrib) has a new commit, a GitHub action *already* stores each recipe as JSON, which becomes the "recipe API": https://github.com/symfony/recipes/tree/flex/main. A change to that action (symfony/recipes#1037) and the recipes-checker (symfony-tools/recipes-checker#2) will add an "archived/" directory that contains EVERY version of every recipe. You can see an example in my fork: https://github.com/weaverryan/recipes/tree/flex/main/archived

B) When you run `recipes:update <package/name>`, we fetch the "original" recipe and "new" recipe and then pass both to each "configurator". Its job is to say what files would exist and what they would look if the "original" recipe were installed now and if the "new" recipe were installed now.

C) We use these "original files" and "new files" to generate a patch file.

D) We apply that patch file to the user's actual project. There are a few tricks here, like temporarily inserting the git "blob" for what the "original" version of the file would look like. That allows for a 3-way merge.

So, while it was a bit of work, it's a fairly straightforward process. It makes keeping your recipes up to date both easy and rewarding.

## TODOS

* [x] Merge recipes-checker PR symfony-tools/recipes-checker#2
* [x] Merge symfony/recipes PR symfony/recipes#1037
* [x] Update `Downloader` in this PR to remove 2x TODOs that the above PR's will enable
* [x] Make sure the `archived/` directory is populated for both `recipes` and `recipes-contrib` - see symfony-tools/recipes-checker#3 and symfony/recipes#1038
* [x] Document that this now exists symfony/symfony-docs#16301

Cheers!

Commits
-------

3ee7719 Merge-powered recipe update system
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants