mirror/vcpkg
1
0
Fork 0
mirror of https://github.com/microsoft/vcpkg.git synced 2024-12-29 22:57:51 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
84e5852cfa
vcpkg/scripts/azure-pipelines/azure-pipelines.yml

98 lines
2.6 KiB
YAML
Raw Normal View History

Change supporting infrastructure to use Azure Virtual Machine Scale Sets for vcpkg's PR builds, which should both improve our PR build times and reduce Azure spending by shutting down machines when they aren't being used. Included is a script that sets up all vcpkg's Azure infrastructure for Windows PR tests, and several updates to baselines. The baseline updates are generally caused by an updated copy of the MSVC++ compiler caused by updating the VMs, but some are caused by missed failures only detected now because this did a cleared out archives directory first. Some of the build infrastructure isn't what I'd call 'pretty' (e.g. we're split into more scripts and such than I'd like) but this mirrors how our existing PR system works. It is expected that the existing vcpkg Windows PR system will hate these baseline updates so we'll need to merge this, then remove that (duplicate) workflow immediately afterwards, then delete all the Windows VMs powering the old infrastructure.
2020-04-22 08:12:21 +08:00
# Copyright (c) Microsoft Corporation.
# SPDX-License-Identifier: MIT
#
variables:
[opentracing] Update VMs 2020-12 (#15151) * Add meson from https://github.com/microsoft/vcpkg/pull/12860/ * Add autoconf-archive from https://github.com/microsoft/vcpkg/pull/13081/ * Add kf5windowsystem libs from https://github.com/microsoft/vcpkg/pull/13467/ * Open the FTP and SFTP ports from https://github.com/microsoft/vcpkg/pull/14412/ * Add libxcb-util0-dev from https://github.com/microsoft/vcpkg/pull/14678/ * Add libasound2-dev from https://github.com/microsoft/vcpkg/pull/14774 * Remove no longer necessary apt-mark calls. * Update nasm on Linux. * Fix longstanding bug where Storage was publicly accessible and change to generate SAS token rather than File Share * Delete no longer necessary azure storage firewall rules. * Install the newer Windows SDK with the VS installer instead of manually. * Install the VS2015 and VS2017 compilers. * Update Powershell-Core to 7.1.0. * Update source of WDK. * Update pools. * [opentracing] Repair arm64-windows failures caused by mojibake in `expected.hpp` and errors in opentracing-cpp's lint for arm64 where it thinks exceptions are disabled when they are enabled. Fixes: C:\Dev\vcpkg\buildtrees\opentracing\src\b67575dab0-0250653c81.clean\3rd_party\include\opentracing/expected/expected.hpp(1): warning C4828: The file contains a character starting at offset 0x4a77 that is illegal in the current source character set (codepage 65001). Fixes: D:\buildtrees\opentracing\src\b67575dab0-0250653c81.clean\include\opentracing/tracer.h:223:5: error: cannot use 'try' with exceptions disabled [clang-diagnostic-error] try { ^ * [mmloader] Patch out overrides of CMAKE_C_FLAGS and CMAKE_CXX_FLAGS that inserted /WX. Note that this port sets /GS-, possibly because it may be for authoring shellcode. * Bump storage API version to 2020-04-08.
2020-12-23 06:52:58 +08:00
windows-pool: 'PrWin-2020-12-17'
linux-pool: 'PrLin-2020-12-16'
[vcpkg osx ci] update 2020-09-28 (#13799) * [vcpkg osx ci] update to newer bits these ones should actually work! * update vagrantfile * correct scripts, reformat, add docs * Finish Get-InternalBaseBox, move archives In order to avoid people maliciously deleting the boxes, the archives share and file share are in different users now. * baseline libqcow to be fixed later * actually check for the mount point * fix Install-Prerequisites again * add +x to Get-InternalBaseBox.ps1 additionally, fix some errors
2020-09-30 07:49:49 +08:00
osx-pool: 'PrOsx-2020-09-28'
[vcpkg] [cudnn] [msmpi] [openmpi] Update VMSS (#11365) Co-authored-by: @JackBoosY Co-authored-by: Stefano Sinigardi <stesinigardi@hotmail.com> Co-authored-by: Voskrese <10104740+Voskrese@users.noreply.github.com>
2020-06-12 02:13:09 +08:00
[vcpkg ci] Update formatting CI (#12314) * stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-08 05:09:33 +08:00
stages:
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
- stage: FormatChecks
displayName: 'Formatting and Documentation Checks'
[vcpkg ci] Update formatting CI (#12314) * stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-08 05:09:33 +08:00
pool: $(windows-pool)
jobs:
- job:
[vcpkg manifests] fix some issues (#12227) Fixes #12190 Fixes #12208 Fixes #12234 Fixes #12286 Fixes #12315 Fixes #12186 Fixes #12331 Fixes googleapis/google-cloud-cpp#4487
2020-07-10 03:32:31 +08:00
workspace:
clean: resources
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
variables:
- name: VCPKG_DOWNLOADS
value: D:\downloads
- name: DiffFile
value: $(Build.ArtifactStagingDirectory)\format.diff
[vcpkg ci] Update formatting CI (#12314) * stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-08 05:09:33 +08:00
steps:
- task: Powershell@2
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
displayName: 'Generate Documentation'
[vcpkg ci] Update formatting CI (#12314) * stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-08 05:09:33 +08:00
inputs:
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
filePath: 'docs/regenerate.ps1'
arguments: '-VcpkgRoot . -WarningAction Stop'
[skia, ompl, capnproto] Update VMs for 2020-08-12 (including VS 16.7) (#12884) Co-authored-by: Nicole Mazzuca <mazzucan@outlook.com>
2020-08-28 03:27:39 +08:00
pwsh: true
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
- script: .\bootstrap-vcpkg.bat
[vcpkg] Download vcpkg.exe rather than building it in bootstrap on Windows. (#15474) This reduces bootstrap cost for Windows customers, resolving the issue initially submitted as #12502 . The `toolsrc` tree was extracted to https://github.com/microsoft/vcpkg-tool. `bootstrap.sh` was changed to download the right source tarball, extract, and build it. This was chosen over the previous attempt, a submodule, over concerns of accidentally destroying people's local modifications.
2021-02-05 02:15:44 +08:00
displayName: 'Bootstrap vcpkg'
- script: '.\vcpkg.exe format-manifest --all'
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
displayName: 'Format Manifests'
[vcpkg docs] Check for documentation generation in CI (#14614) * [vcpkg docs] Change how documenting port functions works Instead of using `##`, use comment blocks for documentation. Also, add some minor docs and change RST -> MD so we actually get docs generated. * add CI stuff * regenerate docs * fix vcpkg_find_acquire_program to not use _execute_process
2020-12-02 05:37:26 +08:00
- task: Powershell@2
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
displayName: 'Create Diff'
[vcpkg docs] Check for documentation generation in CI (#14614) * [vcpkg docs] Change how documenting port functions works Instead of using `##`, use comment blocks for documentation. Also, add some minor docs and change RST -> MD so we actually get docs generated. * add CI stuff * regenerate docs * fix vcpkg_find_acquire_program to not use _execute_process
2020-12-02 05:37:26 +08:00
inputs:
[vcpkg] Download vcpkg.exe rather than building it in bootstrap on Windows. (#15474) This reduces bootstrap cost for Windows customers, resolving the issue initially submitted as #12502 . The `toolsrc` tree was extracted to https://github.com/microsoft/vcpkg-tool. `bootstrap.sh` was changed to download the right source tarball, extract, and build it. This was chosen over the previous attempt, a submodule, over concerns of accidentally destroying people's local modifications.
2021-02-05 02:15:44 +08:00
filePath: scripts/azure-pipelines/Create-PRDiff.ps1
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
arguments: '-DiffFile $(DiffFile)'
[vcpkg docs] Check for documentation generation in CI (#14614) * [vcpkg docs] Change how documenting port functions works Instead of using `##`, use comment blocks for documentation. Also, add some minor docs and change RST -> MD so we actually get docs generated. * add CI stuff * regenerate docs * fix vcpkg_find_acquire_program to not use _execute_process
2020-12-02 05:37:26 +08:00
pwsh: true
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
- task: PublishBuildArtifacts@1
condition: failed()
[vcpkg] Download vcpkg.exe rather than building it in bootstrap on Windows. (#15474) This reduces bootstrap cost for Windows customers, resolving the issue initially submitted as #12502 . The `toolsrc` tree was extracted to https://github.com/microsoft/vcpkg-tool. `bootstrap.sh` was changed to download the right source tarball, extract, and build it. This was chosen over the previous attempt, a submodule, over concerns of accidentally destroying people's local modifications.
2021-02-05 02:15:44 +08:00
displayName: 'Publish Format and Documentation Diff'
[vcpkg ci] upload diff from clang-format to artifacts (#15141) * [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-17 05:14:35 +08:00
inputs:
PathtoPublish: '$(DiffFile)'
ArtifactName: 'format.diff'
- stage: RunPrTests
displayName: 'Run PR Tests:'
dependsOn: FormatChecks
[vcpkg ci] Update formatting CI (#12314) * stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-08 05:09:33 +08:00
jobs:
[vcpkg] Delete unnecessary tombstone deletion step now that CI rebuilds everything (#12120)
2020-06-26 13:19:17 +08:00
- template: windows/azure-pipelines.yml
parameters:
triplet: x86-windows
jobName: x86_windows
poolName: $(windows-pool)
- template: windows/azure-pipelines.yml
parameters:
triplet: x64-windows
jobName: x64_windows
poolName: $(windows-pool)
- template: windows/azure-pipelines.yml
parameters:
triplet: x64-windows-static
jobName: x64_windows_static
poolName: $(windows-pool)
[vcpkg] Add x64-windows-static-md to pipeline (#15411) * Add x64-windows-static-md to pipeline * Update azure-pipelines.yml * Update test-modified-ports.ps1 * Replicate skip/fail from x64-windows-static * Add failures to ci.baseline * Update ci.baseline.txt * Update ci.baseline.txt * Update ci.baseline.txt * Update ci.baseline.txt Co-authored-by: ankurv <ankurv@microsoft.com>
2021-01-09 03:55:31 +08:00
- template: windows/azure-pipelines.yml
parameters:
triplet: x64-windows-static-md
jobName: x64_windows_static_md
poolName: $(windows-pool)
[vcpkg] Delete unnecessary tombstone deletion step now that CI rebuilds everything (#12120)
2020-06-26 13:19:17 +08:00
- template: windows/azure-pipelines.yml
parameters:
triplet: x64-uwp
jobName: x64_uwp
poolName: $(windows-pool)
- template: windows/azure-pipelines.yml
parameters:
triplet: arm64-windows
jobName: arm64_windows
poolName: $(windows-pool)
- template: windows/azure-pipelines.yml
parameters:
triplet: arm-uwp
jobName: arm_uwp
poolName: $(windows-pool)
- template: osx/azure-pipelines.yml
[vcpkg macos ci] Switch to using our own base boxes, to fix bringing up mac machines (#13619) * [vcpkg ci:osx] Remove brew install * add instructions for creating a new vagrant box * fix the vagrant scripts for the new box * finish fixing the setup * [mecab jxrlib] fix ports for CI mecab needed to use an actual ref that wasn't master, and jxrlib needed a patch for xcode 12 CLTs. Additionally, this fixes the mecab version to be a date, the date of the last commit, since `1.0` is not the correct version (mecab doesn't have released versions) * [many ports] fix compile with Xcode 12 CLTs This mostly means fixing errors on implicit-function-declaration, and removing some Werrors * alac-decoder * apr * argtable2 * arrow * hyperscan * mcpp * minizip * mosquitto * stormlib * [many ports] even more Xcode 12 CLT fixes * [jxrlib darknet] fix the last ports! (hopefully) * CRs, plus minor wip changes to osx scripts
2020-09-25 06:15:06 +08:00
parameters:
poolName: $(osx-pool)
[vcpkg] Delete unnecessary tombstone deletion step now that CI rebuilds everything (#12120)
2020-06-26 13:19:17 +08:00
- template: linux/azure-pipelines.yml
parameters:
poolName: $(linux-pool)
Reference in New Issue Copy Permalink