Skip to content

The Linux and macOS test legs run the suite without instrumenting it - #2168

Merged
Rafael-SOWNet merged 1 commit into
masterfrom
the-linux-and-macos-legs-test-without-coverage
Oct 27, 2026
Merged

Rafael-SOWNet merged 1 commit into
masterfrom
the-linux-and-macos-legs-test-without-coverage

Conversation

@Rafael-SOWNet

@Rafael-SOWNet Rafael-SOWNet commented Oct 27, 2026 •

Copy link
Copy Markdown
Member

On Linux and macOS, C# Test passed /p:CollectCoverage=true to dotnet test. Coverlet's MSBuild integration instrumented the kernel and printed AngouriMath | 0% on every run. The cause is the first entry of coverlet's KnownIssues.md: VSTest stops the test host before coverlet writes its hits. Nothing uploads either report. The Windows leg's collector report is the one Codecov gets (#2165).

What the instrumentation cost:

  • On master 90ac9752a, the test step took 16 m 47 s on Linux and 29 m 2 s on macOS.
  • Locally, the full suite takes 12 m 9 s instrumented and 7 m 7 s to 7 m 52 s without. So about two fifths of the time went on a report that recorded nothing.

This PR drops the two properties, and Coverage.md's table now says the C# coverage comes from the Windows leg. Measured on this PR (dotnet test's own duration line, one run each):

leg master 90ac9752a this PR
Linux 16 m 47 s 12 m 43 s (−24%)
macOS 29 m 2 s 23 m 50 s (−18%)

Both legs ran all 17,141 tests, and neither printed the 0% table.

Part of #397.

🤖 Generated with Claude Code

https://claude.ai/code/session_012sonx8iAspMiwRwokT1Ura

Both legs passed /p:CollectCoverage=true to dotnet test. Coverlet's MSBuild
integration then instrumented the kernel and printed `AngouriMath | 0%` on
every run, because VSTest stops the test host before coverlet writes its
hits (the first entry of coverlet's KnownIssues.md). Nothing uploads either
report: the Windows leg's collector report is the one sent to Codecov.

The instrumentation was not free. On master 90ac975 the test step took
16 m 47 s on Linux and 29 m 2 s on macOS. Locally the full suite takes
12 m 9 s instrumented and 7 m 7 s to 7 m 52 s without, so about two fifths
of it went on a report of nothing.

Coverage.md's table says where the C# coverage comes from.

Part of #397

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012sonx8iAspMiwRwokT1Ura
@Rafael-SOWNet Rafael-SOWNet added this to the 2.7.0 milestone Oct 27, 2026
@Rafael-SOWNet Rafael-SOWNet moved this from Todo to In review in AngouriMath Oct 27, 2026
@codecov

codecov Bot commented Oct 27, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 86.41%. Comparing base (e828414) to head (643c1aa).

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2168      +/-   ##
==========================================
- Coverage   86.41%   86.41%   -0.01%     
==========================================
  Files         295      295              
  Lines       64806    64806              
  Branches    19059    19059              
==========================================
- Hits        56005    56004       -1     
- Misses       4771     4772       +1     
  Partials     4030     4030              
Flag Coverage Δ
cpp 37.77% <ø> (ø)
csharp 86.99% <ø> (-0.01%) ⬇️
fsharp 32.97% <ø> (ø)
interactive 40.72% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
see 4 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Rafael-SOWNet
Rafael-SOWNet merged commit 9326683 into master Oct 27, 2026
35 checks passed
@github-project-automation github-project-automation Bot moved this from In review to Done in AngouriMath Oct 27, 2026
@Rafael-SOWNet
Rafael-SOWNet deleted the the-linux-and-macos-legs-test-without-coverage branch October 28, 2026 10:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant