Skip to content

Latest commit

 

History

History
313 lines (220 loc) · 11.5 KB

BUILD.md

File metadata and controls

313 lines (220 loc) · 11.5 KB
Raw

Building MsQuic

First, clone the repo recursively or run git submodule update --init --recursive to get all the submodules.

Source Code

The source (found in the src directory) is divided into several directories:

  • bin - Packages up all static libraries into the platform specific binaries.
  • core - Platform independent code that implements the QUIC protocol.
  • inc - Header files used by all the other directories.
  • manifest - Windows ETW manifest and related files.
  • platform - Platform specific code for OS types, sockets and TLS.
  • test - Test code for the MsQuic API / protocol.
  • tools - Tools for exercising MsQuic.

PowerShell Usage

MsQuic uses several cross-platform PowerShell scripts to simplify build and test operations. The latest PowerShell will need to be installed for them to work. These scripts are the recommended way to build and test MsQuic, but they are not required. If you prefer to use CMake directly, please scroll down to the end of this page and start with the Building with CMake instructions.

Install on Windows

You can install the latest PowerShell on Windows by running the following PowerShell script or read the complete instructions here.

iex "& { $(irm https://aka.ms/install-powershell.ps1) } -UseMSI"

Then you will need to manually launch "PowerShell 7" to continue. This install does not replace the built-in version of PowerShell.

Install on Linux

You can find the full installation instructions for PowerShell on Linux here. For Ubuntu you can run the following:

# Download the Microsoft repository GPG keys
wget -q https://packages.microsoft.com/config/ubuntu/18.04/packages-microsoft-prod.deb

# Register the Microsoft repository GPG keys
sudo dpkg -i packages-microsoft-prod.deb

# Update the list of products
sudo apt-get update

# Enable the "universe" repositories
sudo add-apt-repository universe

# Install PowerShell
sudo apt-get install -y powershell

# Start PowerShell
pwsh

Note If you get this error trying to install PowerShell:

powershell : Depends: libicu55 but it is not installable

Then you will need to run the following first (as a workaround):

sudo apt-get remove libicu57
wget http://security.ubuntu.com/ubuntu/pool/main/i/icu/libicu55_55.1-7ubuntu0.5_amd64.deb
sudo dpkg -i libicu55_55.1-7ubuntu0.5_amd64.deb
wget http://security.ubuntu.com/ubuntu/pool/main/o/openssl/libssl1.0.0_1.0.2g-1ubuntu4.18_amd64.deb
sudo dpkg -i libssl1.0.0_1.0.2g-1ubuntu4.18_amd64.deb

Then you will need to manually run "pwsh" to continue.

Install on macOS

brew install powershell

Then you will need to manually run "pwsh" to continue.

Building with PowerShell

Install Dependencies

In order to install the necessary dependencies, a copy of the .NET Core 3.1 SDK is required. Go to the following location and find the install page for your platform.

After installing .NET Core, you will need to restart your terminal.

For the very first time you build, it's recommend to make sure you have all the dependencies installed. You can ensure this by running:

./scripts/prepare-machine.ps1

Note at minimum CMake 3.20 on windows and 3.16 on other platforms is required. Instructions for installing the newest version on Ubuntu can be found here. https://apt.kitware.com/. The prepare-machine script will not do this for you.

Additional Requirements on Windows

  • CMake (The version installed with Visual Studio will likely not be new enough)
  • Strawberry Perl optional (required for OpenSSL build)
  • Visual Studio 2019 or 2022 (or Build Tools for Visual Studio 2019/2022) with
    • C++ CMake tools for Windows
    • MSVC v142 - VS 2019 (or 2022) C++ (Arch) build tools
    • Windows SDK
  • Latest Windows Insider builds (required for SChannel build)

Running a Build

To build the code, you just need to run build.ps1 in the scripts folder:

./scripts/build.ps1

Note that schannel TLS provider requires the latest Windows versions (Windows Server 2022 or Insider Preview) to function. If you don't have schannel use openssl to build and test.

./scripts/build.ps1 -Tls openssl

The script has a lot of additional configuration options, but the default should be fine for most.

Config options

-Config <Debug/Release> Allows for building in debug or release mode. Debug is the default configuration.

-Arch <x86/x64/arm/arm64> Allow for building for different architectures. x64 is the defualt architecture.

-Static Compiles msquic as a monolithic statically linkable library. Supported only by Windows currently.

-Tls <schannel/openssl> Allows for building with different TLS providers. The default is platform dependent (Windows = schannel, Linux = openssl).

-Clean Forces a clean build of everything.

For more info, take a look at the build.ps1 script.

Build Output

By default the build output will go in the build folder and the final build binaries in the artifacts folder. Under that it will create per-platform folders with subfolders for architecture/tls combinations. This allows for building different platforms and configurations at the same time.

Building with CMake

The following section details how to build MsQuic purely with CMake commands.

Please note that since using CMake directly is not the recommended way of building MsQuic, it's likely that these instructions may fall out of date more often than the Building with PowerShell ones.

Note that you will need to disable logging if building with CMake exclusively. Logging enabled requires .NET Core and at least the configuration from prepare-machine.ps1 in order to build.

Note at minimum CMake 3.16 is required. Instructions for installing a the newest version on Ubuntu can be found here. https://apt.kitware.com/

Install Dependencies

Linux

The following are generally required. Actual installations may vary.

sudo apt-add-repository ppa:lttng/stable-2.13
sudo apt-get update
sudo apt-get install cmake
sudo apt-get install build-essential
sudo apt-get install liblttng-ust-dev
sudo apt-get install lttng-tools

On RHEL 8, you'll need to manually install CMake to get the latest version. Download the x86_64 Linux installation script from cmake.org, and run the following sudo sh cmake.sh --prefix=/usr/local/ --exclude-subdir to install CMake.

RHEL 8 also requires the following:

sudo dnf install openssl-devel
sudo dnf install libatomic

Linux XDP

Linux XDP is experimentally supported on amd64 && Ubuntu 22.04LTS.
Commands below install dependencies and setup runtime environment.
WARN: This might break your system by installing Ubuntu 24.04LTS packages on ubuntu 22.04.Do not run on production environment and need to understand the side effect. You can workaround this prompt by -ForceXdpInstall 

$ pwsh ./scripts/prepare-machine.ps1 -UseXdp
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! WARN !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Linux XDP installs dependencies from Ubuntu 24.04 packages, which should affect your environment
You need to understand the impact of this on your environment before proceeding
Type 'YES' to proceed: YES

or

$ pwsh ./scripts/prepare-machine.ps1 -UseXdp -ForceXdpInstall
$ pwsh ./scripts/build.ps1 -UseXdp

./scripts/prepare-machine.ps1 internally does the below commands. This might break your environment.

# for libxdp v1.4.2
sudo apt-add-repository "deb http://mirrors.kernel.org/ubuntu noble main" -y

# install runtime dependencies
sudo apt-get install -y libxdp1 libbpf1 libnl-3-200 libnl-route-3-200 libnl-genl-3-200

# install build dependencies
sudo apt-get --no-install-recommends -y install libxdp-dev libbpf-dev libnl-3-dev libnl-genl-3-dev libnl-route-3-dev zlib1g-dev zlib1g pkg-config m4 clang libpcap-dev libelf-dev libc6-dev-i386

# Optional. This is required when you run test with duonic (XDP capable virtual nic pair)
sudo apt-get -y install iproute2 iptables
sudo ./scripts/duonic.sh install

Test

# "sudo" and --duoNic required
# You can explicitly specify directory of datapath_raw_xdp_kern.o by MSQUIC_XDP_OBJECT_PATH
# By default, libmsquic.so searchs for same directory as its executable
# If something failed, fallback to normal socket
sudo ./artifacts/bin/linux/x64_Debug_openssl3/msquictest --duoNic

Q&A

  • Q: Is this workload really running on XDP?
    A: If you have the xdp-dump command, try using sudo xdp-dump --list-interfaces. The xdp_main function is located in src/platform/datapath_raw_xdp_linux_kern.c. If none of the interfaces load the XDP program, something must be wrong.
$ sudo ./xdp-tools/xdp-dump/xdpdump --list-interfaces
Interface        Prio  Program name      Mode     ID   Tag               Chain actions
--------------------------------------------------------------------------------------
lo                     <No XDP program loaded!>
eth0                   <No XDP program loaded!>
docker0                <No XDP program loaded!>
duo2                   xdp_dispatcher    native   608211 4d7e87c0d30db711 
 =>              50     xdp_main                  608220 c8fcabdd9e3895f3  XDP_PASS
duo1                   xdp_dispatcher    native   608225 4d7e87c0d30db711 
 =>              50     xdp_main                  608228 c8fcabdd9e3895f3  XDP_PASS
  • Q: Is Ubuntu 20.04LTS supported?
    A: Not officially, but you can still build it by running apt-get upgrade linux-libc-dev. Please be aware of potential side effects from the upgrade.

macOS

The build needs CMake and compiler.

brew install cmake

Minimally, build needs Xcode 'Command Line Tools`. That can be done via XCode in App Store or from command line

xcode-select --install

Generating Build Files

Windows

Ensure the corresponding "MSVC v142 - VS 2019 (or 2022) C++ (Arch) build tools" are installed for the target arch, e.g. selecting "Desktop development with C++" only includes x64/x86 but not ARM64 by default.

VS 2019

mkdir build && cd build
cmake -G 'Visual Studio 16 2019' -A x64 ..

VS 2022

mkdir build && cd build
cmake -G 'Visual Studio 17 2022' -A x64 ..

Linux

mkdir build && cd build
cmake -G 'Unix Makefiles' ..

Running a Build

cmake --build .

Building for Rust

Rust support is currently experimental, and not officially supported.

To build MsQuic for Rust, you still must install the dependencies listed above for the various platforms. Then simply run:

cargo build

To run the tests:

cargo test

Installing from vcpkg

You can download and install MsQuic using the vcpkg dependency manager:

git clone https://github.com/Microsoft/vcpkg.git
cd vcpkg
./bootstrap-vcpkg.sh #.\bootstrap-vcpkg.bat(for windows)
./vcpkg integrate install
./vcpkg install ms-quic

The MsQuic port in vcpkg is kept up to date by Microsoft team members and community contributors. If the version is out of date, please create an issue or pull request on the vcpkg repository.