Exploring Distributed Tracing Using ASP.NET Core And Jaeger

Introduction

Modern software architectures built on microservices and serverless introduce advantages to application development but there’s also the cost of reduced visibility.

Requests often span multiple services. Each service handles a request by performing one or more operations, for examaple - database queries, publish messages, etc.

How to understand the behavior of an application, monitor services, and troubleshoot problems?

Distributed tracing provides end-to-end visibility and reveals service dependencies – showing how the services respond to each other.

This article demonstrates how to set up the Jaeger all-in-one deployment on local testing with traces generated from two ASP.NET Core applications.

Setup Jaeger

Using docker to setup Jaeger is very easy, and jaegertracing provides an image named all-in-one which is designed for quick local testing, launches the Jaeger UI, collector, query, and an agent with an in-memory storage component.

docker run -d --name jaeger \
-e COLLECTOR_ZIPKIN_HTTP_PORT=9411 \
-p 5775:5775/udp \
-p 6831:6831/udp \
-p 6832:6832/udp \
-p 5778:5778 \
-p 16686:16686 \
-p 14268:14268 \
-p 9411:9411 \
jaegertracing/all-in-one:latest

After running up, we can navigate to http://localhost:16686 to access the Jaeger UI.

What we should do next is to integrate it with ASP.NET Core.

Integrate With ASP.NET Core

Here, we will create two ASP.NET Core Web API projects to show - one of them is named CustomerApi and the other one is named OrderApi.

We should add two NuGet packages in our projects.

Install-Package Jaeger -Version 0.2.2
Install-Package OpenTracing.Contrib.NetCore -Version 0.5.0

Each project should add the following code in the ConfigureServices method.

services.AddSingleton<ITracer>(serviceProvider =>
{
string serviceName = Assembly.GetEntryAssembly().GetName().Name;
ILoggerFactory loggerFactory = serviceProvider.GetRequiredService<ILoggerFactory>();
ISampler sampler = new ConstSampler(sample: true);
ITracer tracer = new Tracer.Builder(serviceName)
.WithLoggerFactory(loggerFactory)
.WithSampler(sampler)
.Build();
GlobalTracer.Register(tracer);
return tracer;
});
services.AddOpenTracing();

We will query some data from SQLite with EFCore in the OrderApi service. Also, add a method that will throw an exception.

[Route("api/orders")]
public class OrdersController : Controller
{
private readonly OrderDbContext _dbContext;
public OrdersController(OrderDbContext dbContext)
{
this._dbContext = dbContext;
}
// GET: api/orders
[HttpGet]
public IEnumerable<string> Get()
{
// query data from SQLite
var orders = _dbContext.Orders.ToList();
return new string[] { "value1", "value2" };
}
// GET: api/orders/1
[HttpGet("{id}")]
public ActionResult<string> Get(int id)
{
throw new System.Exception("Error Test");
return "value";
}
}

In CustomerApi service, we will use HttpClient to call OrderApi service so that we can see the tracing between different services.

[Route("api/[controller]")]
[ApiController]
public class ValuesController : ControllerBase
{
private readonly IHttpClientFactory _factory;
public ValuesController(IHttpClientFactory factory)
{
this._factory = factory;
}
// GET api/values
[HttpGet]
public async Task<IEnumerable<string>> GetAsync()
{
var data = await GetSomeThingFromOrderApi();
return new string[] { "value1", "value2" };
}
private async Task<string> GetSomeThingFromOrderApi()
{
var client = _factory.CreateClient("orderApi");
var requestMsg = new HttpRequestMessage(HttpMethod.Get, "http://localhost:8990/api/orders");
var responseMsg = await client.SendAsync(requestMsg);
var data = await responseMsg.Content.ReadAsStringAsync();
return data;
}
}

After finishing the above steps, we can run those two services up, and visit CustomerApi via http://localhost:8989/api/values.

Turn to Jaeger UI and select CustomerApi.

As you can see, there is some useful information about this request!

HTTP GET request costs 17.78ms
8 Spans with two services
Happen in 10.38.20 pm
...

However, that information is an overview of this request. We should learn more details about it!

Click this item and we can see more information about this request.

OrderApi contains a span named DB ExecuteReader, it shows us the statement that EFCore generated. Sometimes, this is a very helpful message that can optimize our applications.

Visiting http://localhost:8989/api/values one more time. It will generate another record, we can compare those two traces to find out the difference between them.

Also, we can see those two service dependencies. The following screenshot tells us that CustomerApi is dependent on OrderApi.

What about our services throw exceptions?

Visiting http://localhost:8990/api/orders/1 and we will learn how it records the exception when our services throw.

It recorded the full exception message and StackTrace that can help us to find out the problem quickly!!

Summary

This short article shows how to set up a local testing environment of Jaeger, integrate with ASP.NET Core application and why we need a distributed tracing during our development and deployment.

Hope this article can help you!

Additional Resources

4 Comments

Join the conversation! Your thoughts help the community grow.

Azri Zakaria7y ago
I install the jaeger on different server. Any idea how to sent data on the different server?
- Catcher Wong7y ago
  ILoggerFactory loggerFactory = serviceProvider.GetRequiredService<ILoggerFactory>(); var senderConfig = new Jaeger.Configuration.SenderConfiguration(loggerFactory) .WithAgentHost(agentHost) .WithAgentPort(agentPort); var reporter = new RemoteReporter.Builder() .WithLoggerFactory(loggerFactory) .WithSender(senderConfig.GetSender()) .Build(); var sampler = new GuaranteedThroughputSampler(samplingRate, lowerBound); ITracer tracer = new Tracer.Builder(serviceName) .WithLoggerFactory(loggerFactory) .WithReporter(reporter) .WithSampler(sampler) .Build(); GlobalTracer.Register(tracer);
Jeeva Subburaj7y ago
Thanks for the article. Tracing is very important for microservices and this tool looks very promising (open source and part of CNCF (Cloud Native Computing Foundation))
- Catcher Wong7y ago
  Jaeger is vary nice, the same as SkyWalking