You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 20:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Nov 20, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28651212197,19sleep00-21swapper/007:07:110
28798211695,15sleep20-21swapper/207:09:062
28623211594,15sleep30-21swapper/307:06:503
28636211396,12sleep10-21swapper/107:07:001
1650921130,0sleep30-21swapper/310:20:403
250762880,0sleep20-21swapper/212:13:302
59392730,1sleep35945-21missed_timers08:50:183
187262710,0sleep0101ktimersoftd/012:05:510
263152690,2sleep12890099cyclictest12:15:101
69532640,0sleep30-21swapper/310:45:173
229242570,0sleep30-21swapper/311:36:123
222482300,1sleep012978-21diskmemload11:35:240
169462280,1sleep10-21swapper/109:13:481
2890199223,2cyclictest0-21swapper/209:15:042
2890199222,18cyclictest0-21swapper/211:47:042
28901992218,2cyclictest16881-21kworker/u8:010:43:042
2890199220,5cyclictest0-21swapper/211:40:012
2890199220,17cyclictest0-21swapper/211:01:042
246602220,0sleep2301ktimersoftd/209:20:582
28902992118,2cyclictest18045-21kworker/u8:210:59:043
28902992117,2cyclictest17485-21kworker/u8:210:19:043
28901992118,2cyclictest971-21kworker/u8:109:29:042
28901992118,2cyclictest9333-21kworker/u8:209:13:042
28901992118,2cyclictest8545-21kworker/u8:110:14:042
28901992118,2cyclictest4831-21kworker/u8:207:44:012
28901992118,2cyclictest4831-21kworker/u8:207:32:012
28901992118,2cyclictest23434-21kworker/u8:311:38:052
28901992118,2cyclictest22284-21kworker/u8:310:35:042
28901992118,2cyclictest20148-21kworker/u8:311:28:012
28901992118,2cyclictest20148-21kworker/u8:311:19:042
28901992118,2cyclictest17988-21kworker/u8:011:34:052
28900992118,2cyclictest17988-21kworker/u8:011:38:021
28902992017,2cyclictest9333-21kworker/u8:209:12:013
28901992017,2cyclictest761-21kworker/u8:007:21:052
28901992017,2cyclictest7393-21kworker/u8:309:53:042
28901992017,2cyclictest7393-21kworker/u8:309:44:042
28901992017,2cyclictest4460-21kworker/u8:008:53:042
28901992017,2cyclictest30594-21kworker/u8:207:13:042
28901992017,2cyclictest28766-21kworker/u8:208:28:012
28901992017,2cyclictest27381-21kworker/u8:110:00:052
28901992017,2cyclictest25327-21kworker/u8:108:23:042
28901992017,2cyclictest25327-21kworker/u8:108:23:042
28901992017,2cyclictest23422-21kworker/u8:012:24:042
28901992017,2cyclictest20148-21kworker/u8:311:24:052
28901992017,2cyclictest20148-21kworker/u8:311:08:052
28901992017,2cyclictest17485-21kworker/u8:210:05:042
28901992017,2cyclictest17272-21kworker/u8:208:14:042
28901992017,2cyclictest17272-21kworker/u8:208:09:042
28901992017,2cyclictest14829-21kworker/u8:008:18:042
28901992017,2cyclictest10370-21kworker/u8:310:51:042
28901992017,2cyclictest10239-21kworker/u8:312:35:022
2890199201,2cyclictest0-21swapper/209:48:012
2890199201,17cyclictest2568-21ssh11:50:132
28900992017,2cyclictest8948-21kworker/u8:111:26:041
2889999200,18cyclictest0-21swapper/008:25:090
20352200,0sleep00-21swapper/007:20:240
28902991915,3cyclictest2934-21kworker/u8:010:12:043
28901991916,2cyclictest4831-21kworker/u8:207:35:042
28901991916,2cyclictest27105-21kworker/u8:009:33:052
28901991916,2cyclictest17485-21kworker/u8:210:15:042
28901991916,2cyclictest16881-21kworker/u8:010:49:042
28901991916,2cyclictest16881-21kworker/u8:010:22:042
28901991916,2cyclictest12138-21kworker/u8:312:02:042
2890199191,17cyclictest0-21swapper/212:17:042
28900991916,2cyclictest8545-21kworker/u8:110:26:041
28900991916,2cyclictest22284-21kworker/u8:310:39:041
28900991916,2cyclictest17040-21kworker/u8:112:08:041
2889999190,2cyclictest0-21swapper/008:05:100
28902991815,2cyclictest23422-21kworker/u8:012:34:043
28902991815,2cyclictest16881-21kworker/u8:010:36:013
28901991815,2cyclictest4831-21kworker/u8:207:45:052
28901991815,2cyclictest26773-21kworker/u8:107:28:042
28901991815,2cyclictest14829-21kworker/u8:007:56:042
2890199180,2cyclictest0-21swapper/212:33:042
2890199180,2cyclictest0-21swapper/209:56:052
2890199180,2cyclictest0-21swapper/208:48:012
28900991815,2cyclictest23422-21kworker/u8:012:38:041
28900991815,2cyclictest20148-21kworker/u8:311:06:051
28900991815,2cyclictest16881-21kworker/u8:010:31:041
2890099180,2cyclictest0-21swapper/110:59:041
2890099180,2cyclictest0-21swapper/110:19:041
32012170,0sleep30-21swapper/310:41:123
28902991714,2cyclictest17040-21kworker/u8:112:12:043
28902991714,2cyclictest16869-21kworker/u8:009:18:043
2890199170,2cyclictest0-21swapper/210:28:012
2890199170,2cyclictest0-21swapper/208:34:042
2890199170,15cyclictest0-21swapper/210:55:042
28900991714,2cyclictest23434-21kworker/u8:311:46:041
28900991714,2cyclictest23434-21kworker/u8:311:40:051
28900991714,2cyclictest16881-21kworker/u8:010:46:011
2890099170,2cyclictest0-21swapper/112:34:041
2890099170,15cyclictest0-21swapper/109:18:041
246392170,0sleep00-21swapper/009:20:570
28902991613,2cyclictest987-21kworker/u8:011:51:043
28902991613,2cyclictest7393-21kworker/u8:309:41:043
28902991613,2cyclictest23434-21kworker/u8:311:48:043
2890199160,2cyclictest0-21swapper/212:06:042
2890199160,2cyclictest0-21swapper/209:08:042
2890199160,2cyclictest0-21swapper/208:59:042
2890199160,2cyclictest0-21swapper/208:43:042
2890199160,2cyclictest0-21swapper/208:02:042
2890199160,15cyclictest0-21swapper/208:38:042
28900991613,2cyclictest627-21kworker/u8:210:44:041
28900991613,2cyclictest3850-21kworker/u8:011:21:041
28900991613,2cyclictest29972-21kworker/u8:310:06:011
28900991613,2cyclictest27105-21kworker/u8:009:36:041
28900991613,2cyclictest22282-21kworker/u8:009:57:041
28900991613,2cyclictest20148-21kworker/u8:311:17:041
28900991613,2cyclictest17485-21kworker/u8:210:10:041
28900991613,2cyclictest1148-21kworker/u8:112:25:041
28900991612,2cyclictest16881-21kworker/u8:011:02:011
28902991512,2cyclictest987-21kworker/u8:012:01:043
28902991512,2cyclictest27381-21kworker/u8:110:00:013
28902991512,2cyclictest27105-21kworker/u8:009:34:043
28902991512,2cyclictest23365-21ssh11:03:083
28902991512,2cyclictest16881-21kworker/u8:010:50:013
28902991512,2cyclictest0-21swapper/311:20:193
2890299150,2cyclictest12978-21diskmemload12:36:483
2890299150,2cyclictest0-21swapper/311:08:383
2890299150,13cyclictest0-21swapper/309:35:583
2890199150,2cyclictest0-21swapper/211:57:042
2890199150,2cyclictest0-21swapper/207:19:042
28900991512,2cyclictest971-21kworker/u8:108:57:041
28900991512,2cyclictest9333-21kworker/u8:209:03:041
28900991512,2cyclictest761-21kworker/u8:007:23:041
28900991512,2cyclictest7393-21kworker/u8:309:40:041
28900991512,2cyclictest30594-21kworker/u8:207:12:051
28900991512,2cyclictest28766-21kworker/u8:208:29:041
28900991512,2cyclictest27105-21kworker/u8:009:25:041
28900991512,2cyclictest25327-21kworker/u8:108:22:041
28900991512,2cyclictest25327-21kworker/u8:108:22:041
28900991512,2cyclictest17485-21kworker/u8:210:01:041
28900991512,2cyclictest17272-21kworker/u8:208:04:011
28900991512,2cyclictest14829-21kworker/u8:008:39:041
2890099151,12cyclictest0-21swapper/110:20:141
28900991510,3cyclictest29716-21sed08:30:131
2890099150,13cyclictest8920-21cron07:40:001
2890099150,13cyclictest0-21swapper/111:51:331
2889999151,12cyclictest7081-21apt-get11:55:060
316602140,2sleep00-21swapper/011:11:200
28902991411,2cyclictest971-21kworker/u8:108:44:053
28902991411,2cyclictest9211-21kworker/u8:108:00:013
28902991411,2cyclictest8948-21kworker/u8:111:33:043
28902991411,2cyclictest2934-21kworker/u8:010:07:043
28902991411,2cyclictest23422-21kworker/u8:012:28:043
28902991411,2cyclictest17272-21kworker/u8:208:10:043
28902991411,2cyclictest17040-21kworker/u8:112:07:043
28902991411,2cyclictest0-21swapper/311:44:283
28902991411,2cyclictest0-21swapper/309:55:183
2890299140,2cyclictest20336-21ssh09:50:283
2890299140,2cyclictest0-21swapper/309:28:183
2890299140,2cyclictest0-21swapper/309:20:383
2890299140,13cyclictest0-21swapper/311:15:383
2890299140,13cyclictest0-21swapper/309:46:283
2890299140,12cyclictest0-21swapper/311:10:113
28900991411,2cyclictest971-21kworker/u8:109:07:041
28900991411,2cyclictest971-21kworker/u8:108:41:041
28900991411,2cyclictest23422-21kworker/u8:012:23:041
28900991411,2cyclictest0-21swapper/109:20:241
2890099140,13cyclictest0-21swapper/109:46:341
2890099140,13cyclictest0-21swapper/109:34:041
2890099140,12cyclictest12978-21diskmemload12:11:341
28899991411,2cyclictest0-21swapper/011:05:100
28899991411,2cyclictest0-21swapper/010:11:140
2889999140,9cyclictest0-21swapper/009:49:050
2889999140,2cyclictest12978-21diskmemload10:06:030
2889999140,2cyclictest0-21swapper/010:27:330
2889999140,2cyclictest0-21swapper/009:26:040
2889999140,13cyclictest0-21swapper/010:41:330
2889999140,13cyclictest0-21swapper/009:35:230
2889999140,12cyclictest24097-21ssh10:30:020
2889999140,12cyclictest0-21swapper/012:39:170
2889999140,12cyclictest0-21swapper/012:24:530
2889999140,12cyclictest0-21swapper/012:00:080
2889999140,12cyclictest0-21swapper/008:20:000
28902991310,2cyclictest971-21kworker/u8:108:45:043
28902991310,2cyclictest9333-21kworker/u8:209:02:043
28902991310,2cyclictest761-21kworker/u8:007:37:043
28902991310,2cyclictest4346-21kworker/u8:007:10:043
28902991310,2cyclictest28766-21kworker/u8:208:32:043
28902991310,2cyclictest23422-21kworker/u8:012:22:043
28902991310,2cyclictest22284-21kworker/u8:310:28:053
28902991310,2cyclictest0-21swapper/311:55:123
28902991310,2cyclictest0-21swapper/311:28:383
28902991310,2cyclictest0-21swapper/308:35:293
2890299130,12cyclictest0-21swapper/307:20:223
28900991310,2cyclictest971-21kworker/u8:108:47:041
28900991310,2cyclictest4831-21kworker/u8:207:34:041
28900991310,2cyclictest17272-21kworker/u8:208:06:041
28900991310,2cyclictest14829-21kworker/u8:007:55:041
28900991310,2cyclictest14829-21kworker/u8:007:54:011
28900991310,2cyclictest0-21swapper/111:55:111
28900991310,2cyclictest0-21swapper/109:50:241
2890099130,2cyclictest0-21swapper/110:50:011
2890099130,12cyclictest0-21swapper/112:00:531
2890099130,12cyclictest0-21swapper/107:35:231
2889999139,2cyclictest20439-21ssh09:16:520
2889999139,2cyclictest12978-21diskmemload12:32:170
2889999139,2cyclictest0-21swapper/010:55:310
28899991310,2cyclictest0-21swapper/012:16:030
28899991310,2cyclictest0-21swapper/011:42:480
28899991310,2cyclictest0-21swapper/011:32:020
28899991310,2cyclictest0-21swapper/011:25:320
28899991310,2cyclictest0-21swapper/010:35:280
28899991310,2cyclictest0-21swapper/010:17:500
28899991310,2cyclictest0-21swapper/010:03:200
28899991310,2cyclictest0-21swapper/008:35:140
28899991310,2cyclictest0-21swapper/008:10:150
2889999130,9cyclictest0-21swapper/009:58:040
2889999130,2cyclictest12978-21diskmemload11:45:080
2889999130,2cyclictest0-21swapper/012:10:520
2889999130,2cyclictest0-21swapper/010:48:250
2889999130,2cyclictest0-21swapper/009:10:210
2889999130,2cyclictest0-21swapper/007:55:100
2889999130,12cyclictest0-21swapper/012:27:130
2889999130,12cyclictest0-21swapper/011:17:130
2889999130,12cyclictest0-21swapper/009:31:130
2889999130,12cyclictest0-21swapper/007:25:230
2889999130,11cyclictest0-21swapper/010:20:250
2890299129,2cyclictest0-21swapper/312:16:173
2890299120,2cyclictest0-21swapper/310:30:293
2890299120,11cyclictest0-21swapper/308:59:503
2890299120,11cyclictest0-21swapper/308:05:223
2890199129,2cyclictest9333-21kworker/u8:209:04:052
2890199129,2cyclictest0-21swapper/207:50:162
2890199120,2cyclictest0-21swapper/209:35:112
2890199120,11cyclictest3230-21ssh12:25:072
2890099129,2cyclictest20148-21kworker/u8:311:10:041
2890099129,2cyclictest0-21swapper/107:25:141
2890099121,3cyclictest11184-21munin-node1
2890099120,2cyclictest0-21swapper/108:10:051
2890099120,11cyclictest0-21swapper/111:30:131
2890099120,11cyclictest0-21swapper/108:50:191
2889999129,2cyclictest0-21swapper/011:50:420
2889999129,2cyclictest0-21swapper/008:55:010
2889999129,2cyclictest0-21swapper/008:50:230
2889999129,2cyclictest0-21swapper/007:50:250
2889999120,2cyclictest0-21swapper/011:20:510
2889999120,2cyclictest0-21swapper/010:50:060
2889999120,2cyclictest0-21swapper/007:10:210
2889999120,11cyclictest18045-21kworker/u8:211:00:040
2889999120,11cyclictest0-21swapper/009:51:010
2889999120,11cyclictest0-21swapper/009:40:040
2889999120,11cyclictest0-21swapper/009:00:200
2889999120,11cyclictest0-21swapper/007:45:250
2889999120,11cyclictest0-21swapper/007:40:070
2889999120,11cyclictest0-21swapper/007:15:120
2890299118,2cyclictest9211-21kworker/u8:107:58:053
2890299118,2cyclictest9211-21kworker/u8:107:50:043
2890299118,2cyclictest761-21kworker/u8:007:25:043
2890299118,2cyclictest4831-21kworker/u8:207:42:043
2890299118,2cyclictest26773-21kworker/u8:107:17:043
2890299118,2cyclictest17272-21kworker/u8:208:15:043
2890199118,2cyclictest0-21swapper/211:10:062
2890199110,6cyclictest0-21swapper/210:35:002
2890099118,2cyclictest0-21swapper/108:15:161
2889999118,2cyclictest0-21swapper/008:20:170
2889999118,2cyclictest0-21swapper/008:20:170
2889999110,10cyclictest971-21kworker/u8:108:49:040
2890299107,2cyclictest9333-21kworker/u8:209:05:043
2890299107,2cyclictest4831-21kworker/u8:207:47:043
2890299107,2cyclictest28766-21kworker/u8:208:26:043
2890299107,2cyclictest0-21swapper/307:30:253
2890099107,2cyclictest0-21swapper/107:15:201
2889999102,7cyclictest0-21swapper/009:08:580
2889999102,6cyclictest0-21swapper/008:33:180
2889999102,6cyclictest0-21swapper/007:38:070
2889999100,9cyclictest0-21swapper/008:42:010
2889999100,9cyclictest0-21swapper/007:33:590
288999983,3cyclictest19117-21cat08:05:000
26410280,5sleep30-21swapper/308:20:273
26410280,5sleep30-21swapper/308:20:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional