You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 09:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Nov 20, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8902211796,16sleep00-21swapper/019:08:020
8639211694,15sleep20-21swapper/219:05:282
89812115104,6sleep30-21swapper/319:09:063
7271211295,12sleep10-21swapper/119:05:071
99892720,0sleep00-21swapper/000:31:120
69342250,0sleep00-21swapper/022:45:340
69342250,0sleep00-21swapper/022:45:330
9084992118,2cyclictest27326-21kworker/u8:122:04:042
908299211,3cyclictest0-21swapper/019:49:040
9084992017,2cyclictest27610-21kworker/u8:123:43:052
9084992017,2cyclictest2750-21kworker/u8:222:10:052
9084992017,2cyclictest14459-21kworker/u8:100:02:042
908499200,4cyclictest0-21swapper/222:45:052
908499200,4cyclictest0-21swapper/222:45:042
908499200,3cyclictest0-21swapper/222:32:052
908499200,3cyclictest0-21swapper/222:25:042
908499200,3cyclictest0-21swapper/220:04:042
908499200,3cyclictest0-21swapper/220:04:042
908499200,3cyclictest0-21swapper/219:43:042
908499200,3cyclictest0-21swapper/200:34:042
9083992015,4cyclictest2885-21kworker/u8:123:28:041
9082992015,3cyclictest31043-21ssh21:30:100
9084991916,2cyclictest9860-21kworker/u8:021:54:042
9084991916,2cyclictest3293-21kworker/u8:321:41:042
9084991916,2cyclictest28916-21kworker/u8:023:14:052
9084991916,2cyclictest28215-21kworker/u8:022:42:052
908399191,2cyclictest0-21swapper/122:25:041
908399191,2cyclictest0-21swapper/119:43:041
908399190,2cyclictest0-21swapper/100:34:051
111512190,2sleep337-21rcuc/321:42:313
9084991815,2cyclictest28215-21kworker/u8:022:39:042
9084991815,2cyclictest25180-21kworker/u8:121:27:042
9084991815,2cyclictest21170-21kworker/u8:123:08:042
9084991815,2cyclictest16510-21kworker/u8:020:25:042
9084991815,2cyclictest15727-21kworker/u8:023:46:042
908499180,3cyclictest0-21swapper/221:22:062
9083991815,2cyclictest25180-21kworker/u8:121:28:051
9083991815,2cyclictest22659-21kworker/u8:223:38:041
908399181,2cyclictest0-21swapper/122:32:041
908399180,2cyclictest0-21swapper/120:04:051
908399180,2cyclictest0-21swapper/120:04:041
9084991714,2cyclictest8356-21kworker/u8:022:17:042
9084991714,2cyclictest5261-21kworker/u8:100:39:042
9084991714,2cyclictest4632-21kworker/u8:119:27:042
9084991714,2cyclictest4632-21kworker/u8:119:12:052
9084991714,2cyclictest3280-21kworker/u8:120:58:052
9084991714,2cyclictest2885-21kworker/u8:123:36:012
9084991714,2cyclictest25161-21kworker/u8:100:17:042
9084991714,2cyclictest25161-21kworker/u8:100:14:042
9084991714,2cyclictest15885-21kworker/u8:121:17:042
9084991714,2cyclictest15727-21kworker/u8:023:52:042
9084991714,2cyclictest15727-21kworker/u8:000:23:042
9084991714,2cyclictest13522-21kworker/u8:220:09:052
9084991714,2cyclictest13083-21kworker/u8:222:57:042
9084991714,2cyclictest12435-21kworker/u8:019:39:052
9085991613,2cyclictest28916-21kworker/u8:023:14:013
9085991613,2cyclictest13998-21kworker/u8:122:41:043
908599160,14cyclictest11759-21diskmemload22:03:073
9084991613,2cyclictest9860-21kworker/u8:021:57:052
9084991613,2cyclictest31814-21kworker/u8:020:49:042
9084991613,2cyclictest28098-21kworker/u8:220:35:042
9084991613,2cyclictest16510-21kworker/u8:020:23:042
9084991613,2cyclictest16510-21kworker/u8:020:11:042
9084991613,2cyclictest15885-21kworker/u8:121:14:042
9084991613,2cyclictest15727-21kworker/u8:023:55:042
9084991613,2cyclictest14459-21kworker/u8:100:06:052
9084991613,2cyclictest13083-21kworker/u8:222:53:052
9084991613,2cyclictest11569-21kworker/u8:021:08:052
9084991613,2cyclictest11123-21kworker/u8:219:31:042
9084991612,3cyclictest14502-21kworker/u8:119:54:042
908399161,13cyclictest332250irq/24-eth122:44:211
908299162,2cyclictest11-21rcuc/022:15:160
908299161,3cyclictest0-21swapper/023:55:180
9085991512,2cyclictest22659-21kworker/u8:223:37:043
9085991512,2cyclictest15727-21kworker/u8:000:08:043
9085991512,2cyclictest10325-21ssh23:24:273
908599151,12cyclictest0-21swapper/300:22:543
908599150,13cyclictest26317-21munin-node3
9084991512,2cyclictest4632-21kworker/u8:119:15:042
9084991512,2cyclictest2885-21kworker/u8:123:27:042
9084991512,2cyclictest15727-21kworker/u8:000:26:052
9084991512,2cyclictest13998-21kworker/u8:122:23:052
9084991512,2cyclictest13522-21kworker/u8:219:57:042
9084991512,2cyclictest11569-21kworker/u8:021:34:052
908499150,13cyclictest0-21swapper/223:15:152
9083991512,2cyclictest3293-21kworker/u8:321:42:051
9083991512,2cyclictest13998-21kworker/u8:122:52:041
9083991512,2cyclictest13083-21kworker/u8:223:02:011
9083991512,2cyclictest0-21swapper/121:20:241
908399151,12cyclictest13344-21df21:45:121
908399150,2cyclictest0-21swapper/123:14:011
9082991513,1cyclictest0-21swapper/021:54:060
9082991512,2cyclictest11759-21diskmemload00:21:070
908299150,13cyclictest4910-21smartctl20:50:260
908299150,13cyclictest11-21rcuc/023:25:260
908299150,13cyclictest0-21swapper/021:22:380
62822150,0sleep20-21swapper/223:20:102
9085991411,2cyclictest7719-21kworker/u8:223:58:043
9085991411,2cyclictest0-21swapper/323:50:193
9085991411,2cyclictest0-21swapper/323:18:083
9085991411,2cyclictest0-21swapper/300:11:253
908599140,2cyclictest19889-21df_abs23:00:133
908599140,2cyclictest0-21swapper/323:34:543
908599140,2cyclictest0-21swapper/321:49:573
908599140,2cyclictest0-21swapper/300:15:083
908599140,13cyclictest0-21swapper/322:31:183
908599140,13cyclictest0-21swapper/322:18:073
908599140,13cyclictest0-21swapper/321:21:173
908599140,12cyclictest0-21swapper/323:06:173
908599140,12cyclictest0-21swapper/322:45:453
908599140,12cyclictest0-21swapper/322:45:453
908599140,12cyclictest0-21swapper/320:45:053
908599140,12cyclictest0-21swapper/300:25:083
9084991411,2cyclictest4632-21kworker/u8:119:20:052
9084991411,2cyclictest3280-21kworker/u8:121:04:042
9084991411,2cyclictest28098-21kworker/u8:220:34:052
9083991411,2cyclictest4632-21kworker/u8:119:30:041
9083991411,2cyclictest16510-21kworker/u8:020:22:051
9083991411,2cyclictest15885-21kworker/u8:121:15:041
9083991411,2cyclictest13522-21kworker/u8:220:05:051
9083991411,2cyclictest13083-21kworker/u8:223:15:041
9083991411,2cyclictest12435-21kworker/u8:019:37:051
9083991410,2cyclictest18391-21munin-run22:25:011
908399140,3cyclictest0-21swapper/122:35:221
908399140,2cyclictest11759-21diskmemload23:05:181
908399140,2cyclictest11759-21diskmemload21:39:031
908399140,2cyclictest0-21swapper/100:08:051
908399140,12cyclictest28163-21cut20:30:161
908399140,12cyclictest0-21swapper/123:30:021
908399140,12cyclictest0-21swapper/123:21:421
908399140,12cyclictest0-21swapper/121:32:051
908399140,12cyclictest0-21swapper/100:02:141
908299149,3cyclictest20341-21ssh00:08:510
9082991410,2cyclictest0-21swapper/021:41:070
908299140,3cyclictest0-21swapper/023:40:230
908299140,2cyclictest0-21swapper/022:44:260
908299140,2cyclictest0-21swapper/022:09:060
908299140,2cyclictest0-21swapper/021:55:260
908299140,13cyclictest0-21swapper/022:35:370
908299140,12cyclictest11759-21diskmemload00:15:030
908299140,12cyclictest0-21swapper/023:11:140
908299140,12cyclictest0-21swapper/022:00:400
908299140,12cyclictest0-21swapper/021:15:460
324902140,2sleep00-21swapper/023:47:030
908599132,10cyclictest9081-21cyclictest21:53:363
9085991310,2cyclictest4632-21kworker/u8:119:25:043
9085991310,2cyclictest0-21swapper/323:26:433
9085991310,2cyclictest0-21swapper/322:55:283
9085991310,2cyclictest0-21swapper/322:52:533
9085991310,2cyclictest0-21swapper/322:35:453
9085991310,2cyclictest0-21swapper/322:10:213
9085991310,2cyclictest0-21swapper/321:36:173
9085991310,2cyclictest0-21swapper/321:15:453
9085991310,2cyclictest0-21swapper/321:10:213
9085991310,2cyclictest0-21swapper/319:50:093
908599130,2cyclictest0-21swapper/323:46:053
908599130,2cyclictest0-21swapper/322:25:213
908599130,2cyclictest0-21swapper/321:30:243
908599130,2cyclictest0-21swapper/320:40:163
908599130,2cyclictest0-21swapper/320:15:243
908599130,12cyclictest0-21swapper/322:24:343
908599130,12cyclictest0-21swapper/322:08:083
908599130,12cyclictest0-21swapper/321:05:263
908599130,12cyclictest0-21swapper/300:30:253
908599130,12cyclictest0-21swapper/300:01:253
908599130,11cyclictest0-21swapper/300:35:343
9084991310,2cyclictest27326-21kworker/u8:122:05:052
9084991310,2cyclictest12435-21kworker/u8:019:49:052
9084991310,2cyclictest0-21swapper/223:34:142
908499130,4cyclictest0-21swapper/220:18:012
908499130,2cyclictest14236-21mailstats21:45:212
908399133,2cyclictest21-21rcuc/100:28:231
9083991310,2cyclictest8013-21kworker/u8:221:07:041
9083991310,2cyclictest4632-21kworker/u8:119:28:041
9083991310,2cyclictest4632-21kworker/u8:119:17:041
9083991310,2cyclictest4632-21kworker/u8:119:13:051
9083991310,2cyclictest28098-21kworker/u8:220:43:041
9083991310,2cyclictest28098-21kworker/u8:220:38:011
9083991310,2cyclictest16510-21kworker/u8:020:15:041
9083991310,2cyclictest15727-21kworker/u8:000:18:051
9083991310,2cyclictest11759-21diskmemload22:17:131
9083991310,2cyclictest0-21swapper/123:50:301
908399130,2cyclictest0-21swapper/123:58:041
908399130,2cyclictest0-21swapper/123:45:021
908399130,2cyclictest0-21swapper/122:58:041
908399130,2cyclictest0-21swapper/120:10:141
908399130,12cyclictest0-21swapper/121:10:431
908399130,12cyclictest0-21swapper/100:37:421
908399130,11cyclictest0-21swapper/122:00:011
908299138,3cyclictest0-21swapper/022:30:150
9082991311,1cyclictest0-21swapper/021:28:060
9082991311,1cyclictest0-21swapper/020:05:110
9082991310,2cyclictest22307-21ssh23:35:560
9082991310,2cyclictest11759-21diskmemload22:25:180
9082991310,2cyclictest0-21swapper/023:50:590
9082991310,2cyclictest0-21swapper/023:20:520
9082991310,2cyclictest0-21swapper/023:05:120
9082991310,2cyclictest0-21swapper/000:10:360
908299130,2cyclictest0-21swapper/022:58:550
908299130,1cyclictest0-21swapper/000:00:560
908299130,12cyclictest0-21swapper/021:45:170
908299130,12cyclictest0-21swapper/021:35:060
908299130,12cyclictest0-21swapper/000:26:450
908299130,11cyclictest11759-21diskmemload23:33:000
908299130,11cyclictest0-21swapper/023:15:060
908299130,11cyclictest0-21swapper/021:10:320
908599129,2cyclictest30523-21fschecks_count20:35:143
908599129,2cyclictest0-21swapper/320:30:183
908599120,2cyclictest0-21swapper/323:40:033
908599120,2cyclictest0-21swapper/320:10:233
908599120,11cyclictest0-21swapper/321:56:003
908599120,11cyclictest0-21swapper/320:50:213
908499129,2cyclictest0-21swapper/221:38:052
908499120,2cyclictest0-21swapper/223:00:042
908399129,2cyclictest4632-21kworker/u8:119:23:041
908399129,2cyclictest28215-21kworker/u8:022:46:021
908399129,2cyclictest28215-21kworker/u8:022:46:011
908399129,2cyclictest1470-21apt-get20:45:051
908399129,2cyclictest12435-21kworker/u8:019:45:041
908399129,2cyclictest0-21swapper/100:20:161
908399121,9cyclictest0-21swapper/120:25:051
908399120,2cyclictest0-21swapper/123:41:221
908399120,2cyclictest0-21swapper/121:52:451
908399120,11cyclictest0-21swapper/120:50:181
908399120,10cyclictest11759-21diskmemload22:10:381
9082991210,1cyclictest0-21swapper/020:00:170
9082991210,1cyclictest0-21swapper/020:00:160
908299120,2cyclictest0-21swapper/023:00:060
908299120,1cyclictest0-21swapper/022:50:040
908299120,11cyclictest12-21rcu_preempt22:10:510
908299120,11cyclictest0-21swapper/022:20:140
908299120,11cyclictest0-21swapper/021:05:170
908299120,11cyclictest0-21swapper/020:35:140
908299120,11cyclictest0-21swapper/020:25:170
908299120,11cyclictest0-21swapper/019:40:070
908299120,11cyclictest0-21swapper/000:35:070
281142120,2sleep00-21swapper/020:30:150
251042120,1sleep011-21rcuc/020:20:260
21872120,2sleep10-21swapper/122:07:111
908599118,2cyclictest4632-21kworker/u8:119:11:043
908599118,2cyclictest25840-21apt-get20:25:073
908599118,2cyclictest0-21swapper/319:55:053
908599110,2cyclictest0-21swapper/320:08:343
908499118,2cyclictest28098-21kworker/u8:220:42:052
908399111,2cyclictest5901-21apt-get20:55:101
908399110,9cyclictest0-21swapper/119:55:061
908399110,3cyclictest14146-21munin-node1
908399110,2cyclictest0-21swapper/121:55:221
908399110,10cyclictest0-21swapper/100:10:031
908299112,7cyclictest0-21swapper/021:03:580
908299112,6cyclictest0-21swapper/020:59:020
908299112,6cyclictest0-21swapper/020:43:580
908299111,6cyclictest0-21swapper/019:30:160
908299110,9cyclictest0-21swapper/020:45:260
908299110,2cyclictest0-21swapper/020:15:260
908299110,1cyclictest0-21swapper/020:10:270
908599107,2cyclictest4632-21kworker/u8:119:21:053
908599107,2cyclictest16510-21kworker/u8:020:20:013
908599107,2cyclictest13522-21kworker/u8:220:03:043
908599107,2cyclictest13522-21kworker/u8:220:03:043
908599107,2cyclictest11123-21kworker/u8:219:32:013
908499102,7cyclictest0-21swapper/220:53:012
908399107,2cyclictest3280-21kworker/u8:121:02:041
908299102,6cyclictest0-21swapper/019:55:010
908299102,6cyclictest0-21swapper/019:40:010
908299101,7cyclictest10257-21cron19:20:000
908299100,6cyclictest0-21swapper/019:25:160
90859996,2cyclictest4632-21kworker/u8:119:18:043
90859996,2cyclictest11123-21kworker/u8:219:36:043
90859990,8cyclictest0-21swapper/321:00:173
90859990,2cyclictest0-21swapper/320:55:333
90829992,6cyclictest0-21swapper/019:10:130
90829991,6cyclictest0-21swapper/019:55:210
90859985,2cyclictest0-21swapper/319:43:273
90859980,2cyclictest0-21swapper/319:46:303
90829980,6cyclictest0-21swapper/019:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional