You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 05:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Jul 14, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2035421190,0sleep00-21swapper/021:35:510
2035421190,0sleep00-21swapper/021:35:510
11363211694,16sleep10-21swapper/119:05:521
10285211290,16sleep00-21swapper/019:05:070
11842210587,12sleep20-21swapper/219:06:572
12045210279,18sleep30-21swapper/319:09:343
106942740,0sleep30-21swapper/321:59:513
57072700,0sleep30-21swapper/323:33:353
46052680,0sleep20-21swapper/222:25:382
322322650,0sleep00-21swapper/022:55:000
176742550,0sleep00-21swapper/022:06:010
243072540,2sleep324292-21munin-run23:20:003
119472480,1sleep011945-21ssh21:27:210
17352300,0sleep10-21swapper/121:50:141
98342210,1sleep3381ktimersoftd/320:26:013
284192200,0sleep30-21swapper/321:45:003
1210699201,2cyclictest101ktimersoftd/022:15:110
1210699200,18cyclictest0-21swapper/000:20:100
109892200,1sleep10-21swapper/100:11:331
1210699191,3cyclictest0-21swapper/022:10:120
1210699190,17cyclictest0-21swapper/021:10:100
1210899180,4cyclictest0-21swapper/222:45:042
251172170,1sleep20-21swapper/222:14:252
12109991714,2cyclictest14191-21kworker/u8:222:39:043
12108991714,2cyclictest14191-21kworker/u8:222:36:052
12107991714,2cyclictest24804-21kworker/u8:223:37:051
12109991613,2cyclictest4985-21kworker/u8:223:12:043
12109991613,2cyclictest27279-21kworker/u8:019:54:043
12109991613,2cyclictest16404-21kworker/u8:300:24:043
12109991613,2cyclictest1079-21kworker/u8:022:25:043
1210999160,14cyclictest3649-21snmpd21:20:183
12108991613,2cyclictest27279-21kworker/u8:020:20:052
12108991613,2cyclictest20436-21kworker/u8:322:19:042
12108991613,2cyclictest16809-21kworker/u8:200:07:042
12107991612,2cyclictest27279-21kworker/u8:020:06:041
1210799161,14cyclictest0-21swapper/100:24:041
1210799160,2cyclictest0-21swapper/122:39:041
1210999151,2cyclictest1600-21ssh00:02:203
12109991512,2cyclictest30733-21kworker/u8:121:50:013
12109991512,2cyclictest20062-21kworker/u8:022:59:043
12109991512,2cyclictest19666-21kworker/u8:219:29:043
12109991512,2cyclictest12315-21kworker/u8:019:34:043
12109991512,2cyclictest1079-21kworker/u8:022:32:043
1210999150,13cyclictest7545-21ssh00:08:443
1210999150,13cyclictest3560-21munin-node21:37:383
1210999150,13cyclictest3560-21munin-node21:37:373
1210999150,13cyclictest20955-21aten2.4_r3power22:10:123
1210999150,13cyclictest14222-21ssh22:02:433
1210899151,2cyclictest22135-21perl19:35:152
12108991512,2cyclictest9679-21kworker/u8:222:07:042
12108991512,2cyclictest8824-21kworker/u8:120:35:042
12108991512,2cyclictest8824-21kworker/u8:120:31:042
12108991512,2cyclictest7940-21kworker/u8:100:20:042
12108991512,2cyclictest30733-21kworker/u8:121:54:042
12108991512,2cyclictest27279-21kworker/u8:020:09:042
12108991512,2cyclictest16809-21kworker/u8:223:52:062
1210799151,2cyclictest0-21swapper/123:12:041
12107991511,2cyclictest25061-21entropy23:20:151
1210799151,12cyclictest14911-21ssh22:03:471
12107991511,2cyclictest0-21swapper/123:25:171
1210799151,12cyclictest0-21swapper/100:07:171
1210799150,2cyclictest0-21swapper/122:45:041
1210699151,3cyclictest32335-21ssh00:00:180
1210699151,2cyclictest101ktimersoftd/023:55:160
12106991512,2cyclictest101ktimersoftd/021:56:040
12106991511,2cyclictest101ktimersoftd/020:00:140
12106991510,3cyclictest16777-21ssh23:45:110
325862140,3sleep132721-21sshd22:55:141
313372141,9sleep331437-21iostat_ios22:20:163
1210999141,2cyclictest16765-21munin-node3
12109991411,2cyclictest26404-21diskmemload22:07:483
1210999140,2cyclictest0-21swapper/319:15:133
1210999140,12cyclictest0-21swapper/323:38:243
1210999140,12cyclictest0-21swapper/322:45:483
1210999140,12cyclictest0-21swapper/322:16:143
12108991411,2cyclictest28720-21kworker/u8:100:02:012
12108991411,2cyclictest28015-21kworker/u8:119:28:032
12108991411,2cyclictest26882-21kworker/u8:021:41:042
12108991411,2cyclictest24804-21kworker/u8:223:35:052
12108991411,2cyclictest24804-21kworker/u8:223:34:042
12108991411,2cyclictest18623-21kworker/u8:121:32:052
12108991411,2cyclictest18623-21kworker/u8:121:20:042
12108991411,2cyclictest18623-21kworker/u8:121:19:042
12108991411,2cyclictest13456-21kworker/u8:000:15:052
12108991411,2cyclictest12315-21kworker/u8:019:32:042
12108991411,2cyclictest12315-21kworker/u8:019:20:042
12108991411,2cyclictest0-21swapper/221:25:152
12108991410,2cyclictest3728-21runrttasks23:25:442
12108991410,2cyclictest0-21swapper/223:15:452
1210899140,3cyclictest7113-21ssh23:01:042
1210899140,2cyclictest0-21swapper/222:22:052
1210899140,13cyclictest0-21swapper/222:41:052
1210899140,12cyclictest0-21swapper/219:10:162
1210799149,3cyclictest26404-21diskmemload21:55:151
1210799141,2cyclictest0-21swapper/122:32:041
12107991411,2cyclictest18623-21kworker/u8:121:14:041
12107991411,2cyclictest0-21swapper/123:17:281
12107991411,2cyclictest0-21swapper/121:20:181
1210799140,2cyclictest0-21swapper/121:44:041
1210799140,2cyclictest0-21swapper/121:15:201
1210799140,12cyclictest27392-21memory23:55:181
1210799140,12cyclictest21015-21cut19:30:511
1210799140,12cyclictest0-21swapper/123:30:061
1210799140,12cyclictest0-21swapper/121:25:141
1210699143,9cyclictest101ktimersoftd/022:34:520
1210699141,11cyclictest0-21swapper/000:05:140
1210699140,12cyclictest2393-21ssh21:17:570
1210699140,12cyclictest0-21swapper/022:39:570
290732130,2sleep10-21swapper/122:18:021
12109991310,2cyclictest3649-21snmpd21:15:163
12109991310,2cyclictest20062-21kworker/u8:022:54:043
12109991310,2cyclictest13083-21kworker/u8:023:20:043
12109991310,2cyclictest0-21swapper/323:56:333
12109991310,2cyclictest0-21swapper/323:44:223
12109991310,2cyclictest0-21swapper/323:25:503
12109991310,2cyclictest0-21swapper/323:06:103
12109991310,2cyclictest0-21swapper/323:00:193
12109991310,2cyclictest0-21swapper/322:43:443
12109991310,2cyclictest0-21swapper/321:45:123
12109991310,2cyclictest0-21swapper/321:30:033
12109991310,2cyclictest0-21swapper/321:25:183
12109991310,2cyclictest0-21swapper/321:14:113
12109991310,2cyclictest0-21swapper/320:40:513
12109991310,2cyclictest0-21swapper/320:36:033
1210999130,2cyclictest0-21swapper/320:45:193
1210999130,2cyclictest0-21swapper/320:11:013
1210999130,2cyclictest0-21swapper/300:36:013
1210999130,12cyclictest0-21swapper/323:50:003
1210999130,12cyclictest0-21swapper/300:31:033
1210999130,12cyclictest0-21swapper/300:15:003
1210899139,2cyclictest0-21swapper/220:51:042
1210899138,3cyclictest0-21swapper/200:30:462
12108991310,2cyclictest30733-21kworker/u8:121:55:042
12108991310,2cyclictest29365-21smartctl21:45:152
12108991310,2cyclictest27279-21kworker/u8:019:52:002
12108991310,2cyclictest22719-21kworker/u8:221:05:042
12108991310,2cyclictest22719-21kworker/u8:221:01:042
12108991310,2cyclictest20062-21kworker/u8:022:50:032
12108991310,2cyclictest16404-21kworker/u8:300:25:052
12108991310,2cyclictest16280-21kworker/u8:020:44:042
12108991310,2cyclictest0-21swapper/220:10:152
12108991310,2cyclictest0-21swapper/200:35:152
1210899130,2cyclictest17956-21unixbench_multi20:46:052
1210899130,2cyclictest0-21swapper/222:55:122
1210899130,2cyclictest0-21swapper/219:20:002
1210899130,12cyclictest0-21swapper/223:57:472
1210899130,12cyclictest0-21swapper/223:40:112
1210899130,12cyclictest0-21swapper/223:06:352
1210899130,12cyclictest0-21swapper/221:13:352
1210899130,11cyclictest26404-21diskmemload23:46:472
1210899130,11cyclictest0-21swapper/223:10:062
1210899130,11cyclictest0-21swapper/222:33:482
1210799132,9cyclictest0-21swapper/100:26:381
1210799131,3cyclictest27682-21munin-node1
1210799131,3cyclictest21571-21munin-node1
1210799131,3cyclictest16577-21munin-node1
12107991310,2cyclictest10078-21kworker/u8:123:46:051
12107991310,2cyclictest0-21swapper/121:38:181
12107991310,2cyclictest0-21swapper/121:38:181
12107991310,2cyclictest0-21swapper/120:40:161
12107991310,2cyclictest0-21swapper/119:55:411
1210799130,2cyclictest26404-21diskmemload22:25:181
1210799130,2cyclictest0-21swapper/119:29:041
1210799130,12cyclictest0-21swapper/122:21:041
1210799130,12cyclictest0-21swapper/122:13:581
1210799130,12cyclictest0-21swapper/120:27:041
1210799130,12cyclictest0-21swapper/119:16:031
1210799130,12cyclictest0-21swapper/100:39:481
1210799130,12cyclictest0-21swapper/100:30:141
1210799130,11cyclictest0-21swapper/123:05:301
1210699138,3cyclictest13255-21turbostat00:19:550
1210699132,8cyclictest0-21swapper/021:45:010
1210699132,7cyclictest0-21swapper/022:00:010
1210699132,6cyclictest0-21swapper/023:20:000
1210699132,6cyclictest0-21swapper/020:09:590
1210699131,2cyclictest11-21rcuc/022:59:060
12106991310,2cyclictest0-21swapper/022:49:360
12106991310,2cyclictest0-21swapper/021:46:260
1210699130,7cyclictest0-21swapper/019:50:000
1210699130,2cyclictest0-21swapper/023:36:270
1210699130,12cyclictest0-21swapper/020:30:190
1210699130,11cyclictest0-21swapper/020:25:140
1210999129,2cyclictest22719-21kworker/u8:221:02:053
1210999129,2cyclictest12105-21cyclictest20:06:043
1210999129,2cyclictest0-21swapper/319:10:103
1210999120,2cyclictest0-21swapper/300:25:183
1210999120,1cyclictest0-21swapper/319:45:193
1210999120,11cyclictest0-21swapper/300:11:053
1210899129,2cyclictest30863-21kworker/u8:220:01:042
1210899129,2cyclictest27279-21kworker/u8:019:58:042
1210899129,2cyclictest19666-21kworker/u8:219:47:042
1210899129,2cyclictest16280-21kworker/u8:020:55:042
1210899129,2cyclictest0-21swapper/221:35:452
1210899129,2cyclictest0-21swapper/221:35:442
1210899120,11cyclictest0-21swapper/223:20:592
1210899120,11cyclictest0-21swapper/222:02:122
1210899120,11cyclictest0-21swapper/220:25:182
1210899120,11cyclictest0-21swapper/200:10:282
1210799129,2cyclictest16280-21kworker/u8:020:51:041
1210799129,2cyclictest0-21swapper/122:05:081
1210799129,2cyclictest0-21swapper/120:21:051
1210799129,2cyclictest0-21swapper/119:20:191
1210799121,9cyclictest31653-21apt-get20:00:121
1210799121,9cyclictest14415-21df_abs21:30:111
1210799121,9cyclictest12319-21munin-node1
1210799121,3cyclictest31684-21grep00:00:141
1210799121,3cyclictest22616-21munin-node1
1210799121,3cyclictest17930-21munin-node1
1210799120,3cyclictest11841-21munin-node1
1210799120,3cyclictest0-21swapper/100:15:111
1210799120,2cyclictest0-21swapper/123:52:031
1210799120,2cyclictest0-21swapper/121:45:381
1210799120,2cyclictest0-21swapper/120:39:131
1210799120,11cyclictest0-21swapper/123:00:361
1210799120,11cyclictest0-21swapper/119:45:141
1210799120,10cyclictest22563-21date21:00:001
1210699129,2cyclictest11-21rcuc/000:38:150
1210699129,2cyclictest0-21swapper/022:20:120
1210699122,7cyclictest0-21swapper/019:26:590
1210699122,6cyclictest0-21swapper/020:20:000
1210699120,2cyclictest0-21swapper/023:20:190
1210699120,2cyclictest0-21swapper/021:50:250
1210699120,11cyclictest0-21swapper/023:07:150
1210699120,11cyclictest0-21swapper/022:29:260
1210699120,11cyclictest0-21swapper/021:30:230
1210699120,11cyclictest0-21swapper/019:15:140
1210699120,11cyclictest0-21swapper/000:31:560
1210699120,11cyclictest0-21swapper/000:10:470
1210999118,2cyclictest31681-21head20:00:133
1210999110,2cyclictest0-21swapper/319:23:383
1210999110,10cyclictest0-21swapper/320:53:343
1210899118,2cyclictest0-21swapper/220:15:112
1210899112,6cyclictest0-21swapper/219:41:592
1210799118,2cyclictest0-21swapper/120:15:181
1210799111,8cyclictest10735-21apt-get20:30:121
1210799111,8cyclictest0-21swapper/121:05:131
1210699118,2cyclictest101ktimersoftd/022:41:160
1210699118,2cyclictest0-21swapper/023:30:170
1210699118,2cyclictest0-21swapper/023:13:270
1210699118,2cyclictest0-21swapper/021:20:060
1210699118,2cyclictest0-21swapper/021:05:120
1210699118,2cyclictest0-21swapper/000:28:070
1210699116,3cyclictest7561-21cut20:20:150
1210699114,3cyclictest0-21swapper/019:40:000
1210699111,6cyclictest0-21swapper/020:50:110
1210699110,2cyclictest26404-21diskmemload23:53:190
1210699110,2cyclictest0-21swapper/023:41:200
1210699110,2cyclictest0-21swapper/023:28:420
1210699110,2cyclictest0-21swapper/019:41:050
1210699110,10cyclictest0-21swapper/023:03:060
1210699110,10cyclictest0-21swapper/020:41:050
1210999107,2cyclictest0-21swapper/319:44:583
1210999106,3cyclictest25432-21sed21:05:173
1210999101,5cyclictest27450jbd2/sda1-820:55:053
1210799107,2cyclictest0-21swapper/119:50:191
1210799107,2cyclictest0-21swapper/119:40:201
1210699107,2cyclictest0-21swapper/019:55:180
1210699102,5cyclictest0-21swapper/019:12:590
121099996,2cyclictest0-21swapper/320:30:133
121099994,3cyclictest7194-21cpu20:20:133
121099990,2cyclictest0-21swapper/319:57:143
121099990,2cyclictest0-21swapper/319:38:193
121079990,8cyclictest0-21swapper/120:10:161
121069996,2cyclictest0-21swapper/019:21:010
121069994,3cyclictest22911-21tr21:00:140
121069994,3cyclictest22377-21cron21:00:000
121069994,3cyclictest20455-21fschecks_time19:30:150
121069992,6cyclictest0-21swapper/020:36:000
121069990,3cyclictest0-21swapper/019:50:150
121099984,3cyclictest5887-21awk20:15:193
121069983,3cyclictest2931-21telnet20:10:110
121069982,4cyclictest16948-21grep20:45:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional