You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 09:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Tue Mar 10, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
937211795,16sleep10-21swapper/119:07:481
968211693,18sleep20-21swapper/219:08:132
1018211695,16sleep00-21swapper/019:08:510
1058211493,15sleep30-21swapper/319:09:223
7582760,1sleep20-21swapper/223:31:262
301122730,0sleep00-21swapper/021:21:190
67562690,1sleep16758-21rm22:34:391
152782520,1sleep10-21swapper/122:42:151
113499280,13cyclictest0-21swapper/123:35:101
221142240,0sleep10-21swapper/122:49:501
113699221,3cyclictest0-21swapper/300:00:113
113499210,19cyclictest0-21swapper/121:40:121
113499210,19cyclictest0-21swapper/100:35:111
113499200,2cyclictest0-21swapper/121:50:111
113399200,18cyclictest0-21swapper/023:30:110
113399200,18cyclictest0-21swapper/022:40:100
253022190,3sleep0113399cyclictest21:49:170
253022190,3sleep0113399cyclictest21:49:170
113599191,3cyclictest3593-21ssh23:35:102
90402180,1sleep30-21swapper/300:11:053
44092180,0sleep00-21swapper/023:35:140
301192170,1sleep130120-21forks20:20:141
113699170,2cyclictest0-21swapper/300:30:103
92562160,0sleep20-21swapper/200:11:242
113599161,3cyclictest27473-21munin-run20:15:002
113499161,3cyclictest0-21swapper/120:40:121
1134991611,3cyclictest17374-21diskmemload00:29:221
113499160,13cyclictest0-21swapper/122:15:151
113399160,2cyclictest0-21swapper/022:45:140
283772150,3sleep30-21swapper/320:15:203
113699150,2cyclictest0-21swapper/321:50:123
113699150,2cyclictest0-21swapper/319:50:123
113699150,14cyclictest0-21swapper/321:19:203
113699150,13cyclictest18814-21ssh23:17:423
113599151,3cyclictest0-21swapper/221:55:222
1135991510,3cyclictest0-21swapper/223:10:152
113599150,2cyclictest0-21swapper/223:55:122
113499152,7cyclictest0-21swapper/122:00:011
113499151,3cyclictest0-21swapper/122:10:301
113499151,12cyclictest13573-21ssh21:37:021
1134991511,2cyclictest0-21swapper/122:59:431
1134991510,3cyclictest0-21swapper/121:17:141
113499150,13cyclictest0-21swapper/123:57:211
200682140,1sleep00-21swapper/021:44:050
184292140,0sleep30-21swapper/322:45:193
113699149,3cyclictest4744-21ssh23:04:213
113699142,9cyclictest8717-21ssh22:35:433
113699141,11cyclictest18533-21ssh00:20:423
1136991410,2cyclictest0-21swapper/300:05:103
113699140,3cyclictest3649-21snmpd19:40:113
113699140,12cyclictest0-21swapper/321:21:073
113699140,12cyclictest0-21swapper/320:55:113
113599141,11cyclictest0-21swapper/221:50:342
1135991410,3cyclictest0-21swapper/200:05:162
113599140,12cyclictest0-21swapper/222:05:502
113499149,3cyclictest30007-21munin-node1
113499149,3cyclictest0-21swapper/122:53:061
113499142,6cyclictest0-21swapper/119:50:001
1134991411,2cyclictest0-21swapper/123:08:011
1134991411,2cyclictest0-21swapper/122:36:121
1134991411,2cyclictest0-21swapper/119:15:121
1134991410,2cyclictest0-21swapper/119:45:121
113499140,13cyclictest0-21swapper/122:21:021
113499140,13cyclictest0-21swapper/100:11:021
113499140,12cyclictest0-21swapper/123:23:051
113499140,12cyclictest0-21swapper/121:48:321
113499140,12cyclictest0-21swapper/121:48:321
113499140,12cyclictest0-21swapper/100:22:311
1133991411,2cyclictest0-21swapper/022:04:470
1133991411,2cyclictest0-21swapper/000:15:130
113399140,2cyclictest0-21swapper/023:05:170
113399140,2cyclictest0-21swapper/021:10:170
113399140,2cyclictest0-21swapper/020:10:170
113399140,13cyclictest0-21swapper/022:05:170
113399140,12cyclictest0-21swapper/019:55:000
224692130,1sleep20-21swapper/223:21:012
220562130,2sleep20-21swapper/222:17:132
199552130,2sleep20-21swapper/222:46:432
1136991310,2cyclictest17374-21diskmemload22:27:093
1136991310,2cyclictest0-21swapper/323:45:413
1136991310,2cyclictest0-21swapper/322:32:023
1136991310,2cyclictest0-21swapper/322:17:123
1136991310,2cyclictest0-21swapper/322:08:103
1136991310,2cyclictest0-21swapper/321:42:273
1136991310,2cyclictest0-21swapper/321:25:083
1136991310,2cyclictest0-21swapper/300:39:153
113699130,2cyclictest9198-21ssh21:33:033
113699130,2cyclictest0-21swapper/321:12:573
113699130,2cyclictest0-21swapper/319:11:043
113699130,12cyclictest0-21swapper/323:10:133
113699130,12cyclictest0-21swapper/322:50:123
113699130,12cyclictest0-21swapper/322:40:103
113699130,11cyclictest0-21swapper/323:05:323
113699130,11cyclictest0-21swapper/322:20:183
113699130,11cyclictest0-21swapper/300:16:193
113599139,3cyclictest3649-21snmpd19:30:092
113599139,3cyclictest3430-21cut19:15:112
113599139,3cyclictest0-21swapper/223:50:122
113599139,3cyclictest0-21swapper/223:01:012
113599138,3cyclictest8736-21ssh23:07:462
1135991310,2cyclictest0-21swapper/221:45:352
1135991310,2cyclictest0-21swapper/221:45:352
113599130,2cyclictest0-21swapper/221:33:022
113599130,12cyclictest31824-21ssh00:02:042
113599130,12cyclictest0-21swapper/222:40:102
113599130,12cyclictest0-21swapper/221:00:122
113599130,11cyclictest0-21swapper/221:23:282
113599130,11cyclictest0-21swapper/221:17:022
113499137,5cyclictest0-21swapper/123:31:211
113499132,6cyclictest0-21swapper/119:45:001
1134991310,2cyclictest0-21swapper/122:27:521
1134991310,2cyclictest0-21swapper/121:28:051
113499130,2cyclictest29762-21ssh00:31:421
113499130,2cyclictest0-21swapper/123:18:251
113499130,2cyclictest0-21swapper/122:05:111
113499130,12cyclictest0-21swapper/123:45:321
113499130,12cyclictest0-21swapper/123:27:351
113499130,12cyclictest0-21swapper/123:03:221
113499130,12cyclictest0-21swapper/121:23:021
1133991310,2cyclictest0-21swapper/023:17:470
1133991310,2cyclictest0-21swapper/022:56:220
1133991310,2cyclictest0-21swapper/022:10:190
1133991310,2cyclictest0-21swapper/021:55:140
1133991310,2cyclictest0-21swapper/021:15:050
1133991310,2cyclictest0-21swapper/000:31:370
1133991310,2cyclictest0-21swapper/000:24:470
113399130,2cyclictest0-21swapper/023:45:540
113399130,2cyclictest0-21swapper/020:05:160
113399130,2cyclictest0-21swapper/000:09:570
113399130,12cyclictest0-21swapper/023:51:020
113399130,12cyclictest0-21swapper/023:43:450
113399130,12cyclictest0-21swapper/020:25:140
113399130,12cyclictest0-21swapper/020:20:160
113399130,12cyclictest0-21swapper/019:55:120
113399130,12cyclictest0-21swapper/000:29:350
113399130,11cyclictest0-21swapper/023:00:040
113399130,11cyclictest0-21swapper/021:28:010
261512120,2sleep226161-21ssh22:53:212
135722120,2sleep10-21swapper/121:00:091
113699129,2cyclictest0-21swapper/322:55:203
113699129,2cyclictest0-21swapper/322:14:493
113699129,2cyclictest0-21swapper/320:30:133
113699129,2cyclictest0-21swapper/319:15:123
113699122,6cyclictest0-21swapper/320:00:003
113699120,2cyclictest0-21swapper/323:41:013
113699120,2cyclictest0-21swapper/321:35:093
113699120,11cyclictest0-21swapper/323:55:413
113699120,11cyclictest0-21swapper/323:36:283
113699120,11cyclictest0-21swapper/323:33:493
113699120,11cyclictest0-21swapper/323:25:103
113699120,11cyclictest0-21swapper/323:21:483
113699120,11cyclictest0-21swapper/322:02:113
113699120,11cyclictest0-21swapper/321:55:393
113699120,11cyclictest0-21swapper/321:46:313
113699120,11cyclictest0-21swapper/321:46:313
113699120,11cyclictest0-21swapper/320:45:203
113699120,11cyclictest0-21swapper/320:35:173
113699120,11cyclictest0-21swapper/300:25:083
113699120,10cyclictest18888-21ssh23:50:053
113599129,2cyclictest0-21swapper/222:55:222
113599129,2cyclictest0-21swapper/222:21:542
113599129,2cyclictest0-21swapper/222:10:012
113599129,2cyclictest0-21swapper/222:00:172
113599129,2cyclictest0-21swapper/220:40:132
113599129,2cyclictest0-21swapper/219:35:132
113599129,2cyclictest0-21swapper/200:36:192
113599129,2cyclictest0-21swapper/200:30:082
113599120,2cyclictest0-21swapper/221:26:442
113599120,2cyclictest0-21swapper/200:16:372
113599120,11cyclictest0-21swapper/223:43:212
113599120,11cyclictest0-21swapper/223:16:522
113599120,11cyclictest0-21swapper/222:37:482
113599120,11cyclictest0-21swapper/222:25:292
113599120,11cyclictest0-21swapper/221:43:312
113599120,11cyclictest0-21swapper/221:37:482
113599120,11cyclictest0-21swapper/221:10:152
113599120,11cyclictest0-21swapper/220:51:042
113599120,11cyclictest0-21swapper/220:00:152
113599120,11cyclictest0-21swapper/200:25:162
113599120,11cyclictest0-21swapper/200:20:342
113499129,2cyclictest0-21swapper/123:53:181
113499129,2cyclictest0-21swapper/100:05:311
113499127,3cyclictest0-21swapper/121:30:161
113499122,7cyclictest0-21swapper/119:14:591
113499121,9cyclictest0-21swapper/121:10:131
113499121,9cyclictest0-21swapper/120:35:131
113499121,9cyclictest0-21swapper/120:25:131
113499121,3cyclictest0-21swapper/120:55:121
113499120,2cyclictest0-21swapper/121:55:061
113499120,2cyclictest0-21swapper/119:55:401
113499120,11cyclictest0-21swapper/123:44:231
113499120,11cyclictest0-21swapper/123:10:141
113499120,11cyclictest0-21swapper/119:35:171
113499120,11cyclictest0-21swapper/119:20:161
113499120,10cyclictest0-21swapper/100:16:031
113399129,2cyclictest15702-21aten2.4_r3power21:05:130
113399129,2cyclictest0-21swapper/023:55:340
113399129,2cyclictest0-21swapper/023:26:040
113399129,2cyclictest0-21swapper/022:50:050
113399129,2cyclictest0-21swapper/020:45:170
113399129,2cyclictest0-21swapper/000:35:160
113399120,2cyclictest0-21swapper/023:11:050
113399120,2cyclictest0-21swapper/022:36:430
113399120,2cyclictest0-21swapper/022:33:020
113399120,2cyclictest0-21swapper/022:28:050
113399120,2cyclictest0-21swapper/021:50:470
113399120,2cyclictest0-21swapper/021:36:030
113399120,2cyclictest0-21swapper/020:15:170
113399120,2cyclictest0-21swapper/020:00:140
113399120,2cyclictest0-21swapper/000:14:360
113399120,2cyclictest0-21swapper/000:02:240
113399120,11cyclictest0-21swapper/023:21:150
113399120,11cyclictest0-21swapper/022:20:150
113399120,11cyclictest0-21swapper/021:30:060
113399120,11cyclictest0-21swapper/019:30:150
113699118,2cyclictest0-21swapper/319:45:123
113599118,2cyclictest0-21swapper/220:15:182
113599117,2cyclictest0-21swapper/219:40:122
113599110,9cyclictest31457-21kworker/u8:020:27:042
113599110,2cyclictest0-21swapper/223:45:592
113599110,2cyclictest0-21swapper/220:05:182
113599110,10cyclictest0-21swapper/223:27:522
113499111,8cyclictest0-21swapper/120:50:141
113499111,8cyclictest0-21swapper/120:31:001
113499111,8cyclictest0-21swapper/120:15:181
113499111,3cyclictest7572-21munin-node1
113499111,3cyclictest21661-21munin-node1
113499110,9cyclictest25677-21munin-node1
113499110,9cyclictest0-21swapper/121:09:591
113499110,3cyclictest23668-21munin-node1
113499110,2cyclictest0-21swapper/120:46:051
113399118,2cyclictest0-21swapper/021:00:120
113399110,10cyclictest0-21swapper/022:15:300
113399110,10cyclictest0-21swapper/020:50:120
113399110,10cyclictest0-21swapper/019:15:070
113699102,5cyclictest0-21swapper/319:25:003
113699102,4cyclictest0-21swapper/319:30:003
113699101,5cyclictest0-21swapper/319:35:003
113699100,6cyclictest0-21swapper/320:54:593
113599107,2cyclictest0-21swapper/220:56:042
113599105,3cyclictest6046-21cut19:20:132
113599105,3cyclictest4487-21pzem_power20:35:512
113599105,3cyclictest2062-21latency19:10:172
113599105,3cyclictest1968-21kernelversion20:30:162
113599105,3cyclictest15809-21cpuspeed_turbos21:05:142
113599102,6cyclictest0-21swapper/219:48:592
113599100,9cyclictest0-21swapper/222:30:222
113499106,2cyclictest0-21swapper/119:30:111
113399106,3cyclictest5515-21sendmail20:40:080
113399103,6cyclictest0-21swapper/019:25:090
11369995,2cyclictest15366-21cron21:05:003
11369994,3cyclictest26291-21wc20:10:153
11369994,3cyclictest25038-21unixbench_multi20:06:023
11369994,3cyclictest13375-21cron19:40:003
11369990,2cyclictest0-21swapper/320:44:553
11359994,3cyclictest7858-21tr19:25:122
11359994,3cyclictest31234-21sshd20:21:372
11359994,3cyclictest20248-21cat19:55:152
11359993,4cyclictest8251-21grep20:45:172
11339996,2cyclictest0-21swapper/020:30:110
11339993,4cyclictest0-21swapper/019:45:120
11369983,3cyclictest32441-21grep20:25:173
11369983,3cyclictest29763-21cut20:20:123
11369983,3cyclictest21979-21grep20:00:133
11369983,3cyclictest16393-21missed_timers21:05:183
11359983,3cyclictest17615-21seq19:50:002
11339985,2cyclictest11637-21basename19:35:110
11339983,3cyclictest5864-21grep19:20:120
11339983,3cyclictest13678-21tail19:40:110
11339980,7cyclictest1347-21kworker/u8:219:13:040
11339974,2cyclictest101ktimersoftd/020:35:130
11339973,3cyclictest12069-21cut20:55:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional